2024-05-10T22:25:11.543450899Z ... 2024-05-10T22:25:12.076813160Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-10T22:25:12.716926911Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-10T22:25:23.791375581Z 2024-05-10T22:25:25.108256732Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-10T22:25:26.784980929Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-10T22:25:30.634515826Z [2024-05-10 22:25:30 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-05-10T22:25:30.655081912Z [2024-05-10 22:25:30 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-05-10T22:25:30.655215687Z [2024-05-10 22:25:30 +0000] [16] [INFO] Using worker: sync 2024-05-10T22:25:30.733402927Z [2024-05-10 22:25:30 +0000] [17] [INFO] Booting worker with pid: 17 2024-05-10T22:25:30.757396775Z [2024-05-10 22:25:30 +0000] [18] [INFO] Booting worker with pid: 18 2024-05-10T22:25:32.064907376Z 2024-05-10T22:25:32.064927295Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-05-10T22:25:32.064932091Z --- ***** ----- 2024-05-10T22:25:32.064935721Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-05-10 22:25:32 2024-05-10T22:25:32.064938863Z - *** --- * --- 2024-05-10T22:25:32.064942385Z - ** ---------- [config] 2024-05-10T22:25:32.064945976Z - ** ---------- .> app: airflow.executors.celery_executor:0x7fa904472b60 2024-05-10T22:25:32.064949018Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-05-10T22:25:32.064952145Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-05-10T22:25:32.064959389Z - *** --- * --- .> concurrency: 16 (prefork) 2024-05-10T22:25:32.064962540Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-05-10T22:25:32.064965699Z --- ***** ----- 2024-05-10T22:25:32.064968732Z -------------- [queues] 2024-05-10T22:25:32.064971807Z .> default exchange=default(direct) key=default 2024-05-10T22:25:32.064974956Z 2024-05-10T22:25:32.064977799Z 2024-05-10T22:25:32.064980764Z [tasks] 2024-05-10T22:25:32.064983774Z . airflow.executors.celery_executor.execute_command 2024-05-10T22:25:32.064986665Z 2024-05-10T22:25:36.766216603Z [2024-05-10 22:25:36,759: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-05-10T22:25:36.779594134Z [2024-05-10 22:25:36,778: INFO/MainProcess] mingle: searching for neighbors 2024-05-10T22:25:37.805334170Z [2024-05-10 22:25:37,805: INFO/MainProcess] mingle: all alone 2024-05-10T22:25:37.833104414Z [2024-05-10 22:25:37,832: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-05-10T22:26:13.794281572Z [2024-05-10 22:26:13,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03ea077b-8f51-4362-9798-d81456401c3c] received 2024-05-10T22:26:13.891051086Z [2024-05-10 22:26:13,890: INFO/ForkPoolWorker-15] [03ea077b-8f51-4362-9798-d81456401c3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:26:14.548252772Z [2024-05-10 22:26:14,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:26:15.865245877Z [2024-05-10 22:26:15,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:26:17.032143408Z [2024-05-10 22:26:17,025: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03ea077b-8f51-4362-9798-d81456401c3c] succeeded in 3.2179048340000236s: None 2024-05-10T22:26:27.870941278Z [2024-05-10 22:26:27,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d25e802-ed5b-48f4-b593-768b8249c0a1] received 2024-05-10T22:26:27.884643481Z [2024-05-10 22:26:27,884: INFO/ForkPoolWorker-15] [0d25e802-ed5b-48f4-b593-768b8249c0a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:26:28.450906014Z [2024-05-10 22:26:28,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:26:28.741002544Z [2024-05-10 22:26:28,740: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:26:29.373501523Z [2024-05-10 22:26:29,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d25e802-ed5b-48f4-b593-768b8249c0a1] succeeded in 1.4999435070000118s: None 2024-05-10T22:28:00.464977376Z [2024-05-10 22:28:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efa118e1-451a-4598-ac9e-b14754f7ad5c] received 2024-05-10T22:28:00.494127269Z [2024-05-10 22:28:00,493: INFO/ForkPoolWorker-15] [efa118e1-451a-4598-ac9e-b14754f7ad5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:28:00.903080854Z [2024-05-10 22:28:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:28:01.248279457Z [2024-05-10 22:28:01,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:28:01.899897495Z [2024-05-10 22:28:01,899: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efa118e1-451a-4598-ac9e-b14754f7ad5c] succeeded in 1.4326019200000246s: None 2024-05-10T22:30:01.005098389Z [2024-05-10 22:30:01,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64d5ec3e-b914-4737-9cd3-fb9713ad7e3c] received 2024-05-10T22:30:01.019327290Z [2024-05-10 22:30:01,018: INFO/ForkPoolWorker-15] [64d5ec3e-b914-4737-9cd3-fb9713ad7e3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:30:01.392920563Z [2024-05-10 22:30:01,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:30:01.651396602Z [2024-05-10 22:30:01,651: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:30:02.236353206Z [2024-05-10 22:30:02,235: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64d5ec3e-b914-4737-9cd3-fb9713ad7e3c] succeeded in 1.228856329999985s: None 2024-05-10T22:32:00.435076061Z [2024-05-10 22:32:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99d790a2-0204-48d4-aefb-4c6728fe948c] received 2024-05-10T22:32:00.466751876Z [2024-05-10 22:32:00,466: INFO/ForkPoolWorker-15] [99d790a2-0204-48d4-aefb-4c6728fe948c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:32:00.813669324Z [2024-05-10 22:32:00,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:32:01.137159531Z [2024-05-10 22:32:01,136: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:01.702516531Z [2024-05-10 22:32:01,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99d790a2-0204-48d4-aefb-4c6728fe948c] succeeded in 1.2633803779999653s: None 2024-05-10T22:32:29.574525528Z [2024-05-10 22:32:29,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c462bbf3-42c8-48aa-bd6a-6ee1121f610a] received 2024-05-10T22:32:29.590807746Z [2024-05-10 22:32:29,590: INFO/ForkPoolWorker-15] [c462bbf3-42c8-48aa-bd6a-6ee1121f610a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:32:29.965038489Z [2024-05-10 22:32:29,962: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:32:31.358405889Z [2024-05-10 22:32:31,358: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:32:31.361765063Z [2024-05-10 22:32:31,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:31.387763025Z [2024-05-10 22:32:31,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:32:31.388879159Z [2024-05-10 22:32:31,388: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:31.388941546Z [2024-05-10 22:32:31,388: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:31.389111592Z [2024-05-10 22:32:31,388: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:31.389144238Z [2024-05-10 22:32:31,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:32:31.389372767Z [2024-05-10 22:32:31,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:32:31.389403752Z [2024-05-10 22:32:31,389: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:31.476337945Z [2024-05-10 22:32:31,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:31.957442703Z [2024-05-10 22:32:31,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1646b7ad-b579-4d97-a957-0679d8d9daee] received 2024-05-10T22:32:32.019019283Z [2024-05-10 22:32:32,018: INFO/ForkPoolWorker-16] [1646b7ad-b579-4d97-a957-0679d8d9daee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:32:32.346912706Z [2024-05-10 22:32:32,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:32:33.332283343Z [2024-05-10 22:32:33,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c462bbf3-42c8-48aa-bd6a-6ee1121f610a] succeeded in 3.751292508000006s: None 2024-05-10T22:32:33.520121814Z [2024-05-10 22:32:33,519: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:32:33.523206727Z [2024-05-10 22:32:33,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:33.542943305Z [2024-05-10 22:32:33,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:32:33.544083969Z [2024-05-10 22:32:33,543: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:33.544237964Z [2024-05-10 22:32:33,544: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:33.544448067Z [2024-05-10 22:32:33,544: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:33.544593420Z [2024-05-10 22:32:33,544: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:32:33.544897827Z [2024-05-10 22:32:33,544: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:32:33.544911347Z [2024-05-10 22:32:33,544: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:33.629144368Z [2024-05-10 22:32:33,628: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:35.127960700Z [2024-05-10 22:32:35,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1646b7ad-b579-4d97-a957-0679d8d9daee] succeeded in 3.1652847029999975s: None 2024-05-10T22:32:37.562601943Z [2024-05-10 22:32:37,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34d3dc81-4c4a-4585-a9f2-7fe6b573ca7b] received 2024-05-10T22:32:37.574187159Z [2024-05-10 22:32:37,573: INFO/ForkPoolWorker-15] [34d3dc81-4c4a-4585-a9f2-7fe6b573ca7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:37.830893728Z [2024-05-10 22:32:37,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:32:38.873193053Z [2024-05-10 22:32:38,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:32:38.876912061Z [2024-05-10 22:32:38,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:38.908742482Z [2024-05-10 22:32:38,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:32:38.910078386Z [2024-05-10 22:32:38,909: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:38.910205837Z [2024-05-10 22:32:38,910: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:38.910500735Z [2024-05-10 22:32:38,910: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:38.910630907Z [2024-05-10 22:32:38,910: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:32:38.910944701Z [2024-05-10 22:32:38,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:32:38.911067665Z [2024-05-10 22:32:38,910: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:38.991566339Z [2024-05-10 22:32:38,991: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:39.541175444Z [2024-05-10 22:32:39,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34d3dc81-4c4a-4585-a9f2-7fe6b573ca7b] succeeded in 1.9756473539998751s: None 2024-05-10T22:32:39.844674176Z [2024-05-10 22:32:39,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83521526-6a60-49e7-88a1-6bd9a5a7edbd] received 2024-05-10T22:32:39.856301308Z [2024-05-10 22:32:39,856: INFO/ForkPoolWorker-15] [83521526-6a60-49e7-88a1-6bd9a5a7edbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:40.235145955Z [2024-05-10 22:32:40,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:32:41.523521051Z [2024-05-10 22:32:41,523: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:32:41.527301758Z [2024-05-10 22:32:41,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:41.553829548Z [2024-05-10 22:32:41,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:32:41.555584080Z [2024-05-10 22:32:41,555: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:41.556562582Z [2024-05-10 22:32:41,556: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:41.557195096Z [2024-05-10 22:32:41,556: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:41.557665634Z [2024-05-10 22:32:41,557: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:32:41.559261950Z [2024-05-10 22:32:41,558: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:32:41.559966772Z [2024-05-10 22:32:41,559: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:41.643379693Z [2024-05-10 22:32:41,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:42.259797894Z [2024-05-10 22:32:42,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[523458ec-3795-46d8-aa11-c3cef5f775d3] received 2024-05-10T22:32:42.270836122Z [2024-05-10 22:32:42,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83521526-6a60-49e7-88a1-6bd9a5a7edbd] succeeded in 2.4217618719999336s: None 2024-05-10T22:32:42.279691625Z [2024-05-10 22:32:42,279: INFO/ForkPoolWorker-16] [523458ec-3795-46d8-aa11-c3cef5f775d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:32:42.572732969Z [2024-05-10 22:32:42,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:32:43.760259247Z [2024-05-10 22:32:43,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:32:43.764049201Z [2024-05-10 22:32:43,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:43.787102769Z [2024-05-10 22:32:43,786: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:32:43.789393468Z [2024-05-10 22:32:43,789: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:43.789779161Z [2024-05-10 22:32:43,789: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:43.790321503Z [2024-05-10 22:32:43,789: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:43.790629152Z [2024-05-10 22:32:43,790: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:32:43.791311656Z [2024-05-10 22:32:43,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:32:43.791572948Z [2024-05-10 22:32:43,791: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:43.911738026Z [2024-05-10 22:32:43,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:44.520961905Z [2024-05-10 22:32:44,520: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[523458ec-3795-46d8-aa11-c3cef5f775d3] succeeded in 2.259557804999986s: None 2024-05-10T22:32:44.540394545Z [2024-05-10 22:32:44,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba04ea3e-e2ca-4f88-9f43-1cb7e1d535ca] received 2024-05-10T22:32:44.548607790Z [2024-05-10 22:32:44,548: INFO/ForkPoolWorker-15] [ba04ea3e-e2ca-4f88-9f43-1cb7e1d535ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:32:44.842810948Z [2024-05-10 22:32:44,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:32:45.924102545Z [2024-05-10 22:32:45,923: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:32:45.927418444Z [2024-05-10 22:32:45,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:45.945372216Z [2024-05-10 22:32:45,945: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:32:45.946587166Z [2024-05-10 22:32:45,946: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:32:45.946753387Z [2024-05-10 22:32:45,946: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:32:45.946970655Z [2024-05-10 22:32:45,946: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:32:45.947090206Z [2024-05-10 22:32:45,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:32:45.947419757Z [2024-05-10 22:32:45,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:32:45.947553937Z [2024-05-10 22:32:45,947: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:32:46.037153428Z [2024-05-10 22:32:46,036: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:46.580928162Z [2024-05-10 22:32:46,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba04ea3e-e2ca-4f88-9f43-1cb7e1d535ca] succeeded in 2.038398679000011s: None 2024-05-10T22:32:52.383723788Z [2024-05-10 22:32:52,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eeb1653-d1b1-4f71-989c-efcdb8599fe5] received 2024-05-10T22:32:52.407485806Z [2024-05-10 22:32:52,406: INFO/ForkPoolWorker-15] [0eeb1653-d1b1-4f71-989c-efcdb8599fe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:32:52.760798479Z [2024-05-10 22:32:52,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:32:52.918554504Z [2024-05-10 22:32:52,918: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T22:32:52.923268689Z [2024-05-10 22:32:52,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:32:52.957790210Z [2024-05-10 22:32:52,957: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:32:52.958712281Z [2024-05-10 22:32:52,958: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:32:52.959533996Z [2024-05-10 22:32:52,958: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:32:52.959599115Z [2024-05-10 22:32:52,959: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T22:32:52.959766740Z [2024-05-10 22:32:52,959: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:32:53.069339116Z [2024-05-10 22:32:53,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:32:53.609372785Z [2024-05-10 22:32:53,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0eeb1653-d1b1-4f71-989c-efcdb8599fe5] succeeded in 1.2226472760000888s: None 2024-05-10T22:33:00.546224421Z [2024-05-10 22:33:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7294b624-ec61-4cca-a9ca-92d241787e50] received 2024-05-10T22:33:00.554787992Z [2024-05-10 22:33:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec8c7fd8-ac94-4f43-915b-ddaf9d848263] received 2024-05-10T22:33:00.564566504Z [2024-05-10 22:33:00,564: INFO/ForkPoolWorker-15] [7294b624-ec61-4cca-a9ca-92d241787e50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:00.565107416Z [2024-05-10 22:33:00,564: INFO/ForkPoolWorker-16] [ec8c7fd8-ac94-4f43-915b-ddaf9d848263] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:00.719087382Z [2024-05-10 22:33:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17ed4b91-3ae2-4294-93ca-2579925ac813] received 2024-05-10T22:33:00.827068512Z [2024-05-10 22:33:00,826: INFO/ForkPoolWorker-1] [17ed4b91-3ae2-4294-93ca-2579925ac813] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:33:00.940805219Z [2024-05-10 22:33:00,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:33:01.179005678Z [2024-05-10 22:33:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:33:01.616816130Z [2024-05-10 22:33:01,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:33:01.831100648Z [2024-05-10 22:33:01,830: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:33:01.835297976Z [2024-05-10 22:33:01,834: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:01.891544016Z [2024-05-10 22:33:01,891: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:33:01.892976554Z [2024-05-10 22:33:01,892: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:33:01.893233382Z [2024-05-10 22:33:01,893: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:33:01.893402093Z [2024-05-10 22:33:01,893: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:33:01.893706863Z [2024-05-10 22:33:01,893: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:33:02.046383717Z [2024-05-10 22:33:02,046: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:02.847548528Z [2024-05-10 22:33:02,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17ed4b91-3ae2-4294-93ca-2579925ac813] succeeded in 2.1257941110000047s: None 2024-05-10T22:33:03.029263206Z [2024-05-10 22:33:03,028: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:33:03.033943706Z [2024-05-10 22:33:03,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:03.070831651Z [2024-05-10 22:33:03,070: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:03.071226833Z [2024-05-10 22:33:03,071: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:33:03.072917116Z [2024-05-10 22:33:03,072: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:03.072928987Z [2024-05-10 22:33:03,072: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:03.073135875Z [2024-05-10 22:33:03,072: INFO/ForkPoolWorker-16] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:03.073357333Z [2024-05-10 22:33:03,073: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:03.073469617Z [2024-05-10 22:33:03,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:33:03.073797082Z [2024-05-10 22:33:03,073: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:33:03.073957455Z [2024-05-10 22:33:03,073: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:03.076263949Z [2024-05-10 22:33:03,075: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:03.080858218Z [2024-05-10 22:33:03,080: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:03.112539385Z [2024-05-10 22:33:03,112: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:03.114110082Z [2024-05-10 22:33:03,113: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:03.114145701Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:03.114334769Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:03.114504395Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:03.114679129Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:03.115085781Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:33:03.115130808Z [2024-05-10 22:33:03,114: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:03.121076708Z [2024-05-10 22:33:03,120: INFO/ForkPoolWorker-15] Creating DAG vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:03.175726450Z [2024-05-10 22:33:03,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:03.218758803Z [2024-05-10 22:33:03,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:03.601671197Z [2024-05-10 22:33:03,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b52ed2-9864-42c9-a026-1a8b931c8e54] received 2024-05-10T22:33:03.615337767Z [2024-05-10 22:33:03,615: INFO/ForkPoolWorker-1] [c7b52ed2-9864-42c9-a026-1a8b931c8e54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:03.934219842Z [2024-05-10 22:33:03,930: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:33:04.709524408Z [2024-05-10 22:33:04,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb569ef7-1ecf-40aa-b8d1-a809b948fbb3] received 2024-05-10T22:33:04.761084741Z [2024-05-10 22:33:04,760: INFO/ForkPoolWorker-2] [eb569ef7-1ecf-40aa-b8d1-a809b948fbb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:05.021825456Z [2024-05-10 22:33:05,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7294b624-ec61-4cca-a9ca-92d241787e50] succeeded in 4.469996207999884s: None 2024-05-10T22:33:05.124123460Z [2024-05-10 22:33:05,120: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:33:05.220301972Z [2024-05-10 22:33:05,211: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:33:05.220344011Z [2024-05-10 22:33:05,214: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:05.272007848Z [2024-05-10 22:33:05,271: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:33:05.274465351Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:05.274483871Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:05.274522009Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:05.274745650Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:05.274758933Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:33:05.275028520Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:33:05.275535339Z [2024-05-10 22:33:05,274: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:05.282027838Z [2024-05-10 22:33:05,281: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:05.375147189Z [2024-05-10 22:33:05,374: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:05.652816676Z [2024-05-10 22:33:05,652: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec8c7fd8-ac94-4f43-915b-ddaf9d848263] succeeded in 5.093035069000052s: None 2024-05-10T22:33:06.467414497Z [2024-05-10 22:33:06,467: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:33:06.470487124Z [2024-05-10 22:33:06,470: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:06.490662949Z [2024-05-10 22:33:06,490: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:33:06.494476198Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:06.494506826Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:06.494598544Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:06.494811147Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:06.494855292Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:33:06.495100686Z [2024-05-10 22:33:06,494: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:33:06.495136954Z [2024-05-10 22:33:06,495: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:06.499976105Z [2024-05-10 22:33:06,499: INFO/ForkPoolWorker-2] Creating DAG vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:06.593929094Z [2024-05-10 22:33:06,593: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:07.380294161Z [2024-05-10 22:33:07,379: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7b52ed2-9864-42c9-a026-1a8b931c8e54] succeeded in 3.7771518819999983s: None 2024-05-10T22:33:08.179205717Z [2024-05-10 22:33:08,178: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb569ef7-1ecf-40aa-b8d1-a809b948fbb3] succeeded in 3.4671739440000238s: None 2024-05-10T22:33:08.955202540Z [2024-05-10 22:33:08,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0809d4aa-d28f-4fbf-af32-2a031f90c186] received 2024-05-10T22:33:08.962439091Z [2024-05-10 22:33:08,962: INFO/ForkPoolWorker-15] [0809d4aa-d28f-4fbf-af32-2a031f90c186] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:09.271510066Z [2024-05-10 22:33:09,268: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:10.479236357Z [2024-05-10 22:33:10,478: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:10.483089176Z [2024-05-10 22:33:10,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:10.506250128Z [2024-05-10 22:33:10,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:10.507511184Z [2024-05-10 22:33:10,507: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:10.507546870Z [2024-05-10 22:33:10,507: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:10.507649741Z [2024-05-10 22:33:10,507: INFO/ForkPoolWorker-15] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:10.507800020Z [2024-05-10 22:33:10,507: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:10.507920270Z [2024-05-10 22:33:10,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:10.508198145Z [2024-05-10 22:33:10,508: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:10.508286710Z [2024-05-10 22:33:10,508: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:10.515224634Z [2024-05-10 22:33:10,514: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:10.596098745Z [2024-05-10 22:33:10,595: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:11.176804847Z [2024-05-10 22:33:11,176: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0809d4aa-d28f-4fbf-af32-2a031f90c186] succeeded in 2.2203294729999925s: None 2024-05-10T22:33:11.240461190Z [2024-05-10 22:33:11,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c0e1bd4-3747-4e71-a80e-cc4a509d6eb2] received 2024-05-10T22:33:11.247548208Z [2024-05-10 22:33:11,247: INFO/ForkPoolWorker-15] [9c0e1bd4-3747-4e71-a80e-cc4a509d6eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:11.549302232Z [2024-05-10 22:33:11,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:12.744806605Z [2024-05-10 22:33:12,744: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:12.759779053Z [2024-05-10 22:33:12,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:12.779136438Z [2024-05-10 22:33:12,778: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:12.780338681Z [2024-05-10 22:33:12,780: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:12.780454968Z [2024-05-10 22:33:12,780: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:12.780616861Z [2024-05-10 22:33:12,780: INFO/ForkPoolWorker-15] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:12.780826956Z [2024-05-10 22:33:12,780: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:12.780933017Z [2024-05-10 22:33:12,780: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:12.781251920Z [2024-05-10 22:33:12,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:12.781448962Z [2024-05-10 22:33:12,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:12.787096031Z [2024-05-10 22:33:12,786: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:12.869833627Z [2024-05-10 22:33:12,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:13.470818715Z [2024-05-10 22:33:13,470: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c0e1bd4-3747-4e71-a80e-cc4a509d6eb2] succeeded in 2.2279697930000566s: None 2024-05-10T22:33:13.508399521Z [2024-05-10 22:33:13,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f327409-b592-4532-a55d-8d67760abfec] received 2024-05-10T22:33:13.530819392Z [2024-05-10 22:33:13,530: INFO/ForkPoolWorker-15] [6f327409-b592-4532-a55d-8d67760abfec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:33:13.803477687Z [2024-05-10 22:33:13,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:14.940814108Z [2024-05-10 22:33:14,940: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:14.944923967Z [2024-05-10 22:33:14,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:14.964459812Z [2024-05-10 22:33:14,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:14.965814647Z [2024-05-10 22:33:14,965: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:14.965962220Z [2024-05-10 22:33:14,965: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:14.966038145Z [2024-05-10 22:33:14,965: INFO/ForkPoolWorker-15] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:14.966307364Z [2024-05-10 22:33:14,966: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:14.966369467Z [2024-05-10 22:33:14,966: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:14.966616432Z [2024-05-10 22:33:14,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:14.966756680Z [2024-05-10 22:33:14,966: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:14.973145856Z [2024-05-10 22:33:14,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:15.050223989Z [2024-05-10 22:33:15,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:15.583653684Z [2024-05-10 22:33:15,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f327409-b592-4532-a55d-8d67760abfec] succeeded in 2.072613606999994s: None 2024-05-10T22:33:15.827578034Z [2024-05-10 22:33:15,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9c34d85-be56-4f74-ac70-a9e627bfddd9] received 2024-05-10T22:33:15.836252623Z [2024-05-10 22:33:15,836: INFO/ForkPoolWorker-15] [b9c34d85-be56-4f74-ac70-a9e627bfddd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:16.105474208Z [2024-05-10 22:33:16,102: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:17.359173461Z [2024-05-10 22:33:17,358: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:17.362681988Z [2024-05-10 22:33:17,362: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:17.390332814Z [2024-05-10 22:33:17,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:17.394616462Z [2024-05-10 22:33:17,394: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:17.395312098Z [2024-05-10 22:33:17,395: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:17.395506831Z [2024-05-10 22:33:17,395: INFO/ForkPoolWorker-15] Read VIM 6184fb0f-d433-42cd-a55c-05492cdcef27 (basic01_982750) 2024-05-10T22:33:17.395743205Z [2024-05-10 22:33:17,395: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '6184fb0f-d433-42cd-a55c-05492cdcef27', 'name': 'basic01_982750', 'vim_type': 'openstack'}] 2024-05-10T22:33:17.395888083Z [2024-05-10 22:33:17,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:17.396395059Z [2024-05-10 22:33:17,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:17.396540094Z [2024-05-10 22:33:17,396: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:17.404528754Z [2024-05-10 22:33:17,404: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_6184fb0f-d433-42cd-a55c-05492cdcef27 2024-05-10T22:33:17.494215268Z [2024-05-10 22:33:17,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:18.080866278Z [2024-05-10 22:33:18,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9c34d85-be56-4f74-ac70-a9e627bfddd9] succeeded in 2.2501437419998638s: None 2024-05-10T22:33:34.938547488Z [2024-05-10 22:33:34,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e9e45ac-733f-4c17-966b-367c9015e899] received 2024-05-10T22:33:34.946836516Z [2024-05-10 22:33:34,946: INFO/ForkPoolWorker-15] [8e9e45ac-733f-4c17-966b-367c9015e899] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:33:35.302901469Z [2024-05-10 22:33:35,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:33:36.165702753Z [2024-05-10 22:33:36,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ca738b1-7f63-4ed7-9d3e-8fe834ad6b31] received 2024-05-10T22:33:36.174949476Z [2024-05-10 22:33:36,174: INFO/ForkPoolWorker-16] [3ca738b1-7f63-4ed7-9d3e-8fe834ad6b31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:33:36.355131344Z [2024-05-10 22:33:36,354: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:36.358478418Z [2024-05-10 22:33:36,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:36.377738532Z [2024-05-10 22:33:36,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:36.379479717Z [2024-05-10 22:33:36,379: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:36.379682137Z [2024-05-10 22:33:36,379: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:36.379973589Z [2024-05-10 22:33:36,379: INFO/ForkPoolWorker-15] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:36.380164216Z [2024-05-10 22:33:36,379: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:36.380266101Z [2024-05-10 22:33:36,380: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:36.380529304Z [2024-05-10 22:33:36,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:33:36.380659834Z [2024-05-10 22:33:36,380: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:36.384698074Z [2024-05-10 22:33:36,384: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:36.450747625Z [2024-05-10 22:33:36,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:33:36.472954228Z [2024-05-10 22:33:36,472: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:37.596311965Z [2024-05-10 22:33:37,595: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:33:37.600261282Z [2024-05-10 22:33:37,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:37.624172225Z [2024-05-10 22:33:37,623: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:33:37.625675149Z [2024-05-10 22:33:37,625: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:37.625840156Z [2024-05-10 22:33:37,625: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:37.625851572Z [2024-05-10 22:33:37,625: INFO/ForkPoolWorker-16] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:37.626168502Z [2024-05-10 22:33:37,625: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:37.626179479Z [2024-05-10 22:33:37,626: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:33:37.626745008Z [2024-05-10 22:33:37,626: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:33:37.626876223Z [2024-05-10 22:33:37,626: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:37.634814664Z [2024-05-10 22:33:37,634: INFO/ForkPoolWorker-16] Creating DAG vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:37.726612235Z [2024-05-10 22:33:37,726: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:39.141172942Z [2024-05-10 22:33:39,140: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ca738b1-7f63-4ed7-9d3e-8fe834ad6b31] succeeded in 2.973885709999877s: None 2024-05-10T22:33:39.337659594Z [2024-05-10 22:33:39,337: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e9e45ac-733f-4c17-966b-367c9015e899] succeeded in 4.397146113999952s: None 2024-05-10T22:33:40.361567776Z [2024-05-10 22:33:40,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcfb5e46-3019-42d6-9b60-898f1b0b725c] received 2024-05-10T22:33:40.377347165Z [2024-05-10 22:33:40,377: INFO/ForkPoolWorker-15] [fcfb5e46-3019-42d6-9b60-898f1b0b725c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:40.656251943Z [2024-05-10 22:33:40,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:41.747326602Z [2024-05-10 22:33:41,746: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:41.751393665Z [2024-05-10 22:33:41,750: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:41.772894276Z [2024-05-10 22:33:41,772: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:41.774724435Z [2024-05-10 22:33:41,774: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:41.774852252Z [2024-05-10 22:33:41,774: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:41.774993369Z [2024-05-10 22:33:41,774: INFO/ForkPoolWorker-15] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:41.775194355Z [2024-05-10 22:33:41,774: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:41.775317254Z [2024-05-10 22:33:41,775: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:41.775707006Z [2024-05-10 22:33:41,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:41.775810521Z [2024-05-10 22:33:41,775: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:41.781825745Z [2024-05-10 22:33:41,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:41.857664125Z [2024-05-10 22:33:41,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:42.387918765Z [2024-05-10 22:33:42,387: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcfb5e46-3019-42d6-9b60-898f1b0b725c] succeeded in 2.0268180820000907s: None 2024-05-10T22:33:42.869960241Z [2024-05-10 22:33:42,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8165dd25-0659-450f-8b78-2a79eeb26da4] received 2024-05-10T22:33:42.883625484Z [2024-05-10 22:33:42,883: INFO/ForkPoolWorker-15] [8165dd25-0659-450f-8b78-2a79eeb26da4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'split_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:43.187388667Z [2024-05-10 22:33:43,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:44.291242251Z [2024-05-10 22:33:44,290: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:44.294734247Z [2024-05-10 22:33:44,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:44.320038209Z [2024-05-10 22:33:44,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:44.321624977Z [2024-05-10 22:33:44,321: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:44.321835157Z [2024-05-10 22:33:44,321: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:44.322068090Z [2024-05-10 22:33:44,321: INFO/ForkPoolWorker-15] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:44.322351789Z [2024-05-10 22:33:44,322: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:44.322549773Z [2024-05-10 22:33:44,322: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:44.322889993Z [2024-05-10 22:33:44,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:44.323494728Z [2024-05-10 22:33:44,323: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:44.331558767Z [2024-05-10 22:33:44,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:44.398131926Z [2024-05-10 22:33:44,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:45.064786558Z [2024-05-10 22:33:45,064: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8165dd25-0659-450f-8b78-2a79eeb26da4] succeeded in 2.1919382649998624s: None 2024-05-10T22:33:45.171297276Z [2024-05-10 22:33:45,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b8f5a1b-465d-4dd1-bdff-208c5018f0b0] received 2024-05-10T22:33:45.184248633Z [2024-05-10 22:33:45,183: INFO/ForkPoolWorker-15] [3b8f5a1b-465d-4dd1-bdff-208c5018f0b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'collect_metrics', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:33:45.452898155Z [2024-05-10 22:33:45,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:46.513709598Z [2024-05-10 22:33:46,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:33:46.516938346Z [2024-05-10 22:33:46,516: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:46.534670655Z [2024-05-10 22:33:46,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:33:46.535954962Z [2024-05-10 22:33:46,535: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:46.536092009Z [2024-05-10 22:33:46,535: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:46.536203780Z [2024-05-10 22:33:46,536: INFO/ForkPoolWorker-15] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:46.536405313Z [2024-05-10 22:33:46,536: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:46.536491746Z [2024-05-10 22:33:46,536: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:33:46.536892308Z [2024-05-10 22:33:46,536: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:46.537004342Z [2024-05-10 22:33:46,536: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:46.543711428Z [2024-05-10 22:33:46,543: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:46.622717124Z [2024-05-10 22:33:46,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:47.091820700Z [2024-05-10 22:33:47,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7085980f-23c3-4f31-abaf-c73eb52d9867] received 2024-05-10T22:33:47.101564638Z [2024-05-10 22:33:47,101: INFO/ForkPoolWorker-16] [7085980f-23c3-4f31-abaf-c73eb52d9867] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'send_prometheus', 'scheduled__2024-05-10T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:33:47.159740151Z [2024-05-10 22:33:47,159: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b8f5a1b-465d-4dd1-bdff-208c5018f0b0] succeeded in 1.9840906189999714s: None 2024-05-10T22:33:47.387104399Z [2024-05-10 22:33:47,383: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:33:48.402197493Z [2024-05-10 22:33:48,401: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:33:48.405227695Z [2024-05-10 22:33:48,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:33:48.428654845Z [2024-05-10 22:33:48,428: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:33:48.429849272Z [2024-05-10 22:33:48,429: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:33:48.429956885Z [2024-05-10 22:33:48,429: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:33:48.430008857Z [2024-05-10 22:33:48,429: INFO/ForkPoolWorker-16] Read VIM e3efeb20-6d04-4087-95d3-ef01f8dc9f09 (basic01_225791) 2024-05-10T22:33:48.430092336Z [2024-05-10 22:33:48,429: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'name': 'basic01_225791', 'vim_type': 'openstack'}] 2024-05-10T22:33:48.430172191Z [2024-05-10 22:33:48,430: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:33:48.430581278Z [2024-05-10 22:33:48,430: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:33:48.430598011Z [2024-05-10 22:33:48,430: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:33:48.436052304Z [2024-05-10 22:33:48,435: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09 2024-05-10T22:33:48.510743081Z [2024-05-10 22:33:48,510: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:33:49.045325563Z [2024-05-10 22:33:49,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7085980f-23c3-4f31-abaf-c73eb52d9867] succeeded in 1.947949159000018s: None 2024-05-10T22:34:00.620764165Z [2024-05-10 22:34:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abafafb4-d869-4a65-bfcc-0273ff4f3387] received 2024-05-10T22:34:00.626933421Z [2024-05-10 22:34:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1d07de4-3b05-49b9-9038-af552b9967de] received 2024-05-10T22:34:00.627705026Z [2024-05-10 22:34:00,627: INFO/ForkPoolWorker-15] [abafafb4-d869-4a65-bfcc-0273ff4f3387] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:34:00.633803517Z [2024-05-10 22:34:00,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d97ec12-da25-4e8c-a75a-2194df8fb27b] received 2024-05-10T22:34:00.635416965Z [2024-05-10 22:34:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5f12e53-5576-413c-9c36-cd1fac8d9863] received 2024-05-10T22:34:00.637126760Z [2024-05-10 22:34:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b577dfb-28d2-457b-8b56-634d7d9dae98] received 2024-05-10T22:34:00.649668012Z [2024-05-10 22:34:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67a4dcea-b54e-4091-a228-f849b7dc098e] received 2024-05-10T22:34:00.652928978Z [2024-05-10 22:34:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1103136d-dedf-4ca3-bf0a-341b7ebc7e15] received 2024-05-10T22:34:00.654535157Z [2024-05-10 22:34:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e32d4655-3880-4d09-be17-245081281586] received 2024-05-10T22:34:00.656544609Z [2024-05-10 22:34:00,656: INFO/ForkPoolWorker-16] [f1d07de4-3b05-49b9-9038-af552b9967de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:00.681874775Z [2024-05-10 22:34:00,681: INFO/ForkPoolWorker-2] [f5f12e53-5576-413c-9c36-cd1fac8d9863] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:00.682864972Z [2024-05-10 22:34:00,682: INFO/ForkPoolWorker-1] [0d97ec12-da25-4e8c-a75a-2194df8fb27b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:00.692704676Z [2024-05-10 22:34:00,692: INFO/ForkPoolWorker-3] [3b577dfb-28d2-457b-8b56-634d7d9dae98] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:34:00.774763329Z [2024-05-10 22:34:00,774: INFO/ForkPoolWorker-6] [e32d4655-3880-4d09-be17-245081281586] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:00.788040546Z [2024-05-10 22:34:00,787: INFO/ForkPoolWorker-5] [1103136d-dedf-4ca3-bf0a-341b7ebc7e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:00.790633892Z [2024-05-10 22:34:00,790: INFO/ForkPoolWorker-4] [67a4dcea-b54e-4091-a228-f849b7dc098e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:01.149391704Z [2024-05-10 22:34:01,143: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:01.155430526Z [2024-05-10 22:34:01,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:01.187636715Z [2024-05-10 22:34:01,181: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:01.580922556Z [2024-05-10 22:34:01,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:34:01.606080310Z [2024-05-10 22:34:01,602: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:01.908690171Z [2024-05-10 22:34:01,903: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:34:02.088303921Z [2024-05-10 22:34:02,087: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T22:34:02.092927071Z [2024-05-10 22:34:02,092: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:02.150963266Z [2024-05-10 22:34:02,150: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:34:02.155475917Z [2024-05-10 22:34:02,154: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:34:02.155620692Z [2024-05-10 22:34:02,155: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:34:02.155655180Z [2024-05-10 22:34:02,155: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T22:34:02.155913779Z [2024-05-10 22:34:02,155: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:34:02.260198117Z [2024-05-10 22:34:02,252: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:02.364444552Z [2024-05-10 22:34:02,339: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:02.492799013Z [2024-05-10 22:34:02,492: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:34:02.839003906Z [2024-05-10 22:34:02,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:34:03.181605123Z [2024-05-10 22:34:03,181: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:34:03.188508077Z [2024-05-10 22:34:03,185: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:03.237142523Z [2024-05-10 22:34:03,236: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:34:03.242213723Z [2024-05-10 22:34:03,241: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:03.242232015Z [2024-05-10 22:34:03,242: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:03.242326493Z [2024-05-10 22:34:03,242: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:03.242341569Z [2024-05-10 22:34:03,242: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:34:03.242578384Z [2024-05-10 22:34:03,242: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:03.242626903Z [2024-05-10 22:34:03,242: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:03.249808436Z [2024-05-10 22:34:03,249: WARNING/ForkPoolWorker-2] Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:03.251290675Z [2024-05-10 22:34:03,250: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:03.252085947Z [2024-05-10 22:34:03,251: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:34:03.265801881Z [2024-05-10 22:34:03,265: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:03.319727873Z [2024-05-10 22:34:03,319: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:34:03.324180486Z [2024-05-10 22:34:03,323: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:03.324196531Z [2024-05-10 22:34:03,324: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:03.324315660Z [2024-05-10 22:34:03,324: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:03.324415843Z [2024-05-10 22:34:03,324: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:34:03.324662825Z [2024-05-10 22:34:03,324: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:03.324689777Z [2024-05-10 22:34:03,324: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:03.328435753Z [2024-05-10 22:34:03,327: ERROR/ForkPoolWorker-2] [f5f12e53-5576-413c-9c36-cd1fac8d9863] Failed to execute task Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:03.328450029Z Traceback (most recent call last): 2024-05-10T22:34:03.328454039Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:03.328457568Z args.func(args) 2024-05-10T22:34:03.328461478Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:03.328468597Z return func(*args, **kwargs) 2024-05-10T22:34:03.328471765Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:03.328474729Z return f(*args, **kwargs) 2024-05-10T22:34:03.328477966Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:03.328480982Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:03.328497415Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:03.328500851Z raise AirflowException( 2024-05-10T22:34:03.328504808Z airflow.exceptions.AirflowException: Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:03.374958845Z [2024-05-10 22:34:03,374: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f5f12e53-5576-413c-9c36-cd1fac8d9863] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5f12e53-5576-413c-9c36-cd1fac8d9863') 2024-05-10T22:34:03.374980918Z Traceback (most recent call last): 2024-05-10T22:34:03.374984850Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:03.374988028Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:03.374991388Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:03.374994724Z return self.run(*args, **kwargs) 2024-05-10T22:34:03.374998211Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:03.375001666Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:03.375004653Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:03.375008183Z raise AirflowException(msg) 2024-05-10T22:34:03.375011724Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5f12e53-5576-413c-9c36-cd1fac8d9863 2024-05-10T22:34:03.775886911Z [2024-05-10 22:34:03,775: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3b577dfb-28d2-457b-8b56-634d7d9dae98] succeeded in 3.135876843999995s: None 2024-05-10T22:34:03.913690866Z [2024-05-10 22:34:03,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abafafb4-d869-4a65-bfcc-0273ff4f3387] succeeded in 3.2906296329999805s: None 2024-05-10T22:34:03.994543376Z [2024-05-10 22:34:03,994: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:34:03.997969945Z [2024-05-10 22:34:03,997: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.021499639Z [2024-05-10 22:34:04,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:34:04.024774256Z [2024-05-10 22:34:04,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.039195643Z [2024-05-10 22:34:04,038: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:34:04.045073269Z [2024-05-10 22:34:04,042: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.045093022Z [2024-05-10 22:34:04,042: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.045097459Z [2024-05-10 22:34:04,042: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.045116989Z [2024-05-10 22:34:04,042: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:34:04.045133475Z [2024-05-10 22:34:04,043: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:04.045139869Z [2024-05-10 22:34:04,043: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.058308749Z [2024-05-10 22:34:04,051: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-10T22:34:04.061656213Z [2024-05-10 22:34:04,060: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.112525500Z [2024-05-10 22:34:04,106: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:34:04.112533572Z [2024-05-10 22:34:04,110: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.112536715Z [2024-05-10 22:34:04,110: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.112540726Z [2024-05-10 22:34:04,110: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.112544393Z [2024-05-10 22:34:04,111: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:34:04.112547472Z [2024-05-10 22:34:04,111: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:04.112550519Z [2024-05-10 22:34:04,111: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.118187161Z [2024-05-10 22:34:04,117: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-10T22:34:04.119817178Z [2024-05-10 22:34:04,118: INFO/ForkPoolWorker-5] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.119984904Z [2024-05-10 22:34:04,119: INFO/ForkPoolWorker-5] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.121106535Z [2024-05-10 22:34:04,120: INFO/ForkPoolWorker-5] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.122035195Z [2024-05-10 22:34:04,120: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-10T22:34:04.122485993Z [2024-05-10 22:34:04,122: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:04.122498564Z [2024-05-10 22:34:04,122: INFO/ForkPoolWorker-5] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.122805432Z [2024-05-10 22:34:04,122: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:04.123976959Z [2024-05-10 22:34:04,123: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:04.124880949Z [2024-05-10 22:34:04,124: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:34:04.127464708Z [2024-05-10 22:34:04,127: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.139843799Z [2024-05-10 22:34:04,139: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:34:04.142061614Z [2024-05-10 22:34:04,141: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.142115074Z [2024-05-10 22:34:04,142: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.142275827Z [2024-05-10 22:34:04,142: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.142314412Z [2024-05-10 22:34:04,142: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:34:04.142577417Z [2024-05-10 22:34:04,142: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:04.142650246Z [2024-05-10 22:34:04,142: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.145803040Z [2024-05-10 22:34:04,145: ERROR/ForkPoolWorker-1] [0d97ec12-da25-4e8c-a75a-2194df8fb27b] Failed to execute task Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:04.145815257Z Traceback (most recent call last): 2024-05-10T22:34:04.145820088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:04.145824202Z args.func(args) 2024-05-10T22:34:04.145828508Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:04.145832563Z return func(*args, **kwargs) 2024-05-10T22:34:04.145836148Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:04.145839761Z return f(*args, **kwargs) 2024-05-10T22:34:04.145843329Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:04.145847142Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:04.145850764Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:04.145854463Z raise AirflowException( 2024-05-10T22:34:04.145917943Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:04.152661783Z [2024-05-10 22:34:04,152: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:34:04.190052420Z [2024-05-10 22:34:04,189: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d97ec12-da25-4e8c-a75a-2194df8fb27b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0d97ec12-da25-4e8c-a75a-2194df8fb27b') 2024-05-10T22:34:04.190074873Z Traceback (most recent call last): 2024-05-10T22:34:04.190078927Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:04.190082540Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:04.190085534Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:04.190088409Z return self.run(*args, **kwargs) 2024-05-10T22:34:04.190092096Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:04.190114092Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:04.190118846Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:04.190124023Z raise AirflowException(msg) 2024-05-10T22:34:04.190129610Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0d97ec12-da25-4e8c-a75a-2194df8fb27b 2024-05-10T22:34:04.229921293Z [2024-05-10 22:34:04,229: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:34:04.268270540Z [2024-05-10 22:34:04,267: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-10T22:34:04.274566169Z [2024-05-10 22:34:04,274: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.322350920Z [2024-05-10 22:34:04,322: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-10T22:34:04.330933518Z [2024-05-10 22:34:04,330: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.330957818Z [2024-05-10 22:34:04,330: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.331111053Z [2024-05-10 22:34:04,330: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.331178061Z [2024-05-10 22:34:04,331: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-10T22:34:04.331939430Z [2024-05-10 22:34:04,331: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:04.331946616Z [2024-05-10 22:34:04,331: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.339906646Z [2024-05-10 22:34:04,339: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:04.341848880Z [2024-05-10 22:34:04,340: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:04.347712016Z [2024-05-10 22:34:04,346: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-10T22:34:04.354540832Z [2024-05-10 22:34:04,353: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.365153073Z [2024-05-10 22:34:04,364: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-10T22:34:04.366767129Z [2024-05-10 22:34:04,366: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.367173737Z [2024-05-10 22:34:04,366: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.367338050Z [2024-05-10 22:34:04,367: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.367423940Z [2024-05-10 22:34:04,367: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-10T22:34:04.367733078Z [2024-05-10 22:34:04,367: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:04.367738707Z [2024-05-10 22:34:04,367: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.371487942Z [2024-05-10 22:34:04,370: ERROR/ForkPoolWorker-4] [67a4dcea-b54e-4091-a228-f849b7dc098e] Failed to execute task Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:04.371500985Z Traceback (most recent call last): 2024-05-10T22:34:04.371504850Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:04.371508597Z args.func(args) 2024-05-10T22:34:04.371512433Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:04.371515790Z return func(*args, **kwargs) 2024-05-10T22:34:04.371519520Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:04.371522623Z return f(*args, **kwargs) 2024-05-10T22:34:04.371525784Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:04.371528795Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:04.371532124Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:04.371535679Z raise AirflowException( 2024-05-10T22:34:04.371539427Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:04.413423901Z [2024-05-10 22:34:04,413: INFO/ForkPoolWorker-6] Getting VIM list 2024-05-10T22:34:04.417270686Z [2024-05-10 22:34:04,416: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.437641688Z [2024-05-10 22:34:04,437: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[67a4dcea-b54e-4091-a228-f849b7dc098e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 67a4dcea-b54e-4091-a228-f849b7dc098e') 2024-05-10T22:34:04.437657114Z Traceback (most recent call last): 2024-05-10T22:34:04.437660865Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:04.437663810Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:04.437667013Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:04.437670079Z return self.run(*args, **kwargs) 2024-05-10T22:34:04.437673776Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:04.437677149Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:04.437680401Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:04.437684726Z raise AirflowException(msg) 2024-05-10T22:34:04.437689822Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 67a4dcea-b54e-4091-a228-f849b7dc098e 2024-05-10T22:34:04.447029813Z [2024-05-10 22:34:04,446: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-10T22:34:04.449290842Z [2024-05-10 22:34:04,449: INFO/ForkPoolWorker-6] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.449400461Z [2024-05-10 22:34:04,449: INFO/ForkPoolWorker-6] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.449545176Z [2024-05-10 22:34:04,449: INFO/ForkPoolWorker-6] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.449750327Z [2024-05-10 22:34:04,449: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-05-10T22:34:04.450021769Z [2024-05-10 22:34:04,449: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:04.450102315Z [2024-05-10 22:34:04,450: INFO/ForkPoolWorker-6] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.456295519Z [2024-05-10 22:34:04,456: WARNING/ForkPoolWorker-6] Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:04.457095891Z [2024-05-10 22:34:04,456: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:04.458267772Z [2024-05-10 22:34:04,458: INFO/ForkPoolWorker-6] Getting VIM list 2024-05-10T22:34:04.460775265Z [2024-05-10 22:34:04,460: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:04.477179308Z [2024-05-10 22:34:04,476: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-10T22:34:04.481536548Z [2024-05-10 22:34:04,479: INFO/ForkPoolWorker-6] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:04.481614984Z [2024-05-10 22:34:04,481: INFO/ForkPoolWorker-6] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:04.481809486Z [2024-05-10 22:34:04,481: INFO/ForkPoolWorker-6] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:04.481920760Z [2024-05-10 22:34:04,481: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-05-10T22:34:04.482309018Z [2024-05-10 22:34:04,482: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:04.482357354Z [2024-05-10 22:34:04,482: INFO/ForkPoolWorker-6] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:04.486295784Z [2024-05-10 22:34:04,485: ERROR/ForkPoolWorker-6] [e32d4655-3880-4d09-be17-245081281586] Failed to execute task Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:04.486307758Z Traceback (most recent call last): 2024-05-10T22:34:04.486311572Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:04.486314945Z args.func(args) 2024-05-10T22:34:04.486318214Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:04.486321785Z return func(*args, **kwargs) 2024-05-10T22:34:04.486337488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:04.486340508Z return f(*args, **kwargs) 2024-05-10T22:34:04.486343640Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:04.486346545Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:04.486349450Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:04.486352339Z raise AirflowException( 2024-05-10T22:34:04.486355785Z airflow.exceptions.AirflowException: Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:04.526728938Z [2024-05-10 22:34:04,526: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[e32d4655-3880-4d09-be17-245081281586] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e32d4655-3880-4d09-be17-245081281586') 2024-05-10T22:34:04.526743756Z Traceback (most recent call last): 2024-05-10T22:34:04.526747978Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:04.526751002Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:04.526753965Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:04.526757013Z return self.run(*args, **kwargs) 2024-05-10T22:34:04.526760557Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:04.526764841Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:04.526767979Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:04.526771513Z raise AirflowException(msg) 2024-05-10T22:34:04.526775288Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e32d4655-3880-4d09-be17-245081281586 2024-05-10T22:34:05.686876749Z [2024-05-10 22:34:05,686: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[1103136d-dedf-4ca3-bf0a-341b7ebc7e15] succeeded in 5.024085087000003s: None 2024-05-10T22:34:07.063605105Z [2024-05-10 22:34:07,063: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1d07de4-3b05-49b9-9038-af552b9967de] succeeded in 6.430396229000053s: None 2024-05-10T22:34:13.616125634Z [2024-05-10 22:34:13,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3cc9500-5cce-4ec0-9660-a608720fe451] received 2024-05-10T22:34:13.621499786Z [2024-05-10 22:34:13,621: INFO/ForkPoolWorker-15] [d3cc9500-5cce-4ec0-9660-a608720fe451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:13.925493329Z [2024-05-10 22:34:13,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:14.964082116Z [2024-05-10 22:34:14,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fce308f5-f9de-4b76-ad09-ca9f917df794] received 2024-05-10T22:34:14.965844055Z [2024-05-10 22:34:14,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[396da22f-0e2a-4beb-bfdd-588cc2f0dd1b] received 2024-05-10T22:34:14.967063212Z [2024-05-10 22:34:14,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bf8bab4-fa9f-499f-9234-d225a5335ddd] received 2024-05-10T22:34:14.973525329Z [2024-05-10 22:34:14,973: INFO/ForkPoolWorker-16] [fce308f5-f9de-4b76-ad09-ca9f917df794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:14.974016119Z [2024-05-10 22:34:14,973: INFO/ForkPoolWorker-2] [8bf8bab4-fa9f-499f-9234-d225a5335ddd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:34:14.976853921Z [2024-05-10 22:34:14,976: INFO/ForkPoolWorker-1] [396da22f-0e2a-4beb-bfdd-588cc2f0dd1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:34:14.992644865Z [2024-05-10 22:34:14,992: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:34:14.995923545Z [2024-05-10 22:34:14,995: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:15.035212097Z [2024-05-10 22:34:15,034: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:34:15.036659189Z [2024-05-10 22:34:15,036: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:15.036854623Z [2024-05-10 22:34:15,036: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:15.037155047Z [2024-05-10 22:34:15,036: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:15.037321830Z [2024-05-10 22:34:15,037: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:34:15.037654414Z [2024-05-10 22:34:15,037: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:15.038327891Z [2024-05-10 22:34:15,037: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:15.053775469Z [2024-05-10 22:34:15,053: WARNING/ForkPoolWorker-15] Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:15.059381198Z [2024-05-10 22:34:15,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:15.061698486Z [2024-05-10 22:34:15,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:34:15.069794639Z [2024-05-10 22:34:15,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:15.106440612Z [2024-05-10 22:34:15,106: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:34:15.114539845Z [2024-05-10 22:34:15,114: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:15.114723297Z [2024-05-10 22:34:15,114: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:15.114950118Z [2024-05-10 22:34:15,114: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:15.115056196Z [2024-05-10 22:34:15,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:34:15.117096406Z [2024-05-10 22:34:15,116: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:15.117127527Z [2024-05-10 22:34:15,117: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:15.120413227Z [2024-05-10 22:34:15,119: ERROR/ForkPoolWorker-15] [d3cc9500-5cce-4ec0-9660-a608720fe451] Failed to execute task Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:15.120426389Z Traceback (most recent call last): 2024-05-10T22:34:15.120430378Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:15.120433953Z args.func(args) 2024-05-10T22:34:15.120441142Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:15.120444901Z return func(*args, **kwargs) 2024-05-10T22:34:15.120448118Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:15.120451248Z return f(*args, **kwargs) 2024-05-10T22:34:15.120454266Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:15.120457267Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:15.120460255Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:15.120463295Z raise AirflowException( 2024-05-10T22:34:15.120466887Z airflow.exceptions.AirflowException: Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:15.154751168Z [2024-05-10 22:34:15,154: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3cc9500-5cce-4ec0-9660-a608720fe451] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d3cc9500-5cce-4ec0-9660-a608720fe451') 2024-05-10T22:34:15.154766495Z Traceback (most recent call last): 2024-05-10T22:34:15.154770181Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:15.154773559Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:15.154793794Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:15.154797445Z return self.run(*args, **kwargs) 2024-05-10T22:34:15.154800864Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:15.154804274Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:15.154807568Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:15.154811017Z raise AirflowException(msg) 2024-05-10T22:34:15.154814743Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d3cc9500-5cce-4ec0-9660-a608720fe451 2024-05-10T22:34:15.283820453Z [2024-05-10 22:34:15,280: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:15.318656331Z [2024-05-10 22:34:15,315: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:15.335487828Z [2024-05-10 22:34:15,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:16.388883002Z [2024-05-10 22:34:16,388: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:34:16.392141563Z [2024-05-10 22:34:16,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.438777523Z [2024-05-10 22:34:16,438: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:34:16.442911496Z [2024-05-10 22:34:16,442: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.443014718Z [2024-05-10 22:34:16,442: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.443035514Z [2024-05-10 22:34:16,442: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.443048741Z [2024-05-10 22:34:16,442: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:34:16.443274519Z [2024-05-10 22:34:16,443: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:16.443289644Z [2024-05-10 22:34:16,443: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.449612206Z [2024-05-10 22:34:16,449: WARNING/ForkPoolWorker-2] Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:16.450198801Z [2024-05-10 22:34:16,449: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:34:16.450896367Z [2024-05-10 22:34:16,450: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:34:16.453342500Z [2024-05-10 22:34:16,453: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.461716258Z [2024-05-10 22:34:16,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:34:16.464857479Z [2024-05-10 22:34:16,464: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.475274794Z [2024-05-10 22:34:16,474: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:34:16.477282798Z [2024-05-10 22:34:16,476: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.477397035Z [2024-05-10 22:34:16,477: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.477747531Z [2024-05-10 22:34:16,477: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.477814190Z [2024-05-10 22:34:16,477: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:34:16.478251512Z [2024-05-10 22:34:16,478: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:34:16.478314158Z [2024-05-10 22:34:16,478: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.479350363Z [2024-05-10 22:34:16,479: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:34:16.480528522Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.480585362Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.480704620Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.480721977Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:34:16.480904706Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:16.480944955Z [2024-05-10 22:34:16,480: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.481514680Z [2024-05-10 22:34:16,481: ERROR/ForkPoolWorker-2] [8bf8bab4-fa9f-499f-9234-d225a5335ddd] Failed to execute task Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:16.481529241Z Traceback (most recent call last): 2024-05-10T22:34:16.481534226Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:16.481538599Z args.func(args) 2024-05-10T22:34:16.481542970Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:16.481547339Z return func(*args, **kwargs) 2024-05-10T22:34:16.481551491Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:16.481573492Z return f(*args, **kwargs) 2024-05-10T22:34:16.481578408Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:16.481582305Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:16.481586192Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:16.481590086Z raise AirflowException( 2024-05-10T22:34:16.481594421Z airflow.exceptions.AirflowException: Dag 'vim_status_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:16.486898423Z [2024-05-10 22:34:16,486: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:16.487493349Z [2024-05-10 22:34:16,486: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:16.488262111Z [2024-05-10 22:34:16,488: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:34:16.490738817Z [2024-05-10 22:34:16,490: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.499417697Z [2024-05-10 22:34:16,499: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:34:16.500453863Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.500464385Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.500579790Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.500589228Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:34:16.500753051Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:16.500795136Z [2024-05-10 22:34:16,500: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.504358825Z [2024-05-10 22:34:16,503: ERROR/ForkPoolWorker-1] [396da22f-0e2a-4beb-bfdd-588cc2f0dd1b] Failed to execute task Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:16.504371373Z Traceback (most recent call last): 2024-05-10T22:34:16.504375446Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:16.504379402Z args.func(args) 2024-05-10T22:34:16.504382879Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:16.504386805Z return func(*args, **kwargs) 2024-05-10T22:34:16.504389887Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:16.504393038Z return f(*args, **kwargs) 2024-05-10T22:34:16.504412609Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:16.504416363Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:16.504419511Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:16.504422658Z raise AirflowException( 2024-05-10T22:34:16.504426875Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_6184fb0f-d433-42cd-a55c-05492cdcef27' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:16.511520666Z [2024-05-10 22:34:16,511: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8bf8bab4-fa9f-499f-9234-d225a5335ddd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8bf8bab4-fa9f-499f-9234-d225a5335ddd') 2024-05-10T22:34:16.511534159Z Traceback (most recent call last): 2024-05-10T22:34:16.511555177Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:16.511558224Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:16.511561269Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:16.511564397Z return self.run(*args, **kwargs) 2024-05-10T22:34:16.511577862Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:16.511581407Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:16.511584285Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:16.511587649Z raise AirflowException(msg) 2024-05-10T22:34:16.511591030Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8bf8bab4-fa9f-499f-9234-d225a5335ddd 2024-05-10T22:34:16.530837978Z [2024-05-10 22:34:16,530: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[396da22f-0e2a-4beb-bfdd-588cc2f0dd1b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 396da22f-0e2a-4beb-bfdd-588cc2f0dd1b') 2024-05-10T22:34:16.530853730Z Traceback (most recent call last): 2024-05-10T22:34:16.530857388Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:16.530860452Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:16.530863389Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:16.530866460Z return self.run(*args, **kwargs) 2024-05-10T22:34:16.530870043Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:16.530873453Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:16.530876393Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:16.530879800Z raise AirflowException(msg) 2024-05-10T22:34:16.530883318Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 396da22f-0e2a-4beb-bfdd-588cc2f0dd1b 2024-05-10T22:34:16.553850098Z [2024-05-10 22:34:16,553: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:34:16.557072267Z [2024-05-10 22:34:16,556: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.578144331Z [2024-05-10 22:34:16,577: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:34:16.579530912Z [2024-05-10 22:34:16,579: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.580069994Z [2024-05-10 22:34:16,579: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.580457462Z [2024-05-10 22:34:16,580: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.580603995Z [2024-05-10 22:34:16,580: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:34:16.580937005Z [2024-05-10 22:34:16,580: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:16.581525471Z [2024-05-10 22:34:16,581: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.588350262Z [2024-05-10 22:34:16,588: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:16.589311147Z [2024-05-10 22:34:16,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:34:16.590194359Z [2024-05-10 22:34:16,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:34:16.593111249Z [2024-05-10 22:34:16,592: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:34:16.609925109Z [2024-05-10 22:34:16,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:34:16.611304830Z [2024-05-10 22:34:16,611: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:34:16.611487112Z [2024-05-10 22:34:16,611: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:34:16.611824944Z [2024-05-10 22:34:16,611: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:34:16.611953982Z [2024-05-10 22:34:16,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:34:16.612338021Z [2024-05-10 22:34:16,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:34:16.612483207Z [2024-05-10 22:34:16,612: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:34:16.615632099Z [2024-05-10 22:34:16,615: ERROR/ForkPoolWorker-16] [fce308f5-f9de-4b76-ad09-ca9f917df794] Failed to execute task Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:34:16.615647084Z Traceback (most recent call last): 2024-05-10T22:34:16.615654740Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:34:16.615662181Z args.func(args) 2024-05-10T22:34:16.615669626Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:34:16.615677501Z return func(*args, **kwargs) 2024-05-10T22:34:16.615684203Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:34:16.615690587Z return f(*args, **kwargs) 2024-05-10T22:34:16.615697016Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:34:16.615703383Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:34:16.615709799Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:34:16.615721343Z raise AirflowException( 2024-05-10T22:34:16.615728824Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:34:16.666883992Z [2024-05-10 22:34:16,666: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fce308f5-f9de-4b76-ad09-ca9f917df794] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fce308f5-f9de-4b76-ad09-ca9f917df794') 2024-05-10T22:34:16.666902617Z Traceback (most recent call last): 2024-05-10T22:34:16.666906652Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:34:16.666921545Z R = retval = fun(*args, **kwargs) 2024-05-10T22:34:16.666924660Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:34:16.666927687Z return self.run(*args, **kwargs) 2024-05-10T22:34:16.666931153Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:34:16.666934775Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:34:16.666937665Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:34:16.666941049Z raise AirflowException(msg) 2024-05-10T22:34:16.666944666Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fce308f5-f9de-4b76-ad09-ca9f917df794 2024-05-10T22:35:00.543068318Z [2024-05-10 22:35:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e46a6bf2-edc7-4793-855c-f913448e6fe3] received 2024-05-10T22:35:00.547757783Z [2024-05-10 22:35:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c117586b-2e67-4e1d-869d-18b76d8d749d] received 2024-05-10T22:35:00.553188500Z [2024-05-10 22:35:00,552: INFO/ForkPoolWorker-15] [e46a6bf2-edc7-4793-855c-f913448e6fe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:00.554559478Z [2024-05-10 22:35:00,554: INFO/ForkPoolWorker-16] [c117586b-2e67-4e1d-869d-18b76d8d749d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:00.560675574Z [2024-05-10 22:35:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de2a4431-2384-4cea-8d47-6e1d01d998d1] received 2024-05-10T22:35:00.567231980Z [2024-05-10 22:35:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cffe1d46-c5ef-460a-9410-49d709604360] received 2024-05-10T22:35:00.572116466Z [2024-05-10 22:35:00,571: INFO/ForkPoolWorker-1] [de2a4431-2384-4cea-8d47-6e1d01d998d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:00.573390700Z [2024-05-10 22:35:00,573: INFO/ForkPoolWorker-2] [cffe1d46-c5ef-460a-9410-49d709604360] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:00.588624755Z [2024-05-10 22:35:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eed31ebd-4703-4cb8-87a1-abea56e1181e] received 2024-05-10T22:35:00.592124393Z [2024-05-10 22:35:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[203db765-b9d3-45a4-a8e3-dbed619e7dd8] received 2024-05-10T22:35:00.597404822Z [2024-05-10 22:35:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[130a47d2-d94e-41a9-9a2d-a27f8971ff39] received 2024-05-10T22:35:00.604149626Z [2024-05-10 22:35:00,603: INFO/ForkPoolWorker-4] [203db765-b9d3-45a4-a8e3-dbed619e7dd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:00.604656636Z [2024-05-10 22:35:00,604: INFO/ForkPoolWorker-3] [eed31ebd-4703-4cb8-87a1-abea56e1181e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:35:00.610271980Z [2024-05-10 22:35:00,610: INFO/ForkPoolWorker-5] [130a47d2-d94e-41a9-9a2d-a27f8971ff39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:00.932083015Z [2024-05-10 22:35:00,929: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:00.948733827Z [2024-05-10 22:35:00,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:01.201094090Z [2024-05-10 22:35:01,197: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:01.233200210Z [2024-05-10 22:35:01,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:01.407519005Z [2024-05-10 22:35:01,397: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:01.547735580Z [2024-05-10 22:35:01,544: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:35:01.703156612Z [2024-05-10 22:35:01,692: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:01.944485802Z [2024-05-10 22:35:01,944: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T22:35:01.953404024Z [2024-05-10 22:35:01,952: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:02.055651539Z [2024-05-10 22:35:02,055: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:35:02.057985662Z [2024-05-10 22:35:02,057: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:35:02.058006139Z [2024-05-10 22:35:02,057: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:35:02.058038634Z [2024-05-10 22:35:02,057: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T22:35:02.058341391Z [2024-05-10 22:35:02,058: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:35:02.424879797Z [2024-05-10 22:35:02,424: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:03.144068888Z [2024-05-10 22:35:03,143: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:35:03.147395776Z [2024-05-10 22:35:03,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.185401419Z [2024-05-10 22:35:03,185: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:35:03.188442707Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.188477833Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.188648856Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.188710060Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:35:03.189029750Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:35:03.189039841Z [2024-05-10 22:35:03,188: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.246967368Z [2024-05-10 22:35:03,246: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[eed31ebd-4703-4cb8-87a1-abea56e1181e] succeeded in 2.652250431000084s: None 2024-05-10T22:35:03.300449567Z [2024-05-10 22:35:03,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:03.321481888Z [2024-05-10 22:35:03,321: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:35:03.325230820Z [2024-05-10 22:35:03,324: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.360300071Z [2024-05-10 22:35:03,360: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:35:03.362619561Z [2024-05-10 22:35:03,362: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.362648724Z [2024-05-10 22:35:03,362: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.362791508Z [2024-05-10 22:35:03,362: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.362805545Z [2024-05-10 22:35:03,362: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:35:03.363144544Z [2024-05-10 22:35:03,362: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:03.363157678Z [2024-05-10 22:35:03,363: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.412388837Z [2024-05-10 22:35:03,410: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-10T22:35:03.416489586Z [2024-05-10 22:35:03,416: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.482393505Z [2024-05-10 22:35:03,480: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-10T22:35:03.482422558Z [2024-05-10 22:35:03,481: INFO/ForkPoolWorker-5] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.482426100Z [2024-05-10 22:35:03,481: INFO/ForkPoolWorker-5] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.485559440Z [2024-05-10 22:35:03,481: INFO/ForkPoolWorker-5] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.485573833Z [2024-05-10 22:35:03,482: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-10T22:35:03.485577628Z [2024-05-10 22:35:03,482: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:35:03.485580773Z [2024-05-10 22:35:03,482: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.492176550Z [2024-05-10 22:35:03,489: WARNING/ForkPoolWorker-5] Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:03.492196060Z [2024-05-10 22:35:03,489: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:03.492200224Z [2024-05-10 22:35:03,490: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-10T22:35:03.499602001Z [2024-05-10 22:35:03,499: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.545985590Z [2024-05-10 22:35:03,544: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-10T22:35:03.546003520Z [2024-05-10 22:35:03,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:03.550009603Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.550027516Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.550031689Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.550035728Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-10T22:35:03.550038988Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:35:03.550041962Z [2024-05-10 22:35:03,546: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.550050755Z [2024-05-10 22:35:03,549: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:35:03.554112996Z [2024-05-10 22:35:03,553: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.560245507Z [2024-05-10 22:35:03,557: ERROR/ForkPoolWorker-5] [130a47d2-d94e-41a9-9a2d-a27f8971ff39] Failed to execute task Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:03.560280891Z Traceback (most recent call last): 2024-05-10T22:35:03.560284967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:03.560288672Z args.func(args) 2024-05-10T22:35:03.560292419Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:03.560295922Z return func(*args, **kwargs) 2024-05-10T22:35:03.560298929Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:03.560302019Z return f(*args, **kwargs) 2024-05-10T22:35:03.560305298Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:03.560308235Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:03.560327459Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:03.560331088Z raise AirflowException( 2024-05-10T22:35:03.560335129Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:03.595958607Z [2024-05-10 22:35:03,595: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:35:03.598773159Z [2024-05-10 22:35:03,598: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.598795255Z [2024-05-10 22:35:03,598: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.598890145Z [2024-05-10 22:35:03,598: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.598923127Z [2024-05-10 22:35:03,598: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:35:03.599130736Z [2024-05-10 22:35:03,599: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:35:03.599160484Z [2024-05-10 22:35:03,599: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.607018604Z [2024-05-10 22:35:03,606: WARNING/ForkPoolWorker-2] Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:03.607931757Z [2024-05-10 22:35:03,607: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:03.608863221Z [2024-05-10 22:35:03,608: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:35:03.611512983Z [2024-05-10 22:35:03,611: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.637725963Z [2024-05-10 22:35:03,636: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[130a47d2-d94e-41a9-9a2d-a27f8971ff39] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 130a47d2-d94e-41a9-9a2d-a27f8971ff39') 2024-05-10T22:35:03.637740970Z Traceback (most recent call last): 2024-05-10T22:35:03.637745113Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:03.637761218Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:03.637764737Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:03.637767713Z return self.run(*args, **kwargs) 2024-05-10T22:35:03.637771186Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:03.637774731Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:03.637777738Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:03.637781238Z raise AirflowException(msg) 2024-05-10T22:35:03.637784626Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 130a47d2-d94e-41a9-9a2d-a27f8971ff39 2024-05-10T22:35:03.648965637Z [2024-05-10 22:35:03,648: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:35:03.652551178Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.652570575Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.652665770Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.652697185Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:35:03.653034069Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:35:03.653375704Z [2024-05-10 22:35:03,652: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.656601663Z [2024-05-10 22:35:03,656: ERROR/ForkPoolWorker-2] [cffe1d46-c5ef-460a-9410-49d709604360] Failed to execute task Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:03.656617571Z Traceback (most recent call last): 2024-05-10T22:35:03.656621520Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:03.656625231Z args.func(args) 2024-05-10T22:35:03.656629089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:03.656632965Z return func(*args, **kwargs) 2024-05-10T22:35:03.656636009Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:03.656638966Z return f(*args, **kwargs) 2024-05-10T22:35:03.656641980Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:03.656645406Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:03.656648365Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:03.656651272Z raise AirflowException( 2024-05-10T22:35:03.656655079Z airflow.exceptions.AirflowException: Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:03.695555088Z [2024-05-10 22:35:03,694: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cffe1d46-c5ef-460a-9410-49d709604360] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cffe1d46-c5ef-460a-9410-49d709604360') 2024-05-10T22:35:03.695592834Z Traceback (most recent call last): 2024-05-10T22:35:03.695597591Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:03.695601172Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:03.695605239Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:03.695608760Z return self.run(*args, **kwargs) 2024-05-10T22:35:03.695612835Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:03.695616860Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:03.695620414Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:03.695624350Z raise AirflowException(msg) 2024-05-10T22:35:03.695628551Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cffe1d46-c5ef-460a-9410-49d709604360 2024-05-10T22:35:03.747151583Z [2024-05-10 22:35:03,746: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:03.751447848Z [2024-05-10 22:35:03,750: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.781181949Z [2024-05-10 22:35:03,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:03.783072103Z [2024-05-10 22:35:03,782: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.783637150Z [2024-05-10 22:35:03,783: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.783728965Z [2024-05-10 22:35:03,783: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.783754236Z [2024-05-10 22:35:03,783: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:03.783996751Z [2024-05-10 22:35:03,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:03.784032135Z [2024-05-10 22:35:03,783: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.791146097Z [2024-05-10 22:35:03,790: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:03.791802918Z [2024-05-10 22:35:03,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:03.792700720Z [2024-05-10 22:35:03,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:03.796481716Z [2024-05-10 22:35:03,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.822598208Z [2024-05-10 22:35:03,822: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:03.825073866Z [2024-05-10 22:35:03,824: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.825111392Z [2024-05-10 22:35:03,825: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.825352453Z [2024-05-10 22:35:03,825: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.825483706Z [2024-05-10 22:35:03,825: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:03.825724638Z [2024-05-10 22:35:03,825: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:03.825741298Z [2024-05-10 22:35:03,825: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:03.830383790Z [2024-05-10 22:35:03,829: ERROR/ForkPoolWorker-15] [e46a6bf2-edc7-4793-855c-f913448e6fe3] Failed to execute task Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:03.830399447Z Traceback (most recent call last): 2024-05-10T22:35:03.830403181Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:03.830406696Z args.func(args) 2024-05-10T22:35:03.830410562Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:03.830414063Z return func(*args, **kwargs) 2024-05-10T22:35:03.830417410Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:03.830420357Z return f(*args, **kwargs) 2024-05-10T22:35:03.830423472Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:03.830426525Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:03.830429439Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:03.830432384Z raise AirflowException( 2024-05-10T22:35:03.830436155Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:03.863881139Z [2024-05-10 22:35:03,863: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e46a6bf2-edc7-4793-855c-f913448e6fe3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e46a6bf2-edc7-4793-855c-f913448e6fe3') 2024-05-10T22:35:03.863897896Z Traceback (most recent call last): 2024-05-10T22:35:03.863902060Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:03.863905361Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:03.863908525Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:03.863911485Z return self.run(*args, **kwargs) 2024-05-10T22:35:03.863915020Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:03.863918558Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:03.863921855Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:03.863925261Z raise AirflowException(msg) 2024-05-10T22:35:03.863928944Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e46a6bf2-edc7-4793-855c-f913448e6fe3 2024-05-10T22:35:03.918623598Z [2024-05-10 22:35:03,918: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-10T22:35:03.921973793Z [2024-05-10 22:35:03,921: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:03.948624112Z [2024-05-10 22:35:03,948: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-10T22:35:03.950116207Z [2024-05-10 22:35:03,949: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:03.950151367Z [2024-05-10 22:35:03,950: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:03.950343975Z [2024-05-10 22:35:03,950: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:03.950364706Z [2024-05-10 22:35:03,950: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-10T22:35:03.950638560Z [2024-05-10 22:35:03,950: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:35:03.950662735Z [2024-05-10 22:35:03,950: INFO/ForkPoolWorker-4] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:04.043545183Z [2024-05-10 22:35:04,043: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:04.217638316Z [2024-05-10 22:35:04,217: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c117586b-2e67-4e1d-869d-18b76d8d749d] succeeded in 3.6685268789999554s: None 2024-05-10T22:35:04.643444857Z [2024-05-10 22:35:04,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b66c4713-fbe2-4220-a577-2125cd586744] received 2024-05-10T22:35:04.650558043Z [2024-05-10 22:35:04,650: INFO/ForkPoolWorker-15] [b66c4713-fbe2-4220-a577-2125cd586744] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:04.920238195Z [2024-05-10 22:35:04,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:05.250914693Z [2024-05-10 22:35:05,250: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de2a4431-2384-4cea-8d47-6e1d01d998d1] succeeded in 4.6862634180001805s: None 2024-05-10T22:35:05.586664139Z [2024-05-10 22:35:05,586: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[203db765-b9d3-45a4-a8e3-dbed619e7dd8] succeeded in 4.990564719000076s: None 2024-05-10T22:35:06.030181564Z [2024-05-10 22:35:06,029: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:06.033422003Z [2024-05-10 22:35:06,032: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:06.050252820Z [2024-05-10 22:35:06,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:06.051279581Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:06.051349378Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:06.051476368Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:06.051505186Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:06.051709919Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:06.051736117Z [2024-05-10 22:35:06,051: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:06.132934704Z [2024-05-10 22:35:06,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:06.757819259Z [2024-05-10 22:35:06,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b66c4713-fbe2-4220-a577-2125cd586744] succeeded in 2.1119313439999132s: None 2024-05-10T22:35:07.774525605Z [2024-05-10 22:35:07,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07172466-32da-4d5c-9ab3-d7e854b6acc6] received 2024-05-10T22:35:07.780626813Z [2024-05-10 22:35:07,780: INFO/ForkPoolWorker-15] [07172466-32da-4d5c-9ab3-d7e854b6acc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:35:08.044928137Z [2024-05-10 22:35:08,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:09.103349963Z [2024-05-10 22:35:09,103: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:09.106861840Z [2024-05-10 22:35:09,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:09.123878827Z [2024-05-10 22:35:09,123: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:09.125137871Z [2024-05-10 22:35:09,124: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:09.125233771Z [2024-05-10 22:35:09,125: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:09.125360763Z [2024-05-10 22:35:09,125: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:09.125440448Z [2024-05-10 22:35:09,125: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:09.125674821Z [2024-05-10 22:35:09,125: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:09.125770876Z [2024-05-10 22:35:09,125: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:09.206483097Z [2024-05-10 22:35:09,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:09.745906607Z [2024-05-10 22:35:09,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07172466-32da-4d5c-9ab3-d7e854b6acc6] succeeded in 1.9702144309999312s: None 2024-05-10T22:35:09.760957538Z [2024-05-10 22:35:09,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be85ca14-87f6-4469-ad56-b6cc0b54e789] received 2024-05-10T22:35:09.769626804Z [2024-05-10 22:35:09,769: INFO/ForkPoolWorker-15] [be85ca14-87f6-4469-ad56-b6cc0b54e789] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:10.107065270Z [2024-05-10 22:35:10,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:11.121245117Z [2024-05-10 22:35:11,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:11.124653737Z [2024-05-10 22:35:11,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:11.144096220Z [2024-05-10 22:35:11,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:11.145312777Z [2024-05-10 22:35:11,145: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:11.145473741Z [2024-05-10 22:35:11,145: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:11.145670357Z [2024-05-10 22:35:11,145: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:11.145817320Z [2024-05-10 22:35:11,145: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:11.146143249Z [2024-05-10 22:35:11,145: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:11.146607080Z [2024-05-10 22:35:11,146: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:11.223147239Z [2024-05-10 22:35:11,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:35:11.765041233Z [2024-05-10 22:35:11,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be85ca14-87f6-4469-ad56-b6cc0b54e789] succeeded in 2.0018771569998535s: None 2024-05-10T22:35:14.927414739Z [2024-05-10 22:35:14,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b6e3829-f4a4-4b9b-b269-9a7812ba48fb] received 2024-05-10T22:35:14.930399322Z [2024-05-10 22:35:14,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54b829ea-ca32-490c-96e6-07b9fc59767d] received 2024-05-10T22:35:14.934708845Z [2024-05-10 22:35:14,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c9edb97-41bd-498c-b5b8-09b27d50f46d] received 2024-05-10T22:35:14.936578583Z [2024-05-10 22:35:14,936: INFO/ForkPoolWorker-15] [8b6e3829-f4a4-4b9b-b269-9a7812ba48fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:35:14.944409203Z [2024-05-10 22:35:14,944: INFO/ForkPoolWorker-1] [5c9edb97-41bd-498c-b5b8-09b27d50f46d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:35:14.946073642Z [2024-05-10 22:35:14,944: INFO/ForkPoolWorker-16] [54b829ea-ca32-490c-96e6-07b9fc59767d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:35:15.221939203Z [2024-05-10 22:35:15,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:15.246900409Z [2024-05-10 22:35:15,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:15.265701728Z [2024-05-10 22:35:15,262: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:16.295707799Z [2024-05-10 22:35:16,295: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:35:16.298848150Z [2024-05-10 22:35:16,298: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.311614904Z [2024-05-10 22:35:16,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:16.314692519Z [2024-05-10 22:35:16,314: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.338773897Z [2024-05-10 22:35:16,338: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:16.338790928Z [2024-05-10 22:35:16,338: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:35:16.339885462Z [2024-05-10 22:35:16,339: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.339901760Z [2024-05-10 22:35:16,339: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.340049942Z [2024-05-10 22:35:16,339: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.340064919Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:16.340300871Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:16.340312656Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.340848339Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.340928317Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.341105050Z [2024-05-10 22:35:16,340: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.341179184Z [2024-05-10 22:35:16,341: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:35:16.341453884Z [2024-05-10 22:35:16,341: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:35:16.341527293Z [2024-05-10 22:35:16,341: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.347590865Z [2024-05-10 22:35:16,347: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:16.347725939Z [2024-05-10 22:35:16,347: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:16.348363878Z [2024-05-10 22:35:16,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:35:16.348418486Z [2024-05-10 22:35:16,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:35:16.349226149Z [2024-05-10 22:35:16,349: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:35:16.349235978Z [2024-05-10 22:35:16,349: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:35:16.351915647Z [2024-05-10 22:35:16,351: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.351935198Z [2024-05-10 22:35:16,351: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.364060904Z [2024-05-10 22:35:16,363: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:35:16.366463896Z [2024-05-10 22:35:16,366: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.367084442Z [2024-05-10 22:35:16,366: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:35:16.367553312Z [2024-05-10 22:35:16,366: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.368164897Z [2024-05-10 22:35:16,367: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.368333709Z [2024-05-10 22:35:16,367: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.368406681Z [2024-05-10 22:35:16,368: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.368592974Z [2024-05-10 22:35:16,368: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.368773578Z [2024-05-10 22:35:16,368: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:35:16.368856306Z [2024-05-10 22:35:16,368: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:35:16.369354420Z [2024-05-10 22:35:16,369: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:35:16.369428799Z [2024-05-10 22:35:16,369: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.369578324Z [2024-05-10 22:35:16,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:35:16.370250633Z [2024-05-10 22:35:16,369: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.374632237Z [2024-05-10 22:35:16,374: ERROR/ForkPoolWorker-1] [5c9edb97-41bd-498c-b5b8-09b27d50f46d] Failed to execute task Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:16.374645398Z Traceback (most recent call last): 2024-05-10T22:35:16.374649914Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:16.374653741Z args.func(args) 2024-05-10T22:35:16.374657085Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:16.374665803Z return func(*args, **kwargs) 2024-05-10T22:35:16.374669233Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:16.374672312Z return f(*args, **kwargs) 2024-05-10T22:35:16.374689394Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:16.374692569Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:16.374695678Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:16.374698891Z raise AirflowException( 2024-05-10T22:35:16.374702790Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:16.378819977Z [2024-05-10 22:35:16,377: ERROR/ForkPoolWorker-15] [8b6e3829-f4a4-4b9b-b269-9a7812ba48fb] Failed to execute task Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:16.378843042Z Traceback (most recent call last): 2024-05-10T22:35:16.378846612Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:16.378850362Z args.func(args) 2024-05-10T22:35:16.378853312Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:16.378856780Z return func(*args, **kwargs) 2024-05-10T22:35:16.378859824Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:16.378862531Z return f(*args, **kwargs) 2024-05-10T22:35:16.378865505Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:16.378868395Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:16.378883647Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:16.378886540Z raise AirflowException( 2024-05-10T22:35:16.378890418Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:16.415640762Z [2024-05-10 22:35:16,414: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c9edb97-41bd-498c-b5b8-09b27d50f46d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5c9edb97-41bd-498c-b5b8-09b27d50f46d') 2024-05-10T22:35:16.415686400Z Traceback (most recent call last): 2024-05-10T22:35:16.415691593Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:16.415694827Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:16.415697794Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:16.415700972Z return self.run(*args, **kwargs) 2024-05-10T22:35:16.415704637Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:16.415708442Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:16.415711355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:16.415714996Z raise AirflowException(msg) 2024-05-10T22:35:16.415718652Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5c9edb97-41bd-498c-b5b8-09b27d50f46d 2024-05-10T22:35:16.426821163Z [2024-05-10 22:35:16,426: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b6e3829-f4a4-4b9b-b269-9a7812ba48fb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8b6e3829-f4a4-4b9b-b269-9a7812ba48fb') 2024-05-10T22:35:16.426841564Z Traceback (most recent call last): 2024-05-10T22:35:16.426845417Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:16.426848522Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:16.426851730Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:16.426882798Z return self.run(*args, **kwargs) 2024-05-10T22:35:16.426887127Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:16.426891752Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:16.426895397Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:16.426899650Z raise AirflowException(msg) 2024-05-10T22:35:16.426903683Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8b6e3829-f4a4-4b9b-b269-9a7812ba48fb 2024-05-10T22:35:16.518077757Z [2024-05-10 22:35:16,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:35:16.524265733Z [2024-05-10 22:35:16,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.562152402Z [2024-05-10 22:35:16,558: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:35:16.562174174Z [2024-05-10 22:35:16,559: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.562179225Z [2024-05-10 22:35:16,560: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.562183966Z [2024-05-10 22:35:16,560: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.562228412Z [2024-05-10 22:35:16,560: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:35:16.562237708Z [2024-05-10 22:35:16,560: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:35:16.562242064Z [2024-05-10 22:35:16,560: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.567152501Z [2024-05-10 22:35:16,566: WARNING/ForkPoolWorker-16] Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:16.568154144Z [2024-05-10 22:35:16,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:35:16.569070176Z [2024-05-10 22:35:16,568: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:35:16.571985313Z [2024-05-10 22:35:16,571: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:35:16.597950405Z [2024-05-10 22:35:16,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:35:16.600148011Z [2024-05-10 22:35:16,599: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:35:16.600171364Z [2024-05-10 22:35:16,600: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:35:16.600300214Z [2024-05-10 22:35:16,600: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:35:16.600312371Z [2024-05-10 22:35:16,600: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:35:16.600753785Z [2024-05-10 22:35:16,600: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:35:16.600772680Z [2024-05-10 22:35:16,600: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:35:16.604882749Z [2024-05-10 22:35:16,604: ERROR/ForkPoolWorker-16] [54b829ea-ca32-490c-96e6-07b9fc59767d] Failed to execute task Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:35:16.604907934Z Traceback (most recent call last): 2024-05-10T22:35:16.604913492Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:35:16.604918687Z args.func(args) 2024-05-10T22:35:16.604924134Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:35:16.604929430Z return func(*args, **kwargs) 2024-05-10T22:35:16.604934138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:35:16.604939200Z return f(*args, **kwargs) 2024-05-10T22:35:16.604943949Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:35:16.604948593Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:35:16.604953254Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:35:16.604958074Z raise AirflowException( 2024-05-10T22:35:16.604963376Z airflow.exceptions.AirflowException: Dag 'vim_status_e3efeb20-6d04-4087-95d3-ef01f8dc9f09' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:35:16.633498415Z [2024-05-10 22:35:16,632: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54b829ea-ca32-490c-96e6-07b9fc59767d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 54b829ea-ca32-490c-96e6-07b9fc59767d') 2024-05-10T22:35:16.633524415Z Traceback (most recent call last): 2024-05-10T22:35:16.633545933Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:35:16.633549654Z R = retval = fun(*args, **kwargs) 2024-05-10T22:35:16.633552943Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:35:16.633556281Z return self.run(*args, **kwargs) 2024-05-10T22:35:16.633560515Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:35:16.633565143Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:35:16.633568325Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:35:16.633572673Z raise AirflowException(msg) 2024-05-10T22:35:16.633576657Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 54b829ea-ca32-490c-96e6-07b9fc59767d 2024-05-10T22:36:00.747024092Z [2024-05-10 22:36:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1a734e2-bbbb-4bb6-8062-fe6423b029d6] received 2024-05-10T22:36:00.750296200Z [2024-05-10 22:36:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08d867fc-52a9-4c1d-9c4c-ab86cd3deb2e] received 2024-05-10T22:36:00.769163642Z [2024-05-10 22:36:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[094c9c71-4b36-45c1-a8fc-e3198e00fb2d] received 2024-05-10T22:36:00.771839984Z [2024-05-10 22:36:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[601543ed-a891-4d3c-a6b4-704c1ba57a7e] received 2024-05-10T22:36:00.771876208Z [2024-05-10 22:36:00,771: INFO/ForkPoolWorker-15] [c1a734e2-bbbb-4bb6-8062-fe6423b029d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:36:00.776045876Z [2024-05-10 22:36:00,775: INFO/ForkPoolWorker-16] [08d867fc-52a9-4c1d-9c4c-ab86cd3deb2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:36:00.779376533Z [2024-05-10 22:36:00,779: INFO/ForkPoolWorker-2] [601543ed-a891-4d3c-a6b4-704c1ba57a7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:36:00.780992394Z [2024-05-10 22:36:00,780: INFO/ForkPoolWorker-1] [094c9c71-4b36-45c1-a8fc-e3198e00fb2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:36:01.073938900Z [2024-05-10 22:36:01,061: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:36:01.162991335Z [2024-05-10 22:36:01,159: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:36:01.224798910Z [2024-05-10 22:36:01,221: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:36:01.389978086Z [2024-05-10 22:36:01,386: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:36:01.394165805Z [2024-05-10 22:36:01,393: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T22:36:01.398346810Z [2024-05-10 22:36:01,397: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:36:01.450906566Z [2024-05-10 22:36:01,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:36:01.454169370Z [2024-05-10 22:36:01,453: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:36:01.454286761Z [2024-05-10 22:36:01,454: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:36:01.454359088Z [2024-05-10 22:36:01,454: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T22:36:01.454571063Z [2024-05-10 22:36:01,454: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:36:01.572663627Z [2024-05-10 22:36:01,572: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:36:01.720895216Z [2024-05-10 22:36:01,720: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:36:02.269363747Z [2024-05-10 22:36:02,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1a734e2-bbbb-4bb6-8062-fe6423b029d6] succeeded in 1.5162159070000598s: None 2024-05-10T22:36:02.387103775Z [2024-05-10 22:36:02,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08d867fc-52a9-4c1d-9c4c-ab86cd3deb2e] succeeded in 1.6179342779998933s: None 2024-05-10T22:36:02.533731790Z [2024-05-10 22:36:02,533: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:36:02.537187896Z [2024-05-10 22:36:02,536: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:36:02.565825386Z [2024-05-10 22:36:02,565: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:36:02.567389782Z [2024-05-10 22:36:02,567: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:36:02.567530158Z [2024-05-10 22:36:02,567: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:36:02.567740977Z [2024-05-10 22:36:02,567: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:36:02.567809116Z [2024-05-10 22:36:02,567: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:36:02.568193737Z [2024-05-10 22:36:02,567: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:36:02.568319433Z [2024-05-10 22:36:02,568: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:36:02.613699577Z [2024-05-10 22:36:02,613: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:36:02.617103734Z [2024-05-10 22:36:02,616: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:36:02.634407234Z [2024-05-10 22:36:02,634: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:36:02.635704761Z [2024-05-10 22:36:02,635: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:36:02.635715896Z [2024-05-10 22:36:02,635: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:36:02.635925064Z [2024-05-10 22:36:02,635: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:36:02.636068722Z [2024-05-10 22:36:02,635: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:36:02.636271813Z [2024-05-10 22:36:02,636: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:36:02.636380228Z [2024-05-10 22:36:02,636: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:36:02.650420871Z [2024-05-10 22:36:02,650: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:36:02.713703905Z [2024-05-10 22:36:02,713: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:36:04.312509584Z [2024-05-10 22:36:04,311: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[601543ed-a891-4d3c-a6b4-704c1ba57a7e] succeeded in 3.539298027000086s: None 2024-05-10T22:36:04.627114991Z [2024-05-10 22:36:04,626: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[094c9c71-4b36-45c1-a8fc-e3198e00fb2d] succeeded in 3.856069920999971s: None 2024-05-10T22:37:00.474235093Z [2024-05-10 22:37:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d745d38-d082-41ec-9d6a-cc1e460f5a60] received 2024-05-10T22:37:00.480890876Z [2024-05-10 22:37:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5044718a-5b8a-4236-af3c-4b8a7611c116] received 2024-05-10T22:37:00.486582870Z [2024-05-10 22:37:00,486: INFO/ForkPoolWorker-15] [4d745d38-d082-41ec-9d6a-cc1e460f5a60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:37:00.488950005Z [2024-05-10 22:37:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1621267-91db-4714-bba0-4eab6e6712c2] received 2024-05-10T22:37:00.490613872Z [2024-05-10 22:37:00,490: INFO/ForkPoolWorker-16] [5044718a-5b8a-4236-af3c-4b8a7611c116] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:37:00.495527008Z [2024-05-10 22:37:00,495: INFO/ForkPoolWorker-1] [a1621267-91db-4714-bba0-4eab6e6712c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:37:00.778038476Z [2024-05-10 22:37:00,774: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:37:00.802589840Z [2024-05-10 22:37:00,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:37:00.804976531Z [2024-05-10 22:37:00,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:37:00.965433994Z [2024-05-10 22:37:00,965: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:37:00.969474767Z [2024-05-10 22:37:00,969: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:37:00.993216472Z [2024-05-10 22:37:00,992: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:37:00.994679295Z [2024-05-10 22:37:00,994: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:37:00.994860152Z [2024-05-10 22:37:00,994: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:37:00.995021816Z [2024-05-10 22:37:00,994: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:37:00.995258442Z [2024-05-10 22:37:00,995: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:37:01.145828038Z [2024-05-10 22:37:01,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:37:01.783655615Z [2024-05-10 22:37:01,781: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1621267-91db-4714-bba0-4eab6e6712c2] succeeded in 1.2915586020001228s: None 2024-05-10T22:37:01.901662361Z [2024-05-10 22:37:01,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:37:01.905115432Z [2024-05-10 22:37:01,904: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:37:01.923520340Z [2024-05-10 22:37:01,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:37:01.924768785Z [2024-05-10 22:37:01,924: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:37:01.924901665Z [2024-05-10 22:37:01,924: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:37:01.925107415Z [2024-05-10 22:37:01,924: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:37:01.925176010Z [2024-05-10 22:37:01,925: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:37:01.925471805Z [2024-05-10 22:37:01,925: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:37:01.925575709Z [2024-05-10 22:37:01,925: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:37:02.026599772Z [2024-05-10 22:37:02,026: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:37:02.052719700Z [2024-05-10 22:37:02,052: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:37:02.056343140Z [2024-05-10 22:37:02,055: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:37:02.077160778Z [2024-05-10 22:37:02,076: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:37:02.078254691Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:37:02.078274319Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:37:02.078382802Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:37:02.078399276Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:37:02.078608544Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:37:02.078643364Z [2024-05-10 22:37:02,078: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:37:02.178443245Z [2024-05-10 22:37:02,178: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:37:03.850470698Z [2024-05-10 22:37:03,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d745d38-d082-41ec-9d6a-cc1e460f5a60] succeeded in 3.3738125029999537s: None 2024-05-10T22:37:03.881578896Z [2024-05-10 22:37:03,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5044718a-5b8a-4236-af3c-4b8a7611c116] succeeded in 3.3981341439998687s: None 2024-05-10T22:38:01.532956086Z [2024-05-10 22:38:01,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2277fee5-09d2-42c2-acf1-80409dfd3e23] received 2024-05-10T22:38:01.543758162Z [2024-05-10 22:38:01,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3902e74-c9c4-4ba0-958e-107fe8aaf44b] received 2024-05-10T22:38:01.546388630Z [2024-05-10 22:38:01,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bd71e94-fc1d-491e-8254-731e2b80f495] received 2024-05-10T22:38:01.548996871Z [2024-05-10 22:38:01,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89600b61-1992-4751-9f36-98f25b8c821e] received 2024-05-10T22:38:01.558503462Z [2024-05-10 22:38:01,558: INFO/ForkPoolWorker-15] [2277fee5-09d2-42c2-acf1-80409dfd3e23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:38:01.562115870Z [2024-05-10 22:38:01,561: INFO/ForkPoolWorker-2] [89600b61-1992-4751-9f36-98f25b8c821e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:38:01.565910354Z [2024-05-10 22:38:01,565: INFO/ForkPoolWorker-1] [2bd71e94-fc1d-491e-8254-731e2b80f495] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:38:01.567286630Z [2024-05-10 22:38:01,567: INFO/ForkPoolWorker-16] [f3902e74-c9c4-4ba0-958e-107fe8aaf44b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:38:02.281533573Z [2024-05-10 22:38:02,277: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:38:02.307422579Z [2024-05-10 22:38:02,303: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:38:02.569766311Z [2024-05-10 22:38:02,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:38:02.822435677Z [2024-05-10 22:38:02,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:38:03.150110723Z [2024-05-10 22:38:03,149: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:38:03.154235579Z [2024-05-10 22:38:03,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:38:03.202506829Z [2024-05-10 22:38:03,202: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:38:03.210679397Z [2024-05-10 22:38:03,210: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:38:03.210911502Z [2024-05-10 22:38:03,210: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:38:03.211105822Z [2024-05-10 22:38:03,210: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:38:03.211529290Z [2024-05-10 22:38:03,211: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:38:03.288660992Z [2024-05-10 22:38:03,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:38:03.303192155Z [2024-05-10 22:38:03,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:38:04.005060191Z [2024-05-10 22:38:04,004: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2bd71e94-fc1d-491e-8254-731e2b80f495] succeeded in 2.457031976000053s: None 2024-05-10T22:38:04.189652547Z [2024-05-10 22:38:04,189: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3902e74-c9c4-4ba0-958e-107fe8aaf44b] succeeded in 2.6436484009998367s: None 2024-05-10T22:38:04.393495700Z [2024-05-10 22:38:04,393: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:38:04.396955097Z [2024-05-10 22:38:04,396: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:38:04.435914725Z [2024-05-10 22:38:04,435: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:38:04.437587320Z [2024-05-10 22:38:04,437: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:38:04.437736010Z [2024-05-10 22:38:04,437: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:38:04.438059431Z [2024-05-10 22:38:04,437: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:38:04.438184832Z [2024-05-10 22:38:04,438: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:38:04.438537508Z [2024-05-10 22:38:04,438: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:38:04.438894773Z [2024-05-10 22:38:04,438: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:38:04.533262871Z [2024-05-10 22:38:04,533: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:38:04.748369390Z [2024-05-10 22:38:04,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:38:04.752199231Z [2024-05-10 22:38:04,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:38:04.798072845Z [2024-05-10 22:38:04,797: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:38:04.801676380Z [2024-05-10 22:38:04,801: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:38:04.801921795Z [2024-05-10 22:38:04,801: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:38:04.802180968Z [2024-05-10 22:38:04,801: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:38:04.802569151Z [2024-05-10 22:38:04,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:38:04.803767508Z [2024-05-10 22:38:04,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:38:04.803778507Z [2024-05-10 22:38:04,803: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:38:05.015883522Z [2024-05-10 22:38:05,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:38:06.257742888Z [2024-05-10 22:38:06,257: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89600b61-1992-4751-9f36-98f25b8c821e] succeeded in 4.706325515999879s: None 2024-05-10T22:38:07.399276090Z [2024-05-10 22:38:07,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2277fee5-09d2-42c2-acf1-80409dfd3e23] succeeded in 5.85664921800003s: None 2024-05-10T22:39:00.635313623Z [2024-05-10 22:39:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe916727-f18c-4ab7-9f84-e2dbd87889f3] received 2024-05-10T22:39:00.645950663Z [2024-05-10 22:39:00,645: INFO/ForkPoolWorker-15] [fe916727-f18c-4ab7-9f84-e2dbd87889f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:39:00.651307094Z [2024-05-10 22:39:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80adf74d-1fb0-479a-bccf-91105bf1d30f] received 2024-05-10T22:39:00.653154308Z [2024-05-10 22:39:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e123edbb-6f8e-4aac-a8ed-2d4bd1e55800] received 2024-05-10T22:39:00.663118898Z [2024-05-10 22:39:00,662: INFO/ForkPoolWorker-1] [e123edbb-6f8e-4aac-a8ed-2d4bd1e55800] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:39:00.686853248Z [2024-05-10 22:39:00,686: INFO/ForkPoolWorker-16] [80adf74d-1fb0-479a-bccf-91105bf1d30f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:39:01.214114365Z [2024-05-10 22:39:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:39:01.278588691Z [2024-05-10 22:39:01,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:39:01.300805122Z [2024-05-10 22:39:01,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:39:01.476038449Z [2024-05-10 22:39:01,475: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:39:01.480300386Z [2024-05-10 22:39:01,479: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:39:01.509194934Z [2024-05-10 22:39:01,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:39:01.511839676Z [2024-05-10 22:39:01,511: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:39:01.512072805Z [2024-05-10 22:39:01,511: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:39:01.512210022Z [2024-05-10 22:39:01,512: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:39:01.512561073Z [2024-05-10 22:39:01,512: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:39:01.612526583Z [2024-05-10 22:39:01,612: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:39:02.270104790Z [2024-05-10 22:39:02,269: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80adf74d-1fb0-479a-bccf-91105bf1d30f] succeeded in 1.6155162319998908s: None 2024-05-10T22:39:02.432031575Z [2024-05-10 22:39:02,431: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:39:02.435437140Z [2024-05-10 22:39:02,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:39:02.462365537Z [2024-05-10 22:39:02,462: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:39:02.464272300Z [2024-05-10 22:39:02,464: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:39:02.464484150Z [2024-05-10 22:39:02,464: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:39:02.464742787Z [2024-05-10 22:39:02,464: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:39:02.464923905Z [2024-05-10 22:39:02,464: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:39:02.465408418Z [2024-05-10 22:39:02,465: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:39:02.465590365Z [2024-05-10 22:39:02,465: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:39:02.559745760Z [2024-05-10 22:39:02,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:39:02.569637052Z [2024-05-10 22:39:02,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:39:02.573296390Z [2024-05-10 22:39:02,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:39:02.597679140Z [2024-05-10 22:39:02,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:39:02.599256148Z [2024-05-10 22:39:02,599: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:39:02.599741835Z [2024-05-10 22:39:02,599: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:39:02.599946099Z [2024-05-10 22:39:02,599: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:39:02.600039987Z [2024-05-10 22:39:02,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:39:02.600326718Z [2024-05-10 22:39:02,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:39:02.600471475Z [2024-05-10 22:39:02,600: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:39:02.680702866Z [2024-05-10 22:39:02,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:39:05.053617728Z [2024-05-10 22:39:05,053: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e123edbb-6f8e-4aac-a8ed-2d4bd1e55800] succeeded in 4.399280257999862s: None 2024-05-10T22:39:05.563918911Z [2024-05-10 22:39:05,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe916727-f18c-4ab7-9f84-e2dbd87889f3] succeeded in 4.925660625999853s: None 2024-05-10T22:40:01.057973207Z [2024-05-10 22:40:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a939313d-00c3-4a2d-bf6b-564965894dab] received 2024-05-10T22:40:01.059954109Z [2024-05-10 22:40:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f9d6d4d-2a5e-432b-ad25-a0f86ba726c5] received 2024-05-10T22:40:01.061663816Z [2024-05-10 22:40:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00907766-c948-46ab-82f6-d0316490442b] received 2024-05-10T22:40:01.067220618Z [2024-05-10 22:40:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69a39852-ed95-4c0d-b42e-2b8bfe41828b] received 2024-05-10T22:40:01.070944972Z [2024-05-10 22:40:01,067: INFO/ForkPoolWorker-15] [a939313d-00c3-4a2d-bf6b-564965894dab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:40:01.087331405Z [2024-05-10 22:40:01,081: INFO/ForkPoolWorker-1] [00907766-c948-46ab-82f6-d0316490442b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:40:01.087374640Z [2024-05-10 22:40:01,083: INFO/ForkPoolWorker-2] [69a39852-ed95-4c0d-b42e-2b8bfe41828b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:40:01.087378773Z [2024-05-10 22:40:01,084: INFO/ForkPoolWorker-16] [4f9d6d4d-2a5e-432b-ad25-a0f86ba726c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:01.104488436Z [2024-05-10 22:40:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9b7f256-5748-434a-993c-a0d686d9b5db] received 2024-05-10T22:40:01.152751070Z [2024-05-10 22:40:01,152: INFO/ForkPoolWorker-3] [b9b7f256-5748-434a-993c-a0d686d9b5db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:40:01.499405989Z [2024-05-10 22:40:01,495: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:40:01.554011798Z [2024-05-10 22:40:01,543: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:40:01.617179398Z [2024-05-10 22:40:01,613: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:40:01.667917061Z [2024-05-10 22:40:01,663: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:40:01.705441620Z [2024-05-10 22:40:01,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:40:01.905212657Z [2024-05-10 22:40:01,904: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T22:40:01.908938063Z [2024-05-10 22:40:01,908: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:01.942348279Z [2024-05-10 22:40:01,942: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:40:01.944306524Z [2024-05-10 22:40:01,944: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:40:01.944384877Z [2024-05-10 22:40:01,944: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:40:01.944472784Z [2024-05-10 22:40:01,944: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T22:40:01.944717938Z [2024-05-10 22:40:01,944: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:40:02.048938716Z [2024-05-10 22:40:02,048: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:02.088969179Z [2024-05-10 22:40:02,088: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:02.768617828Z [2024-05-10 22:40:02,768: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b9b7f256-5748-434a-993c-a0d686d9b5db] succeeded in 1.6393210219998764s: None 2024-05-10T22:40:02.793834972Z [2024-05-10 22:40:02,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00907766-c948-46ab-82f6-d0316490442b] succeeded in 1.7300137300001097s: None 2024-05-10T22:40:03.145354195Z [2024-05-10 22:40:03,144: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:40:03.148826979Z [2024-05-10 22:40:03,148: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:03.183758767Z [2024-05-10 22:40:03,183: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:40:03.185052798Z [2024-05-10 22:40:03,184: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:03.185128848Z [2024-05-10 22:40:03,185: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:03.185317510Z [2024-05-10 22:40:03,185: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:03.185379035Z [2024-05-10 22:40:03,185: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:40:03.185731694Z [2024-05-10 22:40:03,185: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:40:03.185832661Z [2024-05-10 22:40:03,185: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:03.307852396Z [2024-05-10 22:40:03,307: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:03.363738818Z [2024-05-10 22:40:03,363: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:40:03.367216163Z [2024-05-10 22:40:03,366: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:03.395020255Z [2024-05-10 22:40:03,394: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:40:03.396164747Z [2024-05-10 22:40:03,395: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:03.396175661Z [2024-05-10 22:40:03,396: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:03.396375584Z [2024-05-10 22:40:03,396: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:03.396430724Z [2024-05-10 22:40:03,396: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:40:03.396836755Z [2024-05-10 22:40:03,396: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:40:03.396848628Z [2024-05-10 22:40:03,396: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:03.413597604Z [2024-05-10 22:40:03,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:40:03.417794160Z [2024-05-10 22:40:03,417: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:03.442009762Z [2024-05-10 22:40:03,441: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:40:03.447344255Z [2024-05-10 22:40:03,447: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:03.447361973Z [2024-05-10 22:40:03,447: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:03.447674963Z [2024-05-10 22:40:03,447: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:03.447811761Z [2024-05-10 22:40:03,447: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:40:03.448283544Z [2024-05-10 22:40:03,448: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:40:03.448403127Z [2024-05-10 22:40:03,448: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:03.555031240Z [2024-05-10 22:40:03,553: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:03.609713517Z [2024-05-10 22:40:03,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:04.081950931Z [2024-05-10 22:40:04,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f9d6d4d-2a5e-432b-ad25-a0f86ba726c5] succeeded in 3.018377333999979s: None 2024-05-10T22:40:05.025639051Z [2024-05-10 22:40:05,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71604965-2e90-4872-afcf-dc47853351da] received 2024-05-10T22:40:05.035444296Z [2024-05-10 22:40:05,035: INFO/ForkPoolWorker-16] [71604965-2e90-4872-afcf-dc47853351da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:05.173106799Z [2024-05-10 22:40:05,171: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69a39852-ed95-4c0d-b42e-2b8bfe41828b] succeeded in 4.102813702000049s: None 2024-05-10T22:40:05.352392565Z [2024-05-10 22:40:05,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:40:05.543645924Z [2024-05-10 22:40:05,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a939313d-00c3-4a2d-bf6b-564965894dab] succeeded in 4.482520187000091s: None 2024-05-10T22:40:06.523314169Z [2024-05-10 22:40:06,522: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:40:06.526466155Z [2024-05-10 22:40:06,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:06.548410970Z [2024-05-10 22:40:06,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:40:06.550314941Z [2024-05-10 22:40:06,550: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:06.550553962Z [2024-05-10 22:40:06,550: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:06.550795900Z [2024-05-10 22:40:06,550: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:06.551131045Z [2024-05-10 22:40:06,550: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:40:06.552038263Z [2024-05-10 22:40:06,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:40:06.552180649Z [2024-05-10 22:40:06,552: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:06.649622603Z [2024-05-10 22:40:06,649: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:07.293444340Z [2024-05-10 22:40:07,293: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71604965-2e90-4872-afcf-dc47853351da] succeeded in 2.2651843339999687s: None 2024-05-10T22:40:08.176906260Z [2024-05-10 22:40:08,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[887862c4-8e91-4102-841d-8eb987689e38] received 2024-05-10T22:40:08.187865389Z [2024-05-10 22:40:08,187: INFO/ForkPoolWorker-15] [887862c4-8e91-4102-841d-8eb987689e38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:40:08.482320750Z [2024-05-10 22:40:08,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:40:09.533182315Z [2024-05-10 22:40:09,532: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:40:09.536485176Z [2024-05-10 22:40:09,535: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:09.564416537Z [2024-05-10 22:40:09,564: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:40:09.565916642Z [2024-05-10 22:40:09,565: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:09.565935267Z [2024-05-10 22:40:09,565: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:09.566114527Z [2024-05-10 22:40:09,565: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:09.566125739Z [2024-05-10 22:40:09,565: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:40:09.566425480Z [2024-05-10 22:40:09,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:40:09.566437874Z [2024-05-10 22:40:09,566: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:09.676350269Z [2024-05-10 22:40:09,675: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:10.319916928Z [2024-05-10 22:40:10,319: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[887862c4-8e91-4102-841d-8eb987689e38] succeeded in 2.1393854369998735s: None 2024-05-10T22:40:10.942850051Z [2024-05-10 22:40:10,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70951df2-5a9a-4023-b4de-ceab664bb06b] received 2024-05-10T22:40:10.952274042Z [2024-05-10 22:40:10,952: INFO/ForkPoolWorker-15] [70951df2-5a9a-4023-b4de-ceab664bb06b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:40:11.285579510Z [2024-05-10 22:40:11,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:40:12.545494382Z [2024-05-10 22:40:12,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:40:12.549079030Z [2024-05-10 22:40:12,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:40:12.575991276Z [2024-05-10 22:40:12,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:40:12.578385018Z [2024-05-10 22:40:12,578: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:40:12.578459177Z [2024-05-10 22:40:12,578: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:40:12.578714222Z [2024-05-10 22:40:12,578: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:40:12.578765790Z [2024-05-10 22:40:12,578: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:40:12.579166624Z [2024-05-10 22:40:12,578: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:40:12.579258176Z [2024-05-10 22:40:12,579: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:40:12.667459447Z [2024-05-10 22:40:12,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:40:13.391970765Z [2024-05-10 22:40:13,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70951df2-5a9a-4023-b4de-ceab664bb06b] succeeded in 2.4457649680000486s: None 2024-05-10T22:41:00.389476288Z [2024-05-10 22:41:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67136972-86aa-4a19-9e8c-eebceb327fc4] received 2024-05-10T22:41:00.394347399Z [2024-05-10 22:41:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[092c0b3f-e8b8-4bed-9d0f-71742e6af93f] received 2024-05-10T22:41:00.406192732Z [2024-05-10 22:41:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2adcb37-7765-4ae8-981c-661fb85a40a9] received 2024-05-10T22:41:00.407306099Z [2024-05-10 22:41:00,407: INFO/ForkPoolWorker-16] [092c0b3f-e8b8-4bed-9d0f-71742e6af93f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:41:00.416186483Z [2024-05-10 22:41:00,415: INFO/ForkPoolWorker-15] [67136972-86aa-4a19-9e8c-eebceb327fc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:41:00.422492373Z [2024-05-10 22:41:00,422: INFO/ForkPoolWorker-1] [a2adcb37-7765-4ae8-981c-661fb85a40a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:41:00.773730941Z [2024-05-10 22:41:00,768: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:41:00.855890398Z [2024-05-10 22:41:00,852: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:41:01.044252435Z [2024-05-10 22:41:01,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:41:01.335117392Z [2024-05-10 22:41:01,334: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T22:41:01.339381524Z [2024-05-10 22:41:01,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:41:01.380654113Z [2024-05-10 22:41:01,380: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:41:01.389620702Z [2024-05-10 22:41:01,389: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:41:01.389657503Z [2024-05-10 22:41:01,389: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:41:01.389662472Z [2024-05-10 22:41:01,389: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T22:41:01.389903722Z [2024-05-10 22:41:01,389: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:41:01.523982146Z [2024-05-10 22:41:01,523: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:41:02.391094864Z [2024-05-10 22:41:02,390: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67136972-86aa-4a19-9e8c-eebceb327fc4] succeeded in 1.9980779720001465s: None 2024-05-10T22:41:02.446791901Z [2024-05-10 22:41:02,446: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:41:02.450832911Z [2024-05-10 22:41:02,450: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:41:02.487988107Z [2024-05-10 22:41:02,487: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:41:02.489334373Z [2024-05-10 22:41:02,489: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:41:02.489348633Z [2024-05-10 22:41:02,489: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:41:02.489751079Z [2024-05-10 22:41:02,489: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:41:02.489837719Z [2024-05-10 22:41:02,489: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:41:02.490186070Z [2024-05-10 22:41:02,490: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:41:02.490217185Z [2024-05-10 22:41:02,490: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:41:02.538007593Z [2024-05-10 22:41:02,537: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:41:02.541612349Z [2024-05-10 22:41:02,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:41:02.574818567Z [2024-05-10 22:41:02,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:41:02.580239116Z [2024-05-10 22:41:02,579: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:41:02.580256490Z [2024-05-10 22:41:02,580: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:41:02.581557704Z [2024-05-10 22:41:02,580: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:41:02.581679644Z [2024-05-10 22:41:02,581: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:41:02.582186903Z [2024-05-10 22:41:02,581: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:41:02.582208969Z [2024-05-10 22:41:02,582: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:41:02.693691315Z [2024-05-10 22:41:02,693: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:41:02.763949573Z [2024-05-10 22:41:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:41:04.822922539Z [2024-05-10 22:41:04,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2adcb37-7765-4ae8-981c-661fb85a40a9] succeeded in 4.407248528000082s: None 2024-05-10T22:41:05.297096965Z [2024-05-10 22:41:05,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[092c0b3f-e8b8-4bed-9d0f-71742e6af93f] succeeded in 4.89965559999996s: None 2024-05-10T22:42:01.013285939Z [2024-05-10 22:42:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[177ee768-8973-4655-8fd9-dd81a933510c] received 2024-05-10T22:42:01.021922648Z [2024-05-10 22:42:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d831a1d-b338-4992-962e-2e86d5fd8f1e] received 2024-05-10T22:42:01.025970463Z [2024-05-10 22:42:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb577bd2-10e0-478e-aedd-2972467bd091] received 2024-05-10T22:42:01.066257916Z [2024-05-10 22:42:01,058: INFO/ForkPoolWorker-1] [cb577bd2-10e0-478e-aedd-2972467bd091] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:42:01.112395716Z [2024-05-10 22:42:01,099: INFO/ForkPoolWorker-15] [177ee768-8973-4655-8fd9-dd81a933510c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:42:01.112421095Z [2024-05-10 22:42:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f46f76b0-8f9e-4a0c-b815-604451fcf2ec] received 2024-05-10T22:42:01.112427866Z [2024-05-10 22:42:01,108: INFO/ForkPoolWorker-16] [1d831a1d-b338-4992-962e-2e86d5fd8f1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:42:01.130206877Z [2024-05-10 22:42:01,127: INFO/ForkPoolWorker-2] [f46f76b0-8f9e-4a0c-b815-604451fcf2ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:42:01.660943031Z [2024-05-10 22:42:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:42:01.998437802Z [2024-05-10 22:42:01,992: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:42:02.010029509Z [2024-05-10 22:42:02,003: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:42:02.193328729Z [2024-05-10 22:42:02,185: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:42:02.463500435Z [2024-05-10 22:42:02,462: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:42:02.475458054Z [2024-05-10 22:42:02,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:42:02.560271241Z [2024-05-10 22:42:02,560: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:42:02.567268632Z [2024-05-10 22:42:02,567: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:42:02.568299797Z [2024-05-10 22:42:02,568: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:42:02.568404581Z [2024-05-10 22:42:02,568: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:42:02.568638059Z [2024-05-10 22:42:02,568: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:42:02.684257256Z [2024-05-10 22:42:02,683: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:42:02.747284575Z [2024-05-10 22:42:02,747: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:42:03.589854708Z [2024-05-10 22:42:03,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[177ee768-8973-4655-8fd9-dd81a933510c] succeeded in 2.56199742900003s: None 2024-05-10T22:42:03.759582057Z [2024-05-10 22:42:03,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb577bd2-10e0-478e-aedd-2972467bd091] succeeded in 2.7346851539998625s: None 2024-05-10T22:42:04.011561122Z [2024-05-10 22:42:04,009: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:42:04.015890749Z [2024-05-10 22:42:04,015: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:42:04.024577966Z [2024-05-10 22:42:04,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:42:04.026461635Z [2024-05-10 22:42:04,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:42:04.046250803Z [2024-05-10 22:42:04,045: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:42:04.049670701Z [2024-05-10 22:42:04,048: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:42:04.049702416Z [2024-05-10 22:42:04,049: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:42:04.049713878Z [2024-05-10 22:42:04,049: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:42:04.049723893Z [2024-05-10 22:42:04,049: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:42:04.050354537Z [2024-05-10 22:42:04,049: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:42:04.050379568Z [2024-05-10 22:42:04,049: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:42:04.070403425Z [2024-05-10 22:42:04,066: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:42:04.070429198Z [2024-05-10 22:42:04,069: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:42:04.070435774Z [2024-05-10 22:42:04,069: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:42:04.070457971Z [2024-05-10 22:42:04,069: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:42:04.070464941Z [2024-05-10 22:42:04,069: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:42:04.070470302Z [2024-05-10 22:42:04,069: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:42:04.070648047Z [2024-05-10 22:42:04,070: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:42:04.234651136Z [2024-05-10 22:42:04,234: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:42:04.243482470Z [2024-05-10 22:42:04,243: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:42:06.421751981Z [2024-05-10 22:42:06,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d831a1d-b338-4992-962e-2e86d5fd8f1e] succeeded in 5.39862220100008s: None 2024-05-10T22:42:06.678177108Z [2024-05-10 22:42:06,677: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f46f76b0-8f9e-4a0c-b815-604451fcf2ec] succeeded in 5.570953518999886s: None 2024-05-10T22:43:01.129088102Z [2024-05-10 22:43:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f552fcb-4ca3-4f3c-ae89-da7a75db4c2e] received 2024-05-10T22:43:01.137672472Z [2024-05-10 22:43:01,137: INFO/ForkPoolWorker-15] [4f552fcb-4ca3-4f3c-ae89-da7a75db4c2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:43:01.145363148Z [2024-05-10 22:43:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f72da8-44fb-486e-b42d-4f26a6134a4c] received 2024-05-10T22:43:01.154930778Z [2024-05-10 22:43:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edfad9b9-848f-47de-9bca-aa4125e60d0a] received 2024-05-10T22:43:01.161543009Z [2024-05-10 22:43:01,161: INFO/ForkPoolWorker-1] [edfad9b9-848f-47de-9bca-aa4125e60d0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:43:01.172939604Z [2024-05-10 22:43:01,172: INFO/ForkPoolWorker-16] [c3f72da8-44fb-486e-b42d-4f26a6134a4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:43:01.449522903Z [2024-05-10 22:43:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:43:01.476899792Z [2024-05-10 22:43:01,468: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:43:01.478039477Z [2024-05-10 22:43:01,474: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:43:01.639267415Z [2024-05-10 22:43:01,638: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:43:01.643272157Z [2024-05-10 22:43:01,642: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:43:01.670765284Z [2024-05-10 22:43:01,670: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:43:01.674802791Z [2024-05-10 22:43:01,674: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:43:01.674974652Z [2024-05-10 22:43:01,674: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:43:01.675071997Z [2024-05-10 22:43:01,674: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:43:01.675297116Z [2024-05-10 22:43:01,675: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:43:01.771838625Z [2024-05-10 22:43:01,771: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:43:02.457990086Z [2024-05-10 22:43:02,457: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3f72da8-44fb-486e-b42d-4f26a6134a4c] succeeded in 1.2908526160001657s: None 2024-05-10T22:43:02.716081220Z [2024-05-10 22:43:02,715: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:43:02.719677645Z [2024-05-10 22:43:02,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:43:02.747692978Z [2024-05-10 22:43:02,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:43:02.749554329Z [2024-05-10 22:43:02,749: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:43:02.749767991Z [2024-05-10 22:43:02,749: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:43:02.750252165Z [2024-05-10 22:43:02,749: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:43:02.750441612Z [2024-05-10 22:43:02,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:43:02.750880069Z [2024-05-10 22:43:02,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:43:02.751168263Z [2024-05-10 22:43:02,750: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:43:02.759995856Z [2024-05-10 22:43:02,759: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:43:02.763974829Z [2024-05-10 22:43:02,763: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:43:02.792827695Z [2024-05-10 22:43:02,792: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:43:02.794282774Z [2024-05-10 22:43:02,793: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:43:02.794309250Z [2024-05-10 22:43:02,794: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:43:02.794364322Z [2024-05-10 22:43:02,794: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:43:02.794438600Z [2024-05-10 22:43:02,794: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:43:02.797337630Z [2024-05-10 22:43:02,797: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:43:02.797396647Z [2024-05-10 22:43:02,797: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:43:02.878957870Z [2024-05-10 22:43:02,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:43:02.884015838Z [2024-05-10 22:43:02,883: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:43:05.195378288Z [2024-05-10 22:43:05,193: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edfad9b9-848f-47de-9bca-aa4125e60d0a] succeeded in 4.036632787000144s: None 2024-05-10T22:43:05.325005358Z [2024-05-10 22:43:05,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f552fcb-4ca3-4f3c-ae89-da7a75db4c2e] succeeded in 4.193904312000086s: None 2024-05-10T22:44:01.014789362Z [2024-05-10 22:44:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0872351f-5c4f-4dad-9cba-eef7f8627003] received 2024-05-10T22:44:01.020285148Z [2024-05-10 22:44:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d168851-970d-41b0-a18f-afd3d7e1e99a] received 2024-05-10T22:44:01.025476919Z [2024-05-10 22:44:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c1c7e2d-2ce3-4b7e-8b9b-943cd44f7808] received 2024-05-10T22:44:01.025561499Z [2024-05-10 22:44:01,025: INFO/ForkPoolWorker-15] [0872351f-5c4f-4dad-9cba-eef7f8627003] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:44:01.031534119Z [2024-05-10 22:44:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79a48e03-d7ff-461d-95ae-eade8f64217c] received 2024-05-10T22:44:01.041842958Z [2024-05-10 22:44:01,041: INFO/ForkPoolWorker-16] [7d168851-970d-41b0-a18f-afd3d7e1e99a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:44:01.048519455Z [2024-05-10 22:44:01,044: INFO/ForkPoolWorker-2] [79a48e03-d7ff-461d-95ae-eade8f64217c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:44:01.061285266Z [2024-05-10 22:44:01,056: INFO/ForkPoolWorker-1] [3c1c7e2d-2ce3-4b7e-8b9b-943cd44f7808] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:44:01.444007919Z [2024-05-10 22:44:01,440: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:44:01.474397436Z [2024-05-10 22:44:01,468: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:44:01.487979765Z [2024-05-10 22:44:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:44:01.516884336Z [2024-05-10 22:44:01,508: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:44:01.606358480Z [2024-05-10 22:44:01,605: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T22:44:01.611165712Z [2024-05-10 22:44:01,610: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:44:01.644368973Z [2024-05-10 22:44:01,644: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:44:01.646211153Z [2024-05-10 22:44:01,645: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:44:01.646587730Z [2024-05-10 22:44:01,646: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:44:01.646813002Z [2024-05-10 22:44:01,646: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T22:44:01.647822867Z [2024-05-10 22:44:01,647: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:44:01.771167151Z [2024-05-10 22:44:01,770: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:44:01.829827453Z [2024-05-10 22:44:01,829: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:44:02.400459196Z [2024-05-10 22:44:02,399: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d168851-970d-41b0-a18f-afd3d7e1e99a] succeeded in 1.3778555090000282s: None 2024-05-10T22:44:02.413907507Z [2024-05-10 22:44:02,413: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[79a48e03-d7ff-461d-95ae-eade8f64217c] succeeded in 1.3801966670000638s: None 2024-05-10T22:44:02.819205425Z [2024-05-10 22:44:02,818: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:44:02.822786976Z [2024-05-10 22:44:02,822: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:44:02.845080153Z [2024-05-10 22:44:02,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:44:02.846598937Z [2024-05-10 22:44:02,846: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:44:02.846646341Z [2024-05-10 22:44:02,846: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:44:02.846792651Z [2024-05-10 22:44:02,846: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:44:02.846848613Z [2024-05-10 22:44:02,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:44:02.847183280Z [2024-05-10 22:44:02,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:44:02.847206542Z [2024-05-10 22:44:02,847: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:44:02.892972785Z [2024-05-10 22:44:02,892: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:44:02.896677095Z [2024-05-10 22:44:02,896: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:44:02.918872944Z [2024-05-10 22:44:02,918: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:44:02.920862469Z [2024-05-10 22:44:02,920: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:44:02.921143647Z [2024-05-10 22:44:02,920: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:44:02.921510575Z [2024-05-10 22:44:02,921: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:44:02.921592116Z [2024-05-10 22:44:02,921: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:44:02.922025848Z [2024-05-10 22:44:02,921: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:44:02.922100530Z [2024-05-10 22:44:02,921: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:44:02.940451252Z [2024-05-10 22:44:02,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:44:03.004790343Z [2024-05-10 22:44:03,004: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:44:04.703555149Z [2024-05-10 22:44:04,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0872351f-5c4f-4dad-9cba-eef7f8627003] succeeded in 3.6866835650000667s: None 2024-05-10T22:44:05.202072322Z [2024-05-10 22:44:05,199: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c1c7e2d-2ce3-4b7e-8b9b-943cd44f7808] succeeded in 4.168440609000072s: None 2024-05-10T22:45:00.821333124Z [2024-05-10 22:45:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcadf9e5-1d86-437c-9518-af161a58e577] received 2024-05-10T22:45:00.823256412Z [2024-05-10 22:45:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1755d39e-83ab-414c-b7bc-62cd5dec977b] received 2024-05-10T22:45:00.828691615Z [2024-05-10 22:45:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74578d07-369d-4b3c-bc43-f16c6cbb48ed] received 2024-05-10T22:45:00.834359246Z [2024-05-10 22:45:00,834: INFO/ForkPoolWorker-16] [1755d39e-83ab-414c-b7bc-62cd5dec977b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:45:00.834924912Z [2024-05-10 22:45:00,834: INFO/ForkPoolWorker-15] [fcadf9e5-1d86-437c-9518-af161a58e577] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:00.837652226Z [2024-05-10 22:45:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cae41eb9-5921-4001-afda-4f60330a73cd] received 2024-05-10T22:45:00.837686928Z [2024-05-10 22:45:00,837: INFO/ForkPoolWorker-1] [74578d07-369d-4b3c-bc43-f16c6cbb48ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:45:00.849377792Z [2024-05-10 22:45:00,848: INFO/ForkPoolWorker-2] [cae41eb9-5921-4001-afda-4f60330a73cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:45:01.245849593Z [2024-05-10 22:45:01,242: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:45:01.321055717Z [2024-05-10 22:45:01,317: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:45:01.364395513Z [2024-05-10 22:45:01,359: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:45:01.382614158Z [2024-05-10 22:45:01,378: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:01.597558138Z [2024-05-10 22:45:01,597: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:45:01.603126487Z [2024-05-10 22:45:01,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:01.650342293Z [2024-05-10 22:45:01,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:45:01.657985736Z [2024-05-10 22:45:01,657: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:45:01.658279671Z [2024-05-10 22:45:01,657: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:45:01.658412002Z [2024-05-10 22:45:01,658: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:45:01.658741608Z [2024-05-10 22:45:01,658: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:45:01.742885522Z [2024-05-10 22:45:01,742: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:02.365074873Z [2024-05-10 22:45:02,364: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[74578d07-369d-4b3c-bc43-f16c6cbb48ed] succeeded in 1.535023117000037s: None 2024-05-10T22:45:02.562253357Z [2024-05-10 22:45:02,561: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:45:02.567325062Z [2024-05-10 22:45:02,566: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:02.585078513Z [2024-05-10 22:45:02,584: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:45:02.588467032Z [2024-05-10 22:45:02,587: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:02.608679323Z [2024-05-10 22:45:02,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:45:02.610294503Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:02.610360293Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:02.610560981Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:45:02.610669657Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:45:02.610984286Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:45:02.611044126Z [2024-05-10 22:45:02,610: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:02.612699877Z [2024-05-10 22:45:02,612: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:45:02.621085616Z [2024-05-10 22:45:02,620: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:02.621119197Z [2024-05-10 22:45:02,621: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:02.623084354Z [2024-05-10 22:45:02,621: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:45:02.623614229Z [2024-05-10 22:45:02,623: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:45:02.623621630Z [2024-05-10 22:45:02,623: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:45:02.623624795Z [2024-05-10 22:45:02,623: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:02.686226050Z [2024-05-10 22:45:02,685: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:02.713716015Z [2024-05-10 22:45:02,713: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:02.795814363Z [2024-05-10 22:45:02,795: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:02.799989733Z [2024-05-10 22:45:02,799: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:02.817741032Z [2024-05-10 22:45:02,817: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:02.820926362Z [2024-05-10 22:45:02,820: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:02.821094290Z [2024-05-10 22:45:02,820: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:02.821253968Z [2024-05-10 22:45:02,821: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:45:02.821375391Z [2024-05-10 22:45:02,821: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:02.821726314Z [2024-05-10 22:45:02,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:02.821855513Z [2024-05-10 22:45:02,821: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:02.918249788Z [2024-05-10 22:45:02,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:03.589426756Z [2024-05-10 22:45:03,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcadf9e5-1d86-437c-9518-af161a58e577] succeeded in 2.765356888000042s: None 2024-05-10T22:45:04.246118187Z [2024-05-10 22:45:04,245: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1755d39e-83ab-414c-b7bc-62cd5dec977b] succeeded in 3.4198103960000026s: None 2024-05-10T22:45:04.331347296Z [2024-05-10 22:45:04,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e02ca4d-42ec-4c2a-ac5c-225f64c82d0d] received 2024-05-10T22:45:04.342804593Z [2024-05-10 22:45:04,342: INFO/ForkPoolWorker-15] [7e02ca4d-42ec-4c2a-ac5c-225f64c82d0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:04.556433948Z [2024-05-10 22:45:04,556: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cae41eb9-5921-4001-afda-4f60330a73cd] succeeded in 3.716471925000178s: None 2024-05-10T22:45:04.647846611Z [2024-05-10 22:45:04,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:05.886443600Z [2024-05-10 22:45:05,886: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:05.889746269Z [2024-05-10 22:45:05,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:05.913579571Z [2024-05-10 22:45:05,913: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:05.914835687Z [2024-05-10 22:45:05,914: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:05.914852568Z [2024-05-10 22:45:05,914: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:05.914980906Z [2024-05-10 22:45:05,914: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:45:05.915009325Z [2024-05-10 22:45:05,914: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:05.915233998Z [2024-05-10 22:45:05,915: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:05.915238569Z [2024-05-10 22:45:05,915: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:06.014917746Z [2024-05-10 22:45:06,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:06.644205012Z [2024-05-10 22:45:06,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e02ca4d-42ec-4c2a-ac5c-225f64c82d0d] succeeded in 2.3104359999999815s: None 2024-05-10T22:45:06.909684079Z [2024-05-10 22:45:06,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92a1cbe2-09a6-461c-875f-a95094ff3300] received 2024-05-10T22:45:06.919844666Z [2024-05-10 22:45:06,919: INFO/ForkPoolWorker-15] [92a1cbe2-09a6-461c-875f-a95094ff3300] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:45:07.187705637Z [2024-05-10 22:45:07,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:08.493003637Z [2024-05-10 22:45:08,492: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:08.496668574Z [2024-05-10 22:45:08,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:08.524523485Z [2024-05-10 22:45:08,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:08.526503848Z [2024-05-10 22:45:08,526: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:08.526541687Z [2024-05-10 22:45:08,526: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:08.526642774Z [2024-05-10 22:45:08,526: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:08.526796129Z [2024-05-10 22:45:08,526: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:08.526845828Z [2024-05-10 22:45:08,526: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:08.527240606Z [2024-05-10 22:45:08,527: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:08.527302420Z [2024-05-10 22:45:08,527: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:08.535266770Z [2024-05-10 22:45:08,535: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:08.618748352Z [2024-05-10 22:45:08,618: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:09.265173416Z [2024-05-10 22:45:09,264: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92a1cbe2-09a6-461c-875f-a95094ff3300] succeeded in 2.353217223999991s: None 2024-05-10T22:45:09.585397739Z [2024-05-10 22:45:09,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87eb4536-0a46-4a65-9fc1-062102b87c20] received 2024-05-10T22:45:09.593344512Z [2024-05-10 22:45:09,592: INFO/ForkPoolWorker-15] [87eb4536-0a46-4a65-9fc1-062102b87c20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:09.920210040Z [2024-05-10 22:45:09,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:11.285193026Z [2024-05-10 22:45:11,284: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:11.288743072Z [2024-05-10 22:45:11,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:11.314472921Z [2024-05-10 22:45:11,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:11.316106468Z [2024-05-10 22:45:11,315: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:11.316210908Z [2024-05-10 22:45:11,315: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:11.316283727Z [2024-05-10 22:45:11,316: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:11.316574441Z [2024-05-10 22:45:11,316: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:11.316697467Z [2024-05-10 22:45:11,316: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:11.317336572Z [2024-05-10 22:45:11,316: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:11.317401361Z [2024-05-10 22:45:11,317: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:11.325531852Z [2024-05-10 22:45:11,325: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:11.421120236Z [2024-05-10 22:45:11,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:12.051503952Z [2024-05-10 22:45:12,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87eb4536-0a46-4a65-9fc1-062102b87c20] succeeded in 2.463061578999941s: None 2024-05-10T22:45:21.156891084Z [2024-05-10 22:45:21,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a605b3d-7ef5-4af3-a7cb-9d6628345645] received 2024-05-10T22:45:21.175550033Z [2024-05-10 22:45:21,175: INFO/ForkPoolWorker-15] [1a605b3d-7ef5-4af3-a7cb-9d6628345645] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:45:21.178429695Z [2024-05-10 22:45:21,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6483913-83ba-46fe-8113-aadb389c90e5] received 2024-05-10T22:45:21.200998004Z [2024-05-10 22:45:21,200: INFO/ForkPoolWorker-16] [e6483913-83ba-46fe-8113-aadb389c90e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:45:21.466787956Z [2024-05-10 22:45:21,463: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:45:21.505756657Z [2024-05-10 22:45:21,502: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:45:22.601932090Z [2024-05-10 22:45:22,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:45:22.605146135Z [2024-05-10 22:45:22,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:22.630548438Z [2024-05-10 22:45:22,630: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:45:22.632004362Z [2024-05-10 22:45:22,631: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:22.632028686Z [2024-05-10 22:45:22,631: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:22.632158302Z [2024-05-10 22:45:22,632: INFO/ForkPoolWorker-16] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:22.632286737Z [2024-05-10 22:45:22,632: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:22.632388110Z [2024-05-10 22:45:22,632: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:45:22.632647700Z [2024-05-10 22:45:22,632: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:45:22.632740612Z [2024-05-10 22:45:22,632: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:22.638057588Z [2024-05-10 22:45:22,637: INFO/ForkPoolWorker-16] Creating DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:22.676021407Z [2024-05-10 22:45:22,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:22.679429522Z [2024-05-10 22:45:22,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:22.699447845Z [2024-05-10 22:45:22,699: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:22.700927686Z [2024-05-10 22:45:22,700: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:22.701079129Z [2024-05-10 22:45:22,700: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:22.701223376Z [2024-05-10 22:45:22,701: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:22.701426212Z [2024-05-10 22:45:22,701: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:22.701488198Z [2024-05-10 22:45:22,701: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:22.701774444Z [2024-05-10 22:45:22,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:45:22.701943431Z [2024-05-10 22:45:22,701: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:22.708629487Z [2024-05-10 22:45:22,708: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:22.722333822Z [2024-05-10 22:45:22,722: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:22.782081657Z [2024-05-10 22:45:22,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:23.400668853Z [2024-05-10 22:45:23,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[677c951c-5be7-41f8-b831-edb4011ff143] received 2024-05-10T22:45:23.410280396Z [2024-05-10 22:45:23,410: INFO/ForkPoolWorker-1] [677c951c-5be7-41f8-b831-edb4011ff143] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:23.680535695Z [2024-05-10 22:45:23,677: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:24.155554168Z [2024-05-10 22:45:24,155: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6483913-83ba-46fe-8113-aadb389c90e5] succeeded in 2.975713098999904s: None 2024-05-10T22:45:24.509845792Z [2024-05-10 22:45:24,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a605b3d-7ef5-4af3-a7cb-9d6628345645] succeeded in 3.348677756999905s: None 2024-05-10T22:45:24.743601706Z [2024-05-10 22:45:24,743: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:45:24.746571361Z [2024-05-10 22:45:24,746: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:24.767044947Z [2024-05-10 22:45:24,766: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:45:24.768546849Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:24.768568299Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:24.768576844Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:24.768680100Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:24.768689899Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:45:24.769100417Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:24.769123285Z [2024-05-10 22:45:24,768: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:24.775473210Z [2024-05-10 22:45:24,775: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:24.839767557Z [2024-05-10 22:45:24,839: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:25.415277044Z [2024-05-10 22:45:25,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[677c951c-5be7-41f8-b831-edb4011ff143] succeeded in 2.0126758459998655s: None 2024-05-10T22:45:26.102552637Z [2024-05-10 22:45:26,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4ae2f72-d6df-44b8-ac5f-df37acb202e8] received 2024-05-10T22:45:26.113459556Z [2024-05-10 22:45:26,113: INFO/ForkPoolWorker-15] [a4ae2f72-d6df-44b8-ac5f-df37acb202e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'split_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:26.415307984Z [2024-05-10 22:45:26,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:27.558071462Z [2024-05-10 22:45:27,557: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:27.561148876Z [2024-05-10 22:45:27,560: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:27.584950360Z [2024-05-10 22:45:27,584: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:27.586446031Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:27.586565547Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:27.586750056Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:27.586808222Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:27.586819630Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:27.587159239Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:27.587203754Z [2024-05-10 22:45:27,586: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:27.595129689Z [2024-05-10 22:45:27,594: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:27.669702542Z [2024-05-10 22:45:27,669: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:28.236977289Z [2024-05-10 22:45:28,236: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4ae2f72-d6df-44b8-ac5f-df37acb202e8] succeeded in 2.131047770999885s: None 2024-05-10T22:45:28.398587624Z [2024-05-10 22:45:28,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae5aa38c-9501-480d-ade1-6c77f8d92e3d] received 2024-05-10T22:45:28.414122255Z [2024-05-10 22:45:28,413: INFO/ForkPoolWorker-15] [ae5aa38c-9501-480d-ade1-6c77f8d92e3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'collect_metrics', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:45:28.723425711Z [2024-05-10 22:45:28,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:29.799632522Z [2024-05-10 22:45:29,799: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:29.803246517Z [2024-05-10 22:45:29,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:29.844646125Z [2024-05-10 22:45:29,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:29.846910437Z [2024-05-10 22:45:29,846: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:29.846996327Z [2024-05-10 22:45:29,846: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:29.847360754Z [2024-05-10 22:45:29,847: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:29.847550595Z [2024-05-10 22:45:29,847: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:29.847779017Z [2024-05-10 22:45:29,847: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:29.848524414Z [2024-05-10 22:45:29,848: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:29.848823585Z [2024-05-10 22:45:29,848: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:29.861984854Z [2024-05-10 22:45:29,861: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:29.948510692Z [2024-05-10 22:45:29,947: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:30.476744930Z [2024-05-10 22:45:30,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae5aa38c-9501-480d-ade1-6c77f8d92e3d] succeeded in 2.073142856000004s: None 2024-05-10T22:45:31.193585371Z [2024-05-10 22:45:31,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8c2af6-e3df-49e1-8ebb-92459d142039] received 2024-05-10T22:45:31.213987417Z [2024-05-10 22:45:31,213: INFO/ForkPoolWorker-15] [bd8c2af6-e3df-49e1-8ebb-92459d142039] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'send_prometheus', 'scheduled__2024-05-10T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:45:31.500513990Z [2024-05-10 22:45:31,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:45:32.554036475Z [2024-05-10 22:45:32,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:45:32.557388475Z [2024-05-10 22:45:32,556: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:45:32.575547783Z [2024-05-10 22:45:32,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:45:32.576959288Z [2024-05-10 22:45:32,576: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:45:32.576971886Z [2024-05-10 22:45:32,576: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:45:32.576975411Z [2024-05-10 22:45:32,576: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:45:32.577283798Z [2024-05-10 22:45:32,577: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:45:32.577311783Z [2024-05-10 22:45:32,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:45:32.577525618Z [2024-05-10 22:45:32,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:45:32.577536722Z [2024-05-10 22:45:32,577: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:45:32.583405243Z [2024-05-10 22:45:32,583: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:45:32.654605450Z [2024-05-10 22:45:32,654: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:45:33.185522966Z [2024-05-10 22:45:33,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd8c2af6-e3df-49e1-8ebb-92459d142039] succeeded in 1.9846099670000967s: None 2024-05-10T22:46:00.788430010Z [2024-05-10 22:46:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b595133-45b8-4f64-ad79-cbfd663face7] received 2024-05-10T22:46:00.796179614Z [2024-05-10 22:46:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0fa39b0-d8b1-48be-b21d-67af5c394ce4] received 2024-05-10T22:46:00.798409878Z [2024-05-10 22:46:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b60a4b-7623-4969-806f-f8cadc23b6af] received 2024-05-10T22:46:00.805749748Z [2024-05-10 22:46:00,805: INFO/ForkPoolWorker-15] [9b595133-45b8-4f64-ad79-cbfd663face7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:46:00.814475236Z [2024-05-10 22:46:00,814: INFO/ForkPoolWorker-1] [e2b60a4b-7623-4969-806f-f8cadc23b6af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:46:00.818842971Z [2024-05-10 22:46:00,818: INFO/ForkPoolWorker-16] [b0fa39b0-d8b1-48be-b21d-67af5c394ce4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:46:00.823084267Z [2024-05-10 22:46:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c689e6e6-2592-49a4-8061-7be3eb7ac2ed] received 2024-05-10T22:46:00.830989103Z [2024-05-10 22:46:00,830: INFO/ForkPoolWorker-2] [c689e6e6-2592-49a4-8061-7be3eb7ac2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:46:00.837228772Z [2024-05-10 22:46:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[152fd0b0-2237-4a92-94c6-3eaa51eba7f9] received 2024-05-10T22:46:00.839065245Z [2024-05-10 22:46:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0458ef89-284f-469b-9681-b272b832008f] received 2024-05-10T22:46:00.855526189Z [2024-05-10 22:46:00,855: INFO/ForkPoolWorker-4] [0458ef89-284f-469b-9681-b272b832008f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:46:00.856864981Z [2024-05-10 22:46:00,855: INFO/ForkPoolWorker-3] [152fd0b0-2237-4a92-94c6-3eaa51eba7f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:46:01.330736055Z [2024-05-10 22:46:01,326: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:46:01.443289335Z [2024-05-10 22:46:01,439: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:46:01.483295971Z [2024-05-10 22:46:01,479: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:46:01.546322325Z [2024-05-10 22:46:01,513: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:46:01.774648078Z [2024-05-10 22:46:01,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:46:01.855607915Z [2024-05-10 22:46:01,851: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:46:02.059942324Z [2024-05-10 22:46:02,059: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T22:46:02.078215434Z [2024-05-10 22:46:02,072: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:46:02.143054146Z [2024-05-10 22:46:02,142: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:46:02.150889583Z [2024-05-10 22:46:02,150: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:46:02.151117453Z [2024-05-10 22:46:02,150: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:46:02.151292182Z [2024-05-10 22:46:02,151: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T22:46:02.151576931Z [2024-05-10 22:46:02,151: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:46:02.156498969Z [2024-05-10 22:46:02,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:02.310140538Z [2024-05-10 22:46:02,309: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:02.797507995Z [2024-05-10 22:46:02,797: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b595133-45b8-4f64-ad79-cbfd663face7] succeeded in 2.006489053999985s: None 2024-05-10T22:46:02.864954142Z [2024-05-10 22:46:02,864: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-10T22:46:02.868379064Z [2024-05-10 22:46:02,867: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:46:02.896997408Z [2024-05-10 22:46:02,896: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-10T22:46:02.903369054Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:46:02.903443433Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:46:02.903528705Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:46:02.903689757Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:46:02.903757404Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-10T22:46:02.904109785Z [2024-05-10 22:46:02,903: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:46:02.904566373Z [2024-05-10 22:46:02,904: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:46:02.908913368Z [2024-05-10 22:46:02,908: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:46:03.015652319Z [2024-05-10 22:46:03,015: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[152fd0b0-2237-4a92-94c6-3eaa51eba7f9] succeeded in 2.1759404849999555s: None 2024-05-10T22:46:03.034038688Z [2024-05-10 22:46:03,033: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:03.215176251Z [2024-05-10 22:46:03,214: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:46:03.220304753Z [2024-05-10 22:46:03,219: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:46:03.251181484Z [2024-05-10 22:46:03,250: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:46:03.252718142Z [2024-05-10 22:46:03,252: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:46:03.252889881Z [2024-05-10 22:46:03,252: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:46:03.253029817Z [2024-05-10 22:46:03,252: INFO/ForkPoolWorker-1] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:46:03.253280762Z [2024-05-10 22:46:03,253: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:46:03.253422623Z [2024-05-10 22:46:03,253: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:46:03.253853421Z [2024-05-10 22:46:03,253: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:46:03.254044516Z [2024-05-10 22:46:03,253: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:46:03.262902633Z [2024-05-10 22:46:03,262: INFO/ForkPoolWorker-1] Creating DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:46:03.270595268Z [2024-05-10 22:46:03,270: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:46:03.273970854Z [2024-05-10 22:46:03,273: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:46:03.310775233Z [2024-05-10 22:46:03,310: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:46:03.315456844Z [2024-05-10 22:46:03,315: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:46:03.315590515Z [2024-05-10 22:46:03,315: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:46:03.315762602Z [2024-05-10 22:46:03,315: INFO/ForkPoolWorker-2] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:46:03.316054127Z [2024-05-10 22:46:03,315: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:46:03.316178793Z [2024-05-10 22:46:03,316: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:46:03.316653727Z [2024-05-10 22:46:03,316: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:46:03.316895643Z [2024-05-10 22:46:03,316: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:46:03.323813401Z [2024-05-10 22:46:03,323: INFO/ForkPoolWorker-2] Creating DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:46:03.369394648Z [2024-05-10 22:46:03,369: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:03.422971410Z [2024-05-10 22:46:03,422: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:03.753832025Z [2024-05-10 22:46:03,753: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:46:03.757831460Z [2024-05-10 22:46:03,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:46:03.781274691Z [2024-05-10 22:46:03,781: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:46:03.782498059Z [2024-05-10 22:46:03,782: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:46:03.782614669Z [2024-05-10 22:46:03,782: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:46:03.782690429Z [2024-05-10 22:46:03,782: INFO/ForkPoolWorker-16] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:46:03.782852527Z [2024-05-10 22:46:03,782: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:46:03.782934118Z [2024-05-10 22:46:03,782: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:46:03.783227266Z [2024-05-10 22:46:03,783: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:46:03.783303071Z [2024-05-10 22:46:03,783: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:46:03.787516304Z [2024-05-10 22:46:03,787: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:46:03.880462973Z [2024-05-10 22:46:03,880: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:46:04.921322004Z [2024-05-10 22:46:04,920: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c689e6e6-2592-49a4-8061-7be3eb7ac2ed] succeeded in 4.09618296199983s: None 2024-05-10T22:46:05.128034424Z [2024-05-10 22:46:05,127: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2b60a4b-7623-4969-806f-f8cadc23b6af] succeeded in 4.324930583999958s: None 2024-05-10T22:46:05.177958958Z [2024-05-10 22:46:05,177: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[0458ef89-284f-469b-9681-b272b832008f] succeeded in 4.335968551000178s: None 2024-05-10T22:46:05.803689094Z [2024-05-10 22:46:05,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0fa39b0-d8b1-48be-b21d-67af5c394ce4] succeeded in 4.998796190999883s: None 2024-05-10T22:47:00.622560705Z [2024-05-10 22:47:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c259c297-7596-4019-a9c8-66a797b4afca] received 2024-05-10T22:47:00.624880838Z [2024-05-10 22:47:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c855af0a-3d5d-4178-b3ff-0d461bcc9bc4] received 2024-05-10T22:47:00.626969536Z [2024-05-10 22:47:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a469fe8-70ad-4abd-9cd1-5143a3bfc28d] received 2024-05-10T22:47:00.633156086Z [2024-05-10 22:47:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acfbadb5-034f-4111-a4ba-5a7517f55697] received 2024-05-10T22:47:00.634397435Z [2024-05-10 22:47:00,634: INFO/ForkPoolWorker-1] [5a469fe8-70ad-4abd-9cd1-5143a3bfc28d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:47:00.640874346Z [2024-05-10 22:47:00,640: INFO/ForkPoolWorker-15] [c259c297-7596-4019-a9c8-66a797b4afca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:47:00.641489824Z [2024-05-10 22:47:00,641: INFO/ForkPoolWorker-2] [acfbadb5-034f-4111-a4ba-5a7517f55697] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:47:00.642047114Z [2024-05-10 22:47:00,641: INFO/ForkPoolWorker-16] [c855af0a-3d5d-4178-b3ff-0d461bcc9bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:47:00.644087953Z [2024-05-10 22:47:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fd61151-4a68-40f4-a3c4-89dc6a94dea7] received 2024-05-10T22:47:00.651708696Z [2024-05-10 22:47:00,651: INFO/ForkPoolWorker-3] [5fd61151-4a68-40f4-a3c4-89dc6a94dea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:47:00.950937334Z [2024-05-10 22:47:00,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:47:01.066020542Z [2024-05-10 22:47:01,062: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:47:01.074005013Z [2024-05-10 22:47:01,068: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:47:01.242219367Z [2024-05-10 22:47:01,237: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:47:01.289502561Z [2024-05-10 22:47:01,289: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:47:01.293717803Z [2024-05-10 22:47:01,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:47:01.335587174Z [2024-05-10 22:47:01,335: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:47:01.340711239Z [2024-05-10 22:47:01,340: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:47:01.340846758Z [2024-05-10 22:47:01,340: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:47:01.340965456Z [2024-05-10 22:47:01,340: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:47:01.341219524Z [2024-05-10 22:47:01,341: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:47:01.397260543Z [2024-05-10 22:47:01,393: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:47:01.464219974Z [2024-05-10 22:47:01,463: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:47:02.255646297Z [2024-05-10 22:47:02,255: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a469fe8-70ad-4abd-9cd1-5143a3bfc28d] succeeded in 1.627348801000153s: None 2024-05-10T22:47:02.614242152Z [2024-05-10 22:47:02,613: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:47:02.617696811Z [2024-05-10 22:47:02,617: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:47:02.653032590Z [2024-05-10 22:47:02,652: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:47:02.659228442Z [2024-05-10 22:47:02,658: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:47:02.659330595Z [2024-05-10 22:47:02,659: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:47:02.659441727Z [2024-05-10 22:47:02,659: INFO/ForkPoolWorker-2] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:47:02.659591395Z [2024-05-10 22:47:02,659: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:47:02.659675963Z [2024-05-10 22:47:02,659: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:47:02.660073170Z [2024-05-10 22:47:02,659: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:47:02.660525285Z [2024-05-10 22:47:02,660: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:47:02.665166384Z [2024-05-10 22:47:02,664: INFO/ForkPoolWorker-2] Creating DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:47:02.706637285Z [2024-05-10 22:47:02,706: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-10T22:47:02.709819648Z [2024-05-10 22:47:02,709: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:47:02.742827556Z [2024-05-10 22:47:02,742: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:47:02.747005293Z [2024-05-10 22:47:02,746: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:47:02.747023394Z [2024-05-10 22:47:02,746: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:47:02.747073616Z [2024-05-10 22:47:02,746: INFO/ForkPoolWorker-3] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:47:02.747258548Z [2024-05-10 22:47:02,747: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:47:02.747275851Z [2024-05-10 22:47:02,747: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-10T22:47:02.747602656Z [2024-05-10 22:47:02,747: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:47:02.747643825Z [2024-05-10 22:47:02,747: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:47:02.753812426Z [2024-05-10 22:47:02,753: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:47:02.760363733Z [2024-05-10 22:47:02,760: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:47:02.834525689Z [2024-05-10 22:47:02,834: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:47:02.909281818Z [2024-05-10 22:47:02,908: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:47:02.916952799Z [2024-05-10 22:47:02,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:47:02.940192323Z [2024-05-10 22:47:02,939: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:47:02.941335617Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:47:02.941348354Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:47:02.941426354Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:47:02.941519795Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:47:02.941536485Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:47:02.941814446Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:47:02.941828377Z [2024-05-10 22:47:02,941: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:47:02.946081086Z [2024-05-10 22:47:02,945: INFO/ForkPoolWorker-16] Creating DAG vim_status_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:47:03.072868785Z [2024-05-10 22:47:03,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:47:03.113238612Z [2024-05-10 22:47:03,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:47:03.116973975Z [2024-05-10 22:47:03,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:47:03.147888091Z [2024-05-10 22:47:03,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:47:03.150526624Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:47:03.150555770Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:47:03.150643074Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] Read VIM 24871773-28b9-44b2-af75-63072e54f9fd (basic_08_vim_test) 2024-05-10T22:47:03.150767879Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '24871773-28b9-44b2-af75-63072e54f9fd', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-10T22:47:03.150796135Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:47:03.151055263Z [2024-05-10 22:47:03,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:47:03.151070125Z [2024-05-10 22:47:03,151: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:47:03.157479264Z [2024-05-10 22:47:03,157: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd 2024-05-10T22:47:03.272707750Z [2024-05-10 22:47:03,272: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:47:04.932954150Z [2024-05-10 22:47:04,932: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[acfbadb5-034f-4111-a4ba-5a7517f55697] succeeded in 4.29812656099989s: None 2024-05-10T22:47:04.983635821Z [2024-05-10 22:47:04,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c855af0a-3d5d-4178-b3ff-0d461bcc9bc4] succeeded in 4.351951285000041s: None 2024-05-10T22:47:05.253237863Z [2024-05-10 22:47:05,251: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5fd61151-4a68-40f4-a3c4-89dc6a94dea7] succeeded in 4.604811243000086s: None 2024-05-10T22:47:05.484012820Z [2024-05-10 22:47:05,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c259c297-7596-4019-a9c8-66a797b4afca] succeeded in 4.859148455999957s: None 2024-05-10T22:48:00.654000444Z [2024-05-10 22:48:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f895bd48-ab2d-46a1-b9c4-eaecb27dd618] received 2024-05-10T22:48:00.658503986Z [2024-05-10 22:48:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40698c99-1cc8-4265-bc6e-4169f4210455] received 2024-05-10T22:48:00.669565390Z [2024-05-10 22:48:00,669: INFO/ForkPoolWorker-15] [f895bd48-ab2d-46a1-b9c4-eaecb27dd618] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:48:00.674786536Z [2024-05-10 22:48:00,674: INFO/ForkPoolWorker-16] [40698c99-1cc8-4265-bc6e-4169f4210455] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:00.678696462Z [2024-05-10 22:48:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12] received 2024-05-10T22:48:00.687049244Z [2024-05-10 22:48:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c41f6d48-e916-4af8-94e9-98ff5db7a4dd] received 2024-05-10T22:48:00.691569842Z [2024-05-10 22:48:00,691: INFO/ForkPoolWorker-1] [58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:00.698514339Z [2024-05-10 22:48:00,698: INFO/ForkPoolWorker-2] [c41f6d48-e916-4af8-94e9-98ff5db7a4dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:48:00.699269472Z [2024-05-10 22:48:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4460f34e-857b-41b4-b7c7-5fd6e4a8819d] received 2024-05-10T22:48:00.706183973Z [2024-05-10 22:48:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84b3207d-cc09-472e-938b-0964ecb252c4] received 2024-05-10T22:48:00.714439906Z [2024-05-10 22:48:00,714: INFO/ForkPoolWorker-3] [4460f34e-857b-41b4-b7c7-5fd6e4a8819d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:00.740360507Z [2024-05-10 22:48:00,740: INFO/ForkPoolWorker-4] [84b3207d-cc09-472e-938b-0964ecb252c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:01.395980555Z [2024-05-10 22:48:01,392: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:48:01.504549841Z [2024-05-10 22:48:01,484: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:01.525641179Z [2024-05-10 22:48:01,522: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:01.580837905Z [2024-05-10 22:48:01,580: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T22:48:01.584945020Z [2024-05-10 22:48:01,584: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:01.626058084Z [2024-05-10 22:48:01,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:48:01.627526635Z [2024-05-10 22:48:01,627: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:48:01.627610380Z [2024-05-10 22:48:01,627: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:48:01.627693446Z [2024-05-10 22:48:01,627: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T22:48:01.627951825Z [2024-05-10 22:48:01,627: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:48:01.724886211Z [2024-05-10 22:48:01,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:48:01.726140007Z [2024-05-10 22:48:01,725: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:48:01.732922382Z [2024-05-10 22:48:01,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:02.121489367Z [2024-05-10 22:48:02,113: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:02.528223953Z [2024-05-10 22:48:02,527: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:48:02.614685550Z [2024-05-10 22:48:02,614: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c41f6d48-e916-4af8-94e9-98ff5db7a4dd] succeeded in 1.9255166680000002s: None 2024-05-10T22:48:03.199001880Z [2024-05-10 22:48:03,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f895bd48-ab2d-46a1-b9c4-eaecb27dd618] succeeded in 2.539387505999912s: None 2024-05-10T22:48:03.317837378Z [2024-05-10 22:48:03,317: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:48:03.321992726Z [2024-05-10 22:48:03,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.374725432Z [2024-05-10 22:48:03,374: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:48:03.386824206Z [2024-05-10 22:48:03,386: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.387073893Z [2024-05-10 22:48:03,386: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.387361716Z [2024-05-10 22:48:03,387: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.387569811Z [2024-05-10 22:48:03,387: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:48:03.388025512Z [2024-05-10 22:48:03,387: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:48:03.388272276Z [2024-05-10 22:48:03,388: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.395053166Z [2024-05-10 22:48:03,394: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:03.396186910Z [2024-05-10 22:48:03,395: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:03.397231964Z [2024-05-10 22:48:03,397: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:48:03.399991609Z [2024-05-10 22:48:03,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.441601998Z [2024-05-10 22:48:03,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:48:03.447159889Z [2024-05-10 22:48:03,446: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.447385219Z [2024-05-10 22:48:03,447: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.447635527Z [2024-05-10 22:48:03,447: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.447819870Z [2024-05-10 22:48:03,447: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:48:03.448246170Z [2024-05-10 22:48:03,448: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:48:03.448431726Z [2024-05-10 22:48:03,448: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.453902078Z [2024-05-10 22:48:03,453: ERROR/ForkPoolWorker-1] [58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12] Failed to execute task Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:48:03.453919671Z Traceback (most recent call last): 2024-05-10T22:48:03.453924143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:48:03.453927769Z args.func(args) 2024-05-10T22:48:03.453931206Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:48:03.453935686Z return func(*args, **kwargs) 2024-05-10T22:48:03.453938776Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:48:03.453949432Z return f(*args, **kwargs) 2024-05-10T22:48:03.453952707Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:48:03.453955970Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:48:03.453959089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:48:03.453962156Z raise AirflowException( 2024-05-10T22:48:03.453965816Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:48:03.489401139Z [2024-05-10 22:48:03,489: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-10T22:48:03.489452080Z [2024-05-10 22:48:03,488: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12') 2024-05-10T22:48:03.489473925Z Traceback (most recent call last): 2024-05-10T22:48:03.489478352Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:48:03.489481448Z R = retval = fun(*args, **kwargs) 2024-05-10T22:48:03.489486142Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:48:03.489489427Z return self.run(*args, **kwargs) 2024-05-10T22:48:03.489492989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:48:03.489496980Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:48:03.489500208Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:48:03.489503769Z raise AirflowException(msg) 2024-05-10T22:48:03.489507545Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 58ce7c32-2c95-44f7-a1b0-dce8fa9a1d12 2024-05-10T22:48:03.494178963Z [2024-05-10 22:48:03,492: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.537487775Z [2024-05-10 22:48:03,536: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-10T22:48:03.538521468Z [2024-05-10 22:48:03,538: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.538711861Z [2024-05-10 22:48:03,538: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.539044253Z [2024-05-10 22:48:03,538: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.539289652Z [2024-05-10 22:48:03,539: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-10T22:48:03.539891086Z [2024-05-10 22:48:03,539: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:48:03.540457512Z [2024-05-10 22:48:03,540: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.632702890Z [2024-05-10 22:48:03,632: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:48:03.653195799Z [2024-05-10 22:48:03,652: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-10T22:48:03.656508901Z [2024-05-10 22:48:03,656: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.677041438Z [2024-05-10 22:48:03,676: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:48:03.679502431Z [2024-05-10 22:48:03,679: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:48:03.681070971Z [2024-05-10 22:48:03,680: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.681120756Z [2024-05-10 22:48:03,680: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.681126286Z [2024-05-10 22:48:03,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.681293167Z [2024-05-10 22:48:03,681: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.681347553Z [2024-05-10 22:48:03,681: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-10T22:48:03.681991526Z [2024-05-10 22:48:03,681: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:48:03.682073157Z [2024-05-10 22:48:03,681: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.688636023Z [2024-05-10 22:48:03,688: WARNING/ForkPoolWorker-3] Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:03.689477440Z [2024-05-10 22:48:03,688: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:03.691124239Z [2024-05-10 22:48:03,690: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-10T22:48:03.693857012Z [2024-05-10 22:48:03,693: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:03.703243866Z [2024-05-10 22:48:03,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:48:03.704592211Z [2024-05-10 22:48:03,704: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.704946981Z [2024-05-10 22:48:03,704: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.705410293Z [2024-05-10 22:48:03,704: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.705466258Z [2024-05-10 22:48:03,705: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:48:03.705983086Z [2024-05-10 22:48:03,705: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:48:03.706123151Z [2024-05-10 22:48:03,706: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.707167356Z [2024-05-10 22:48:03,706: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:48:03.708853405Z [2024-05-10 22:48:03,708: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:03.708892045Z [2024-05-10 22:48:03,708: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:03.709114239Z [2024-05-10 22:48:03,708: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:03.709123760Z [2024-05-10 22:48:03,709: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-10T22:48:03.709394114Z [2024-05-10 22:48:03,709: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:48:03.709400473Z [2024-05-10 22:48:03,709: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:03.712591038Z [2024-05-10 22:48:03,712: ERROR/ForkPoolWorker-3] [4460f34e-857b-41b4-b7c7-5fd6e4a8819d] Failed to execute task Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:48:03.712610291Z Traceback (most recent call last): 2024-05-10T22:48:03.712616256Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:48:03.712621862Z args.func(args) 2024-05-10T22:48:03.712627551Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:48:03.712633090Z return func(*args, **kwargs) 2024-05-10T22:48:03.712637648Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:48:03.712642239Z return f(*args, **kwargs) 2024-05-10T22:48:03.712647500Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:48:03.712652075Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:48:03.712656454Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:48:03.712661228Z raise AirflowException( 2024-05-10T22:48:03.712666536Z airflow.exceptions.AirflowException: Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:48:03.749642395Z [2024-05-10 22:48:03,749: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4460f34e-857b-41b4-b7c7-5fd6e4a8819d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4460f34e-857b-41b4-b7c7-5fd6e4a8819d') 2024-05-10T22:48:03.749676249Z Traceback (most recent call last): 2024-05-10T22:48:03.749680908Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:48:03.749684125Z R = retval = fun(*args, **kwargs) 2024-05-10T22:48:03.749687186Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:48:03.749690371Z return self.run(*args, **kwargs) 2024-05-10T22:48:03.749694061Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:48:03.749698108Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:48:03.749701118Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:48:03.749704819Z raise AirflowException(msg) 2024-05-10T22:48:03.749708625Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4460f34e-857b-41b4-b7c7-5fd6e4a8819d 2024-05-10T22:48:03.807583276Z [2024-05-10 22:48:03,807: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:48:05.340252028Z [2024-05-10 22:48:05,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40698c99-1cc8-4265-bc6e-4169f4210455] succeeded in 4.6783922009999515s: None 2024-05-10T22:48:05.623523149Z [2024-05-10 22:48:05,623: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[84b3207d-cc09-472e-938b-0964ecb252c4] succeeded in 4.915903770000114s: None 2024-05-10T22:48:14.802169400Z [2024-05-10 22:48:14,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec617107-c3c0-41f4-88c0-8c4d91d814aa] received 2024-05-10T22:48:14.807274730Z [2024-05-10 22:48:14,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5711b88e-5e22-412a-8815-9a2b763acd26] received 2024-05-10T22:48:14.809159753Z [2024-05-10 22:48:14,808: INFO/ForkPoolWorker-15] [ec617107-c3c0-41f4-88c0-8c4d91d814aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:48:14.822842403Z [2024-05-10 22:48:14,822: INFO/ForkPoolWorker-16] [5711b88e-5e22-412a-8815-9a2b763acd26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:48:15.102607017Z [2024-05-10 22:48:15,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:15.125886180Z [2024-05-10 22:48:15,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:16.252439727Z [2024-05-10 22:48:16,252: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:48:16.255837977Z [2024-05-10 22:48:16,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:16.262166582Z [2024-05-10 22:48:16,261: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:48:16.265411661Z [2024-05-10 22:48:16,265: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:16.285297623Z [2024-05-10 22:48:16,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:48:16.286704878Z [2024-05-10 22:48:16,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:48:16.287699146Z [2024-05-10 22:48:16,287: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:16.287917771Z [2024-05-10 22:48:16,287: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:16.288246684Z [2024-05-10 22:48:16,287: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:16.288409416Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:16.288558892Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:48:16.288568666Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:16.288822797Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:16.288966262Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:48:16.289132688Z [2024-05-10 22:48:16,288: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:48:16.289284462Z [2024-05-10 22:48:16,289: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:16.289359143Z [2024-05-10 22:48:16,289: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:48:16.289565222Z [2024-05-10 22:48:16,289: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:16.296821699Z [2024-05-10 22:48:16,296: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:16.297155334Z [2024-05-10 22:48:16,296: WARNING/ForkPoolWorker-15] Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:16.297794100Z [2024-05-10 22:48:16,296: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:48:16.298157875Z [2024-05-10 22:48:16,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:48:16.298729163Z [2024-05-10 22:48:16,298: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:48:16.299076957Z [2024-05-10 22:48:16,298: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:48:16.301511935Z [2024-05-10 22:48:16,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:16.302264218Z [2024-05-10 22:48:16,301: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:48:16.315276560Z [2024-05-10 22:48:16,315: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:48:16.316499818Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:16.316593787Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:16.316698419Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:16.316809282Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:48:16.317033572Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:48:16.317101179Z [2024-05-10 22:48:16,316: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:16.318732677Z [2024-05-10 22:48:16,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:48:16.320259134Z [2024-05-10 22:48:16,320: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:48:16.320398044Z [2024-05-10 22:48:16,319: ERROR/ForkPoolWorker-16] [5711b88e-5e22-412a-8815-9a2b763acd26] Failed to execute task Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:48:16.320404820Z Traceback (most recent call last): 2024-05-10T22:48:16.320408942Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:48:16.320413306Z args.func(args) 2024-05-10T22:48:16.320417958Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:48:16.320422323Z return func(*args, **kwargs) 2024-05-10T22:48:16.320425851Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:48:16.320429349Z return f(*args, **kwargs) 2024-05-10T22:48:16.320453341Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:48:16.320457371Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:48:16.320460771Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:48:16.320464190Z raise AirflowException( 2024-05-10T22:48:16.320468238Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:48:16.320482569Z [2024-05-10 22:48:16,320: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:48:16.320709336Z [2024-05-10 22:48:16,320: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:48:16.321009329Z [2024-05-10 22:48:16,320: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:48:16.321356426Z [2024-05-10 22:48:16,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:48:16.322256020Z [2024-05-10 22:48:16,322: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:48:16.325740756Z [2024-05-10 22:48:16,325: ERROR/ForkPoolWorker-15] [ec617107-c3c0-41f4-88c0-8c4d91d814aa] Failed to execute task Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse.. 2024-05-10T22:48:16.325753899Z Traceback (most recent call last): 2024-05-10T22:48:16.325758158Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-10T22:48:16.325761718Z args.func(args) 2024-05-10T22:48:16.325765135Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-10T22:48:16.325784919Z return func(*args, **kwargs) 2024-05-10T22:48:16.325788794Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-10T22:48:16.325791995Z return f(*args, **kwargs) 2024-05-10T22:48:16.325795051Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-10T22:48:16.325798015Z dag = get_dag(args.subdir, args.dag_id) 2024-05-10T22:48:16.325801031Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-10T22:48:16.325804018Z raise AirflowException( 2024-05-10T22:48:16.325807566Z airflow.exceptions.AirflowException: Dag 'vim_status_24871773-28b9-44b2-af75-63072e54f9fd' could not be found; either it does not exist or it failed to parse. 2024-05-10T22:48:16.360353203Z [2024-05-10 22:48:16,359: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5711b88e-5e22-412a-8815-9a2b763acd26] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5711b88e-5e22-412a-8815-9a2b763acd26') 2024-05-10T22:48:16.360386279Z Traceback (most recent call last): 2024-05-10T22:48:16.360391577Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:48:16.360394836Z R = retval = fun(*args, **kwargs) 2024-05-10T22:48:16.360397874Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:48:16.360400812Z return self.run(*args, **kwargs) 2024-05-10T22:48:16.360404916Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:48:16.360408640Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:48:16.360411638Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:48:16.360415328Z raise AirflowException(msg) 2024-05-10T22:48:16.360419587Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5711b88e-5e22-412a-8815-9a2b763acd26 2024-05-10T22:48:16.365176969Z [2024-05-10 22:48:16,364: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec617107-c3c0-41f4-88c0-8c4d91d814aa] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ec617107-c3c0-41f4-88c0-8c4d91d814aa') 2024-05-10T22:48:16.365238549Z Traceback (most recent call last): 2024-05-10T22:48:16.365243540Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-10T22:48:16.365246603Z R = retval = fun(*args, **kwargs) 2024-05-10T22:48:16.365249668Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-10T22:48:16.365252565Z return self.run(*args, **kwargs) 2024-05-10T22:48:16.365256207Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-10T22:48:16.365259551Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-10T22:48:16.365262556Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-10T22:48:16.365265969Z raise AirflowException(msg) 2024-05-10T22:48:16.365269548Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ec617107-c3c0-41f4-88c0-8c4d91d814aa 2024-05-10T22:49:00.667892222Z [2024-05-10 22:49:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c98a169-3fda-4045-bb70-96c084ced40f] received 2024-05-10T22:49:00.681335225Z [2024-05-10 22:49:00,681: INFO/ForkPoolWorker-15] [4c98a169-3fda-4045-bb70-96c084ced40f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:49:00.684653993Z [2024-05-10 22:49:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30e45973-e496-4d57-aba8-43f78f8eab06] received 2024-05-10T22:49:00.690204922Z [2024-05-10 22:49:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec5e2a52-1c05-4c22-af3c-ea69ca287bee] received 2024-05-10T22:49:00.692720387Z [2024-05-10 22:49:00,692: INFO/ForkPoolWorker-16] [30e45973-e496-4d57-aba8-43f78f8eab06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:49:00.699045810Z [2024-05-10 22:49:00,698: INFO/ForkPoolWorker-1] [ec5e2a52-1c05-4c22-af3c-ea69ca287bee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:49:01.003266965Z [2024-05-10 22:49:00,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:49:01.184358882Z [2024-05-10 22:49:01,178: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:49:01.339607447Z [2024-05-10 22:49:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:49:01.371522244Z [2024-05-10 22:49:01,371: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T22:49:01.375407274Z [2024-05-10 22:49:01,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:49:01.404277563Z [2024-05-10 22:49:01,404: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:49:01.405387203Z [2024-05-10 22:49:01,405: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:49:01.405562784Z [2024-05-10 22:49:01,405: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:49:01.405672729Z [2024-05-10 22:49:01,405: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T22:49:01.405971007Z [2024-05-10 22:49:01,405: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:49:01.553853326Z [2024-05-10 22:49:01,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:49:02.289544048Z [2024-05-10 22:49:02,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c98a169-3fda-4045-bb70-96c084ced40f] succeeded in 1.614796170000318s: None 2024-05-10T22:49:02.497831884Z [2024-05-10 22:49:02,497: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:49:02.501208238Z [2024-05-10 22:49:02,500: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:49:02.523232111Z [2024-05-10 22:49:02,523: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:49:02.527372872Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:49:02.527388257Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:49:02.527487080Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:49:02.527538957Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:49:02.527789834Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:49:02.527797810Z [2024-05-10 22:49:02,527: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:49:02.607025324Z [2024-05-10 22:49:02,606: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:49:02.993546817Z [2024-05-10 22:49:02,993: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:49:02.997292687Z [2024-05-10 22:49:02,996: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:49:03.032466223Z [2024-05-10 22:49:03,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:49:03.034221206Z [2024-05-10 22:49:03,033: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:49:03.034237841Z [2024-05-10 22:49:03,034: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:49:03.034374732Z [2024-05-10 22:49:03,034: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:49:03.034412583Z [2024-05-10 22:49:03,034: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:49:03.034641622Z [2024-05-10 22:49:03,034: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:49:03.034648900Z [2024-05-10 22:49:03,034: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:49:03.137241744Z [2024-05-10 22:49:03,136: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:49:06.484235122Z [2024-05-10 22:49:06,483: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30e45973-e496-4d57-aba8-43f78f8eab06] succeeded in 5.795925449000151s: None 2024-05-10T22:49:06.489495351Z [2024-05-10 22:49:06,489: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec5e2a52-1c05-4c22-af3c-ea69ca287bee] succeeded in 5.796236941000188s: None 2024-05-10T22:50:00.546752239Z [2024-05-10 22:50:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07e3de28-089b-40e9-ad96-c0aa3267e244] received 2024-05-10T22:50:00.548298437Z [2024-05-10 22:50:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1c8c711-fa93-454a-b487-0c95e1459cbe] received 2024-05-10T22:50:00.553525224Z [2024-05-10 22:50:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94703843-3fec-4b12-90da-948424d7b761] received 2024-05-10T22:50:00.554166467Z [2024-05-10 22:50:00,553: INFO/ForkPoolWorker-15] [07e3de28-089b-40e9-ad96-c0aa3267e244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:50:00.554705146Z [2024-05-10 22:50:00,554: INFO/ForkPoolWorker-16] [e1c8c711-fa93-454a-b487-0c95e1459cbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:00.555444624Z [2024-05-10 22:50:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0a0b880-5636-431f-aefc-a3b896912173] received 2024-05-10T22:50:00.561696158Z [2024-05-10 22:50:00,561: INFO/ForkPoolWorker-1] [94703843-3fec-4b12-90da-948424d7b761] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:50:00.568954349Z [2024-05-10 22:50:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d17a49d-6c82-423b-9dda-723aa41c0831] received 2024-05-10T22:50:00.570983422Z [2024-05-10 22:50:00,570: INFO/ForkPoolWorker-2] [f0a0b880-5636-431f-aefc-a3b896912173] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:50:00.577591165Z [2024-05-10 22:50:00,577: INFO/ForkPoolWorker-3] [9d17a49d-6c82-423b-9dda-723aa41c0831] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:50:00.869970559Z [2024-05-10 22:50:00,866: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:50:00.871764879Z [2024-05-10 22:50:00,864: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:50:00.897965038Z [2024-05-10 22:50:00,894: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:50:01.006376602Z [2024-05-10 22:50:00,998: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:50:01.277114069Z [2024-05-10 22:50:01,264: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:50:01.352806286Z [2024-05-10 22:50:01,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:01.507072771Z [2024-05-10 22:50:01,506: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T22:50:01.513791862Z [2024-05-10 22:50:01,512: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:01.610007983Z [2024-05-10 22:50:01,609: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:50:01.630098323Z [2024-05-10 22:50:01,620: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:50:01.630158947Z [2024-05-10 22:50:01,621: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:50:01.630163925Z [2024-05-10 22:50:01,621: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T22:50:01.630167081Z [2024-05-10 22:50:01,621: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:50:01.741204703Z [2024-05-10 22:50:01,740: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:02.250523864Z [2024-05-10 22:50:02,250: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94703843-3fec-4b12-90da-948424d7b761] succeeded in 1.6941212930000802s: None 2024-05-10T22:50:02.511018145Z [2024-05-10 22:50:02,510: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f0a0b880-5636-431f-aefc-a3b896912173] succeeded in 1.9481832480000776s: None 2024-05-10T22:50:02.601184709Z [2024-05-10 22:50:02,600: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:50:02.606029142Z [2024-05-10 22:50:02,605: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:02.659390555Z [2024-05-10 22:50:02,659: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:50:02.671374975Z [2024-05-10 22:50:02,671: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:02.671485834Z [2024-05-10 22:50:02,671: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:02.671923535Z [2024-05-10 22:50:02,671: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:02.671936124Z [2024-05-10 22:50:02,671: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:50:02.672406036Z [2024-05-10 22:50:02,672: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:50:02.678290875Z [2024-05-10 22:50:02,672: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:02.773380917Z [2024-05-10 22:50:02,773: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:02.819503064Z [2024-05-10 22:50:02,819: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-10T22:50:02.822642701Z [2024-05-10 22:50:02,822: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:02.856706780Z [2024-05-10 22:50:02,856: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T22:50:02.858880629Z [2024-05-10 22:50:02,858: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:02.859254701Z [2024-05-10 22:50:02,859: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:02.859677991Z [2024-05-10 22:50:02,859: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:02.860199960Z [2024-05-10 22:50:02,860: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-10T22:50:02.860593412Z [2024-05-10 22:50:02,860: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:50:02.861031386Z [2024-05-10 22:50:02,860: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:02.942473087Z [2024-05-10 22:50:02,942: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:03.061794144Z [2024-05-10 22:50:03,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:50:03.065160424Z [2024-05-10 22:50:03,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:03.097777050Z [2024-05-10 22:50:03,097: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:50:03.103087153Z [2024-05-10 22:50:03,102: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:03.103121734Z [2024-05-10 22:50:03,102: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:03.103304529Z [2024-05-10 22:50:03,103: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:03.103325716Z [2024-05-10 22:50:03,103: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:50:03.103658486Z [2024-05-10 22:50:03,103: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:50:03.103676215Z [2024-05-10 22:50:03,103: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:03.181078642Z [2024-05-10 22:50:03,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:03.497335386Z [2024-05-10 22:50:03,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e1c8c711-fa93-454a-b487-0c95e1459cbe] succeeded in 2.947750756000005s: None 2024-05-10T22:50:03.761781687Z [2024-05-10 22:50:03,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78064107-b1f4-4ad5-af3f-686249963021] received 2024-05-10T22:50:03.777197905Z [2024-05-10 22:50:03,776: INFO/ForkPoolWorker-16] [78064107-b1f4-4ad5-af3f-686249963021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:04.094469596Z [2024-05-10 22:50:04,091: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:50:04.929155727Z [2024-05-10 22:50:04,928: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9d17a49d-6c82-423b-9dda-723aa41c0831] succeeded in 4.359015931000158s: None 2024-05-10T22:50:05.216984680Z [2024-05-10 22:50:05,216: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:50:05.220417548Z [2024-05-10 22:50:05,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:05.240823255Z [2024-05-10 22:50:05,240: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:50:05.242071058Z [2024-05-10 22:50:05,241: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:05.242106952Z [2024-05-10 22:50:05,241: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:05.242285560Z [2024-05-10 22:50:05,242: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:05.242341730Z [2024-05-10 22:50:05,242: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:50:05.242649882Z [2024-05-10 22:50:05,242: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:50:05.242700213Z [2024-05-10 22:50:05,242: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:05.316121499Z [2024-05-10 22:50:05,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:05.623630359Z [2024-05-10 22:50:05,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07e3de28-089b-40e9-ad96-c0aa3267e244] succeeded in 5.074227239000265s: None 2024-05-10T22:50:05.993894342Z [2024-05-10 22:50:05,993: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78064107-b1f4-4ad5-af3f-686249963021] succeeded in 2.228189974000088s: None 2024-05-10T22:50:06.417462765Z [2024-05-10 22:50:06,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd811592-e255-42fb-965e-8d29f70329c4] received 2024-05-10T22:50:06.427783123Z [2024-05-10 22:50:06,427: INFO/ForkPoolWorker-15] [bd811592-e255-42fb-965e-8d29f70329c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:50:06.765295119Z [2024-05-10 22:50:06,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:50:07.926922495Z [2024-05-10 22:50:07,926: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:50:07.930450831Z [2024-05-10 22:50:07,929: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:07.952277578Z [2024-05-10 22:50:07,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:50:07.953912277Z [2024-05-10 22:50:07,953: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:07.953928087Z [2024-05-10 22:50:07,953: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:07.954210675Z [2024-05-10 22:50:07,953: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:07.954277043Z [2024-05-10 22:50:07,954: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:50:07.954595880Z [2024-05-10 22:50:07,954: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:50:07.954692073Z [2024-05-10 22:50:07,954: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:08.038924907Z [2024-05-10 22:50:08,038: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:08.580364482Z [2024-05-10 22:50:08,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd811592-e255-42fb-965e-8d29f70329c4] succeeded in 2.1574949270002435s: None 2024-05-10T22:50:08.773214845Z [2024-05-10 22:50:08,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[792fca33-77b2-4cf8-877e-70fe74b43068] received 2024-05-10T22:50:08.781283108Z [2024-05-10 22:50:08,781: INFO/ForkPoolWorker-15] [792fca33-77b2-4cf8-877e-70fe74b43068] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:50:09.052274824Z [2024-05-10 22:50:09,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:50:10.143292473Z [2024-05-10 22:50:10,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:50:10.146520371Z [2024-05-10 22:50:10,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:50:10.166567794Z [2024-05-10 22:50:10,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:50:10.167705456Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:50:10.167726377Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:50:10.167839770Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:50:10.167852669Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:50:10.168085954Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:50:10.168105819Z [2024-05-10 22:50:10,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:50:10.263006606Z [2024-05-10 22:50:10,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:50:10.788218298Z [2024-05-10 22:50:10,787: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[792fca33-77b2-4cf8-877e-70fe74b43068] succeeded in 2.0123593739999706s: None 2024-05-10T22:51:00.453583911Z [2024-05-10 22:51:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61d81d8e-f6ea-40da-98fe-00f7830e7de7] received 2024-05-10T22:51:00.456716528Z [2024-05-10 22:51:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[677df1d0-ed65-437c-8da9-bf6b01c094a8] received 2024-05-10T22:51:00.460192646Z [2024-05-10 22:51:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60710351-c52f-425f-8767-5d62dc8424c8] received 2024-05-10T22:51:00.464960799Z [2024-05-10 22:51:00,464: INFO/ForkPoolWorker-16] [677df1d0-ed65-437c-8da9-bf6b01c094a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:51:00.468133775Z [2024-05-10 22:51:00,467: INFO/ForkPoolWorker-1] [60710351-c52f-425f-8767-5d62dc8424c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:51:00.468150566Z [2024-05-10 22:51:00,467: INFO/ForkPoolWorker-15] [61d81d8e-f6ea-40da-98fe-00f7830e7de7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:51:00.805117507Z [2024-05-10 22:51:00,801: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:51:00.828989396Z [2024-05-10 22:51:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:51:00.829020601Z [2024-05-10 22:51:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:51:01.014949273Z [2024-05-10 22:51:01,014: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:51:01.019306042Z [2024-05-10 22:51:01,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:51:01.082900535Z [2024-05-10 22:51:01,082: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:51:01.084097472Z [2024-05-10 22:51:01,083: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:51:01.084152226Z [2024-05-10 22:51:01,084: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:51:01.084217905Z [2024-05-10 22:51:01,084: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:51:01.084385882Z [2024-05-10 22:51:01,084: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:51:01.203657723Z [2024-05-10 22:51:01,203: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:51:01.764391242Z [2024-05-10 22:51:01,763: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[677df1d0-ed65-437c-8da9-bf6b01c094a8] succeeded in 1.3048993420002262s: None 2024-05-10T22:51:02.050596214Z [2024-05-10 22:51:02,050: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:51:02.054014999Z [2024-05-10 22:51:02,053: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:51:02.075861045Z [2024-05-10 22:51:02,075: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:51:02.078042145Z [2024-05-10 22:51:02,077: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:51:02.078193881Z [2024-05-10 22:51:02,077: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:51:02.078427323Z [2024-05-10 22:51:02,078: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:51:02.078616008Z [2024-05-10 22:51:02,078: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:51:02.079061855Z [2024-05-10 22:51:02,078: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:51:02.079145686Z [2024-05-10 22:51:02,079: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:51:02.083855891Z [2024-05-10 22:51:02,083: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:51:02.087493078Z [2024-05-10 22:51:02,086: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:51:02.108694113Z [2024-05-10 22:51:02,108: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:51:02.110668806Z [2024-05-10 22:51:02,110: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:51:02.110937926Z [2024-05-10 22:51:02,110: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:51:02.111336006Z [2024-05-10 22:51:02,110: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:51:02.111517431Z [2024-05-10 22:51:02,111: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:51:02.112017797Z [2024-05-10 22:51:02,111: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:51:02.112023768Z [2024-05-10 22:51:02,111: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:51:02.169520386Z [2024-05-10 22:51:02,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:51:02.204198527Z [2024-05-10 22:51:02,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:51:03.922007139Z [2024-05-10 22:51:03,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61d81d8e-f6ea-40da-98fe-00f7830e7de7] succeeded in 3.4646379749997323s: None 2024-05-10T22:51:04.658306596Z [2024-05-10 22:51:04,657: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60710351-c52f-425f-8767-5d62dc8424c8] succeeded in 4.196048003999749s: None 2024-05-10T22:52:00.330013494Z [2024-05-10 22:52:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cfab732-a1be-4e3e-b1f7-b2516bdce15b] received 2024-05-10T22:52:00.337938710Z [2024-05-10 22:52:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60cf9628-ed3f-4fef-b56f-af5a50e3972a] received 2024-05-10T22:52:00.342377855Z [2024-05-10 22:52:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d293513-3a5c-480c-bc3f-c7d86f47e907] received 2024-05-10T22:52:00.347846367Z [2024-05-10 22:52:00,347: INFO/ForkPoolWorker-15] [1cfab732-a1be-4e3e-b1f7-b2516bdce15b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:52:00.348650428Z [2024-05-10 22:52:00,348: INFO/ForkPoolWorker-1] [3d293513-3a5c-480c-bc3f-c7d86f47e907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:52:00.352138962Z [2024-05-10 22:52:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d57ba471-ed90-4df1-9424-f8f977ad2850] received 2024-05-10T22:52:00.357784379Z [2024-05-10 22:52:00,357: INFO/ForkPoolWorker-16] [60cf9628-ed3f-4fef-b56f-af5a50e3972a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:52:00.364483027Z [2024-05-10 22:52:00,364: INFO/ForkPoolWorker-2] [d57ba471-ed90-4df1-9424-f8f977ad2850] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:52:00.735125169Z [2024-05-10 22:52:00,731: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:52:00.746637229Z [2024-05-10 22:52:00,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:52:00.821774556Z [2024-05-10 22:52:00,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:52:00.898112330Z [2024-05-10 22:52:00,893: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:52:00.906126618Z [2024-05-10 22:52:00,905: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:52:00.910086301Z [2024-05-10 22:52:00,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:52:00.953945344Z [2024-05-10 22:52:00,953: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:52:00.958025370Z [2024-05-10 22:52:00,957: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:52:00.958369651Z [2024-05-10 22:52:00,958: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:52:00.958552961Z [2024-05-10 22:52:00,958: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:52:00.958904632Z [2024-05-10 22:52:00,958: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:52:01.100723279Z [2024-05-10 22:52:01,100: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:52:01.193813168Z [2024-05-10 22:52:01,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:52:01.815085617Z [2024-05-10 22:52:01,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cfab732-a1be-4e3e-b1f7-b2516bdce15b] succeeded in 1.4856664630001433s: None 2024-05-10T22:52:01.826835122Z [2024-05-10 22:52:01,826: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60cf9628-ed3f-4fef-b56f-af5a50e3972a] succeeded in 1.4876414619998286s: None 2024-05-10T22:52:02.092639448Z [2024-05-10 22:52:02,092: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:52:02.096011310Z [2024-05-10 22:52:02,095: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:52:02.116792189Z [2024-05-10 22:52:02,116: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:52:02.118114214Z [2024-05-10 22:52:02,117: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:52:02.118210072Z [2024-05-10 22:52:02,118: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:52:02.118375846Z [2024-05-10 22:52:02,118: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:52:02.118504474Z [2024-05-10 22:52:02,118: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:52:02.118779058Z [2024-05-10 22:52:02,118: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:52:02.118886359Z [2024-05-10 22:52:02,118: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:52:02.208608566Z [2024-05-10 22:52:02,208: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:52:02.227555125Z [2024-05-10 22:52:02,227: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:52:02.231104832Z [2024-05-10 22:52:02,230: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:52:02.268508499Z [2024-05-10 22:52:02,268: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:52:02.269964896Z [2024-05-10 22:52:02,269: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:52:02.270156844Z [2024-05-10 22:52:02,270: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:52:02.270345228Z [2024-05-10 22:52:02,270: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:52:02.270385805Z [2024-05-10 22:52:02,270: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:52:02.270754556Z [2024-05-10 22:52:02,270: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:52:02.270851758Z [2024-05-10 22:52:02,270: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:52:02.361988456Z [2024-05-10 22:52:02,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:52:03.888304552Z [2024-05-10 22:52:03,887: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d293513-3a5c-480c-bc3f-c7d86f47e907] succeeded in 3.544303128000138s: None 2024-05-10T22:52:04.011824912Z [2024-05-10 22:52:04,011: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d57ba471-ed90-4df1-9424-f8f977ad2850] succeeded in 3.6533971860003476s: None 2024-05-10T22:53:01.092881313Z [2024-05-10 22:53:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4f9da99-fc4e-4011-a34c-7ae1b80a003d] received 2024-05-10T22:53:01.097404350Z [2024-05-10 22:53:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cb520da-e2e4-4dda-9f57-a59dacd655ee] received 2024-05-10T22:53:01.105474379Z [2024-05-10 22:53:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[925cdcbb-f475-4b84-9c20-a07e453ea729] received 2024-05-10T22:53:01.119331016Z [2024-05-10 22:53:01,119: INFO/ForkPoolWorker-1] [925cdcbb-f475-4b84-9c20-a07e453ea729] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:53:01.123373019Z [2024-05-10 22:53:01,123: INFO/ForkPoolWorker-15] [c4f9da99-fc4e-4011-a34c-7ae1b80a003d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:53:01.127517724Z [2024-05-10 22:53:01,127: INFO/ForkPoolWorker-16] [7cb520da-e2e4-4dda-9f57-a59dacd655ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:53:01.449793772Z [2024-05-10 22:53:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:53:01.469989361Z [2024-05-10 22:53:01,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:53:01.486597198Z [2024-05-10 22:53:01,483: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:53:01.669290279Z [2024-05-10 22:53:01,668: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:53:01.674079707Z [2024-05-10 22:53:01,673: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:53:01.709403226Z [2024-05-10 22:53:01,709: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:53:01.710760878Z [2024-05-10 22:53:01,710: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:53:01.710970438Z [2024-05-10 22:53:01,710: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:53:01.711138534Z [2024-05-10 22:53:01,711: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:53:01.711533800Z [2024-05-10 22:53:01,711: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:53:01.804195694Z [2024-05-10 22:53:01,803: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:53:02.435121685Z [2024-05-10 22:53:02,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[925cdcbb-f475-4b84-9c20-a07e453ea729] succeeded in 1.3263223029998699s: None 2024-05-10T22:53:02.628523167Z [2024-05-10 22:53:02,628: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:53:02.631914529Z [2024-05-10 22:53:02,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:53:02.652637954Z [2024-05-10 22:53:02,652: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:53:02.655302086Z [2024-05-10 22:53:02,655: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:53:02.656513127Z [2024-05-10 22:53:02,656: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:53:02.656697745Z [2024-05-10 22:53:02,656: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:53:02.656723306Z [2024-05-10 22:53:02,656: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:53:02.656892245Z [2024-05-10 22:53:02,656: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:53:02.656901449Z [2024-05-10 22:53:02,656: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:53:02.657332696Z [2024-05-10 22:53:02,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:53:02.657359033Z [2024-05-10 22:53:02,657: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:53:02.682728711Z [2024-05-10 22:53:02,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:53:02.684069091Z [2024-05-10 22:53:02,683: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:53:02.684109113Z [2024-05-10 22:53:02,683: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:53:02.684281926Z [2024-05-10 22:53:02,684: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:53:02.684373113Z [2024-05-10 22:53:02,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:53:02.684686822Z [2024-05-10 22:53:02,684: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:53:02.684783922Z [2024-05-10 22:53:02,684: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:53:02.754478382Z [2024-05-10 22:53:02,754: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:53:02.763715232Z [2024-05-10 22:53:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:53:04.312783148Z [2024-05-10 22:53:04,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4f9da99-fc4e-4011-a34c-7ae1b80a003d] succeeded in 3.21765713700006s: None 2024-05-10T22:53:05.508187125Z [2024-05-10 22:53:05,507: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7cb520da-e2e4-4dda-9f57-a59dacd655ee] succeeded in 4.408431792999636s: None 2024-05-10T22:54:01.026986787Z [2024-05-10 22:54:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf9944d1-3afb-4abc-9a2b-77c42ba31f2f] received 2024-05-10T22:54:01.029666884Z [2024-05-10 22:54:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc47b6a-da0a-438f-854e-c0f72ae89ed5] received 2024-05-10T22:54:01.031305055Z [2024-05-10 22:54:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fec76622-0940-4455-9b94-e8c279351a45] received 2024-05-10T22:54:01.058743466Z [2024-05-10 22:54:01,049: INFO/ForkPoolWorker-15] [bf9944d1-3afb-4abc-9a2b-77c42ba31f2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:54:01.058778551Z [2024-05-10 22:54:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[820beab6-9b23-4d62-8a97-25297ce5d529] received 2024-05-10T22:54:01.058796706Z [2024-05-10 22:54:01,051: INFO/ForkPoolWorker-16] [5dc47b6a-da0a-438f-854e-c0f72ae89ed5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:54:01.067856263Z [2024-05-10 22:54:01,064: INFO/ForkPoolWorker-1] [fec76622-0940-4455-9b94-e8c279351a45] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:54:01.079241308Z [2024-05-10 22:54:01,078: INFO/ForkPoolWorker-2] [820beab6-9b23-4d62-8a97-25297ce5d529] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:54:01.447592786Z [2024-05-10 22:54:01,443: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:54:01.543442554Z [2024-05-10 22:54:01,527: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:54:01.569421595Z [2024-05-10 22:54:01,565: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:54:01.677000996Z [2024-05-10 22:54:01,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:54:01.771041768Z [2024-05-10 22:54:01,770: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:54:01.778165228Z [2024-05-10 22:54:01,777: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T22:54:01.782492351Z [2024-05-10 22:54:01,781: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:54:01.828197421Z [2024-05-10 22:54:01,827: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:54:01.829516094Z [2024-05-10 22:54:01,829: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:54:01.829693902Z [2024-05-10 22:54:01,829: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:54:01.829831475Z [2024-05-10 22:54:01,829: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T22:54:01.830140517Z [2024-05-10 22:54:01,829: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:54:01.944554888Z [2024-05-10 22:54:01,944: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:54:02.497545907Z [2024-05-10 22:54:02,496: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fec76622-0940-4455-9b94-e8c279351a45] succeeded in 1.4538214079998397s: None 2024-05-10T22:54:02.580945776Z [2024-05-10 22:54:02,580: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[820beab6-9b23-4d62-8a97-25297ce5d529] succeeded in 1.5239441690000604s: None 2024-05-10T22:54:03.167834711Z [2024-05-10 22:54:03,167: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:54:03.171198318Z [2024-05-10 22:54:03,170: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:54:03.200076069Z [2024-05-10 22:54:03,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:54:03.202838688Z [2024-05-10 22:54:03,202: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:54:03.202869520Z [2024-05-10 22:54:03,202: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:54:03.203086501Z [2024-05-10 22:54:03,202: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:54:03.203186579Z [2024-05-10 22:54:03,203: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:54:03.203554182Z [2024-05-10 22:54:03,203: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:54:03.204138212Z [2024-05-10 22:54:03,203: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:54:03.238433067Z [2024-05-10 22:54:03,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:54:03.242411024Z [2024-05-10 22:54:03,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:54:03.269953167Z [2024-05-10 22:54:03,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:54:03.271510979Z [2024-05-10 22:54:03,271: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:54:03.273318997Z [2024-05-10 22:54:03,271: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:54:03.274301313Z [2024-05-10 22:54:03,273: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:54:03.274566319Z [2024-05-10 22:54:03,274: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:54:03.274911145Z [2024-05-10 22:54:03,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:54:03.276333241Z [2024-05-10 22:54:03,276: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:54:03.337233822Z [2024-05-10 22:54:03,336: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:54:03.380189984Z [2024-05-10 22:54:03,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:54:05.169739670Z [2024-05-10 22:54:05,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf9944d1-3afb-4abc-9a2b-77c42ba31f2f] succeeded in 4.12601791599991s: None 2024-05-10T22:54:05.387434637Z [2024-05-10 22:54:05,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dc47b6a-da0a-438f-854e-c0f72ae89ed5] succeeded in 4.3446766619999835s: None 2024-05-10T22:55:00.839134945Z [2024-05-10 22:55:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf528a30-c950-4847-88f4-b7fad522987f] received 2024-05-10T22:55:00.842616011Z [2024-05-10 22:55:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e1417f9-1597-491f-b288-1c4606a5fcea] received 2024-05-10T22:55:00.845949177Z [2024-05-10 22:55:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00b053f3-93ee-4554-8560-147ff9a538e9] received 2024-05-10T22:55:00.848874967Z [2024-05-10 22:55:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e71c2e7-4667-4d45-a97e-ab23507aed08] received 2024-05-10T22:55:00.853578383Z [2024-05-10 22:55:00,853: INFO/ForkPoolWorker-15] [bf528a30-c950-4847-88f4-b7fad522987f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:00.857741711Z [2024-05-10 22:55:00,857: INFO/ForkPoolWorker-1] [00b053f3-93ee-4554-8560-147ff9a538e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:55:00.861106167Z [2024-05-10 22:55:00,860: INFO/ForkPoolWorker-2] [5e71c2e7-4667-4d45-a97e-ab23507aed08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:55:00.862067967Z [2024-05-10 22:55:00,861: INFO/ForkPoolWorker-16] [0e1417f9-1597-491f-b288-1c4606a5fcea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:55:01.235670681Z [2024-05-10 22:55:01,231: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:55:01.280060045Z [2024-05-10 22:55:01,270: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:55:01.360069755Z [2024-05-10 22:55:01,356: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:55:01.396708107Z [2024-05-10 22:55:01,393: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:55:01.456979384Z [2024-05-10 22:55:01,456: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:55:01.464134857Z [2024-05-10 22:55:01,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:01.528343366Z [2024-05-10 22:55:01,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:55:01.530834892Z [2024-05-10 22:55:01,530: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:55:01.531243688Z [2024-05-10 22:55:01,530: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:55:01.531649931Z [2024-05-10 22:55:01,531: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:55:01.532889543Z [2024-05-10 22:55:01,532: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:55:01.672137056Z [2024-05-10 22:55:01,671: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:02.334075941Z [2024-05-10 22:55:02,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e1417f9-1597-491f-b288-1c4606a5fcea] succeeded in 1.4883968789999926s: None 2024-05-10T22:55:02.595713794Z [2024-05-10 22:55:02,595: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:55:02.599113301Z [2024-05-10 22:55:02,598: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:02.621069615Z [2024-05-10 22:55:02,620: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:55:02.622461221Z [2024-05-10 22:55:02,622: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:02.622617142Z [2024-05-10 22:55:02,622: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:02.622822971Z [2024-05-10 22:55:02,622: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:02.622841320Z [2024-05-10 22:55:02,622: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:55:02.623133026Z [2024-05-10 22:55:02,622: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:55:02.623530016Z [2024-05-10 22:55:02,623: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:02.638447566Z [2024-05-10 22:55:02,638: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:55:02.642329562Z [2024-05-10 22:55:02,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:02.683176620Z [2024-05-10 22:55:02,682: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:55:02.684569615Z [2024-05-10 22:55:02,684: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:02.684702868Z [2024-05-10 22:55:02,684: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:02.684936054Z [2024-05-10 22:55:02,684: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:02.685082386Z [2024-05-10 22:55:02,684: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:55:02.685481777Z [2024-05-10 22:55:02,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:55:02.685609206Z [2024-05-10 22:55:02,685: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:02.693576412Z [2024-05-10 22:55:02,693: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:55:02.697049175Z [2024-05-10 22:55:02,696: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:02.723806364Z [2024-05-10 22:55:02,723: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:55:02.725757280Z [2024-05-10 22:55:02,725: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:02.725775779Z [2024-05-10 22:55:02,725: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:02.725962435Z [2024-05-10 22:55:02,725: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:02.726106898Z [2024-05-10 22:55:02,725: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:55:02.728347418Z [2024-05-10 22:55:02,726: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:55:02.728506827Z [2024-05-10 22:55:02,728: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:02.730723860Z [2024-05-10 22:55:02,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:02.787508111Z [2024-05-10 22:55:02,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:02.810597351Z [2024-05-10 22:55:02,810: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:03.418132661Z [2024-05-10 22:55:03,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf528a30-c950-4847-88f4-b7fad522987f] succeeded in 2.5749141619999136s: None 2024-05-10T22:55:03.630767008Z [2024-05-10 22:55:03,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f448c12-edd4-49bf-b026-4523f6da90a0] received 2024-05-10T22:55:03.639645269Z [2024-05-10 22:55:03,639: INFO/ForkPoolWorker-15] [8f448c12-edd4-49bf-b026-4523f6da90a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:03.946844782Z [2024-05-10 22:55:03,943: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:55:04.260275501Z [2024-05-10 22:55:04,259: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00b053f3-93ee-4554-8560-147ff9a538e9] succeeded in 3.4116504270000405s: None 2024-05-10T22:55:05.086155546Z [2024-05-10 22:55:05,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:55:05.089598320Z [2024-05-10 22:55:05,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:05.110027048Z [2024-05-10 22:55:05,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:55:05.111414095Z [2024-05-10 22:55:05,111: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:05.111615764Z [2024-05-10 22:55:05,111: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:05.111877698Z [2024-05-10 22:55:05,111: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:05.112072079Z [2024-05-10 22:55:05,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:55:05.112571041Z [2024-05-10 22:55:05,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:55:05.112766698Z [2024-05-10 22:55:05,112: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:05.250791204Z [2024-05-10 22:55:05,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:05.872526960Z [2024-05-10 22:55:05,872: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e71c2e7-4667-4d45-a97e-ab23507aed08] succeeded in 5.021315481000329s: None 2024-05-10T22:55:05.915056910Z [2024-05-10 22:55:05,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f448c12-edd4-49bf-b026-4523f6da90a0] succeeded in 2.2812941249999312s: None 2024-05-10T22:55:06.036296085Z [2024-05-10 22:55:06,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1899fb8-e044-4bdd-858f-b475391ddc66] received 2024-05-10T22:55:06.043675429Z [2024-05-10 22:55:06,043: INFO/ForkPoolWorker-15] [c1899fb8-e044-4bdd-858f-b475391ddc66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T22:55:06.351117993Z [2024-05-10 22:55:06,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:55:07.545444477Z [2024-05-10 22:55:07,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:55:07.548887777Z [2024-05-10 22:55:07,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:07.574123989Z [2024-05-10 22:55:07,573: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:55:07.575422396Z [2024-05-10 22:55:07,575: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:07.575538706Z [2024-05-10 22:55:07,575: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:07.575736541Z [2024-05-10 22:55:07,575: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:07.575828994Z [2024-05-10 22:55:07,575: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:55:07.576179622Z [2024-05-10 22:55:07,575: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:55:07.576267247Z [2024-05-10 22:55:07,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:07.672801863Z [2024-05-10 22:55:07,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:08.162188305Z [2024-05-10 22:55:08,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1899fb8-e044-4bdd-858f-b475391ddc66] succeeded in 2.123396558999957s: None 2024-05-10T22:55:08.706141633Z [2024-05-10 22:55:08,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77681907-66ac-4063-905a-adbb16d1d758] received 2024-05-10T22:55:08.715453950Z [2024-05-10 22:55:08,715: INFO/ForkPoolWorker-15] [77681907-66ac-4063-905a-adbb16d1d758] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T22:55:08.980146514Z [2024-05-10 22:55:08,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T22:55:10.058261439Z [2024-05-10 22:55:10,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:55:10.061646090Z [2024-05-10 22:55:10,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:55:10.080082502Z [2024-05-10 22:55:10,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:55:10.081337203Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:55:10.081381162Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:55:10.081467389Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:55:10.081515478Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:55:10.081758684Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T22:55:10.081855185Z [2024-05-10 22:55:10,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:55:10.171637105Z [2024-05-10 22:55:10,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:55:10.737992350Z [2024-05-10 22:55:10,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77681907-66ac-4063-905a-adbb16d1d758] succeeded in 2.028427916000055s: None 2024-05-10T22:56:00.294070923Z [2024-05-10 22:56:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee29bd52-72c8-4710-b4d2-44b071c70760] received 2024-05-10T22:56:00.297087698Z [2024-05-10 22:56:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14c047ab-8820-4145-b47a-bb8a6023dd81] received 2024-05-10T22:56:00.300671132Z [2024-05-10 22:56:00,300: INFO/ForkPoolWorker-15] [ee29bd52-72c8-4710-b4d2-44b071c70760] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:56:00.322041688Z [2024-05-10 22:56:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5947ce3-07f3-4012-ab7b-411e54a4259a] received 2024-05-10T22:56:00.322063560Z [2024-05-10 22:56:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f33e3141-b4f3-4afb-9348-191e8adedd82] received 2024-05-10T22:56:00.324318592Z [2024-05-10 22:56:00,324: INFO/ForkPoolWorker-16] [14c047ab-8820-4145-b47a-bb8a6023dd81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:56:00.335075206Z [2024-05-10 22:56:00,334: INFO/ForkPoolWorker-1] [c5947ce3-07f3-4012-ab7b-411e54a4259a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:56:00.337666969Z [2024-05-10 22:56:00,337: INFO/ForkPoolWorker-2] [f33e3141-b4f3-4afb-9348-191e8adedd82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:56:00.629749299Z [2024-05-10 22:56:00,626: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:56:00.643497264Z [2024-05-10 22:56:00,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:56:00.878498765Z [2024-05-10 22:56:00,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:56:00.913988842Z [2024-05-10 22:56:00,913: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:56:00.958044171Z [2024-05-10 22:56:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:56:01.194813101Z [2024-05-10 22:56:01,194: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:56:01.203854737Z [2024-05-10 22:56:01,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:56:01.228237310Z [2024-05-10 22:56:01,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:56:01.238185361Z [2024-05-10 22:56:01,229: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:56:01.238470584Z [2024-05-10 22:56:01,238: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:56:01.238608197Z [2024-05-10 22:56:01,238: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:56:01.239126829Z [2024-05-10 22:56:01,238: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:56:01.329737868Z [2024-05-10 22:56:01,329: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:56:01.555599984Z [2024-05-10 22:56:01,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee29bd52-72c8-4710-b4d2-44b071c70760] succeeded in 1.2632625750002262s: None 2024-05-10T22:56:01.935318239Z [2024-05-10 22:56:01,934: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14c047ab-8820-4145-b47a-bb8a6023dd81] succeeded in 1.6387332459999016s: None 2024-05-10T22:56:01.984274378Z [2024-05-10 22:56:01,983: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:56:01.987793229Z [2024-05-10 22:56:01,987: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:56:02.019193401Z [2024-05-10 22:56:02,018: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:56:02.020714757Z [2024-05-10 22:56:02,020: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:56:02.020781227Z [2024-05-10 22:56:02,020: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:56:02.020981580Z [2024-05-10 22:56:02,020: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:56:02.021018171Z [2024-05-10 22:56:02,020: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:56:02.021297155Z [2024-05-10 22:56:02,021: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:56:02.021366920Z [2024-05-10 22:56:02,021: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:56:02.106079894Z [2024-05-10 22:56:02,105: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:56:02.287681159Z [2024-05-10 22:56:02,287: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:56:02.291063358Z [2024-05-10 22:56:02,290: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:56:02.312485595Z [2024-05-10 22:56:02,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:56:02.313920578Z [2024-05-10 22:56:02,313: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:56:02.314078686Z [2024-05-10 22:56:02,313: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:56:02.314169787Z [2024-05-10 22:56:02,314: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:56:02.314223477Z [2024-05-10 22:56:02,314: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:56:02.314430617Z [2024-05-10 22:56:02,314: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:56:02.314503851Z [2024-05-10 22:56:02,314: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:56:02.409181793Z [2024-05-10 22:56:02,408: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:56:03.790168808Z [2024-05-10 22:56:03,789: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5947ce3-07f3-4012-ab7b-411e54a4259a] succeeded in 3.4602099120002094s: None 2024-05-10T22:56:03.863169994Z [2024-05-10 22:56:03,862: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f33e3141-b4f3-4afb-9348-191e8adedd82] succeeded in 3.5383160619999217s: None 2024-05-10T22:57:00.639364476Z [2024-05-10 22:57:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08fcdb44-a320-4666-a421-e485070a2882] received 2024-05-10T22:57:00.661334049Z [2024-05-10 22:57:00,661: INFO/ForkPoolWorker-15] [08fcdb44-a320-4666-a421-e485070a2882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:57:00.666092116Z [2024-05-10 22:57:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58ebf7e8-42f3-458c-b55f-4ee6768ed7eb] received 2024-05-10T22:57:00.687252525Z [2024-05-10 22:57:00,686: INFO/ForkPoolWorker-16] [58ebf7e8-42f3-458c-b55f-4ee6768ed7eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:57:00.701551505Z [2024-05-10 22:57:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2020f451-647d-4b47-8db4-8b370e4cd949] received 2024-05-10T22:57:00.723254097Z [2024-05-10 22:57:00,722: INFO/ForkPoolWorker-1] [2020f451-647d-4b47-8db4-8b370e4cd949] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:57:01.067905695Z [2024-05-10 22:57:01,063: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:57:01.142498493Z [2024-05-10 22:57:01,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:57:01.227364510Z [2024-05-10 22:57:01,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:57:01.356855969Z [2024-05-10 22:57:01,356: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T22:57:01.360911769Z [2024-05-10 22:57:01,360: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:57:01.379980621Z [2024-05-10 22:57:01,379: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:57:01.381726063Z [2024-05-10 22:57:01,381: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:57:01.381830478Z [2024-05-10 22:57:01,381: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:57:01.382009699Z [2024-05-10 22:57:01,381: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T22:57:01.382311057Z [2024-05-10 22:57:01,382: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:57:01.489640899Z [2024-05-10 22:57:01,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:57:02.046595403Z [2024-05-10 22:57:02,046: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58ebf7e8-42f3-458c-b55f-4ee6768ed7eb] succeeded in 1.3780424490000769s: None 2024-05-10T22:57:02.340567265Z [2024-05-10 22:57:02,340: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:57:02.343871968Z [2024-05-10 22:57:02,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:57:02.389143455Z [2024-05-10 22:57:02,388: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:57:02.390896850Z [2024-05-10 22:57:02,390: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:57:02.390915052Z [2024-05-10 22:57:02,390: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:57:02.391130133Z [2024-05-10 22:57:02,390: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:57:02.391205025Z [2024-05-10 22:57:02,391: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:57:02.391548323Z [2024-05-10 22:57:02,391: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:57:02.391665381Z [2024-05-10 22:57:02,391: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:57:02.499174385Z [2024-05-10 22:57:02,498: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:57:02.556919450Z [2024-05-10 22:57:02,556: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:57:02.560320691Z [2024-05-10 22:57:02,559: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:57:02.595202814Z [2024-05-10 22:57:02,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:57:02.597267536Z [2024-05-10 22:57:02,596: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:57:02.597327405Z [2024-05-10 22:57:02,597: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:57:02.597509104Z [2024-05-10 22:57:02,597: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:57:02.597551919Z [2024-05-10 22:57:02,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:57:02.597834503Z [2024-05-10 22:57:02,597: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:57:02.597925214Z [2024-05-10 22:57:02,597: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:57:02.698917041Z [2024-05-10 22:57:02,698: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:57:04.157366220Z [2024-05-10 22:57:04,156: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08fcdb44-a320-4666-a421-e485070a2882] succeeded in 3.5138759009996647s: None 2024-05-10T22:57:05.395404505Z [2024-05-10 22:57:05,394: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2020f451-647d-4b47-8db4-8b370e4cd949] succeeded in 4.6917274409997844s: None 2024-05-10T22:58:00.490185882Z [2024-05-10 22:58:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b06e19f-acbd-4d7a-aab6-f939a044da11] received 2024-05-10T22:58:00.494393702Z [2024-05-10 22:58:00,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0354293-2cbd-4db7-b2dd-b8dfe1074833] received 2024-05-10T22:58:00.505455667Z [2024-05-10 22:58:00,505: INFO/ForkPoolWorker-15] [1b06e19f-acbd-4d7a-aab6-f939a044da11] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:58:00.512874967Z [2024-05-10 22:58:00,512: INFO/ForkPoolWorker-16] [b0354293-2cbd-4db7-b2dd-b8dfe1074833] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T22:58:00.522681287Z [2024-05-10 22:58:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cb7bef2-5e17-4292-9f30-bb966c4a7293] received 2024-05-10T22:58:00.535066561Z [2024-05-10 22:58:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a5f253c-5734-466e-9abf-20066512c0b1] received 2024-05-10T22:58:00.544280266Z [2024-05-10 22:58:00,543: INFO/ForkPoolWorker-1] [8cb7bef2-5e17-4292-9f30-bb966c4a7293] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:58:00.549761838Z [2024-05-10 22:58:00,549: INFO/ForkPoolWorker-2] [1a5f253c-5734-466e-9abf-20066512c0b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:58:01.267981117Z [2024-05-10 22:58:01,261: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:58:01.345391282Z [2024-05-10 22:58:01,341: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:58:01.503667337Z [2024-05-10 22:58:01,503: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T22:58:01.512824600Z [2024-05-10 22:58:01,512: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:58:01.619828955Z [2024-05-10 22:58:01,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:58:01.624213498Z [2024-05-10 22:58:01,623: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:58:01.625807322Z [2024-05-10 22:58:01,624: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:58:01.625836092Z [2024-05-10 22:58:01,624: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T22:58:01.625844900Z [2024-05-10 22:58:01,624: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:58:01.871863547Z [2024-05-10 22:58:01,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:58:01.913273890Z [2024-05-10 22:58:01,894: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T22:58:02.149684557Z [2024-05-10 22:58:02,145: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:58:02.378251268Z [2024-05-10 22:58:02,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:58:03.170947633Z [2024-05-10 22:58:03,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b06e19f-acbd-4d7a-aab6-f939a044da11] succeeded in 2.679327910000211s: None 2024-05-10T22:58:04.920230350Z [2024-05-10 22:58:04,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0354293-2cbd-4db7-b2dd-b8dfe1074833] succeeded in 4.421983825999632s: None 2024-05-10T22:58:06.187136063Z [2024-05-10 22:58:06,186: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T22:58:06.190702468Z [2024-05-10 22:58:06,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:58:06.259933076Z [2024-05-10 22:58:06,259: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:58:06.266328778Z [2024-05-10 22:58:06,265: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:58:06.266494649Z [2024-05-10 22:58:06,266: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:58:06.266578723Z [2024-05-10 22:58:06,266: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:58:06.266629268Z [2024-05-10 22:58:06,266: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T22:58:06.266973254Z [2024-05-10 22:58:06,266: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:58:06.267005573Z [2024-05-10 22:58:06,266: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:58:06.636796048Z [2024-05-10 22:58:06,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:58:06.809756395Z [2024-05-10 22:58:06,808: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T22:58:06.818000138Z [2024-05-10 22:58:06,814: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:58:07.021822243Z [2024-05-10 22:58:07,021: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T22:58:07.030662937Z [2024-05-10 22:58:07,030: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:58:07.030677039Z [2024-05-10 22:58:07,030: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:58:07.031285707Z [2024-05-10 22:58:07,030: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:58:07.031296228Z [2024-05-10 22:58:07,030: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T22:58:07.031300301Z [2024-05-10 22:58:07,031: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:58:07.038280682Z [2024-05-10 22:58:07,031: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:58:07.699471595Z [2024-05-10 22:58:07,699: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:58:10.671298360Z [2024-05-10 22:58:10,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cb7bef2-5e17-4292-9f30-bb966c4a7293] succeeded in 10.132615198000167s: None 2024-05-10T22:58:11.374308758Z [2024-05-10 22:58:11,373: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1a5f253c-5734-466e-9abf-20066512c0b1] succeeded in 10.836633861999871s: None 2024-05-10T22:59:00.398429283Z [2024-05-10 22:59:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef605aea-a2e2-4a36-8490-7df0e920233a] received 2024-05-10T22:59:00.411364231Z [2024-05-10 22:59:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20c3a359-3f4b-428b-a32f-82ee15aac9f4] received 2024-05-10T22:59:00.417608780Z [2024-05-10 22:59:00,417: INFO/ForkPoolWorker-15] [ef605aea-a2e2-4a36-8490-7df0e920233a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T22:59:00.425642581Z [2024-05-10 22:59:00,425: INFO/ForkPoolWorker-16] [20c3a359-3f4b-428b-a32f-82ee15aac9f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T22:59:00.427361143Z [2024-05-10 22:59:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29feccc0-a8c9-43b9-93d8-7c08771ea548] received 2024-05-10T22:59:00.474899208Z [2024-05-10 22:59:00,474: INFO/ForkPoolWorker-1] [29feccc0-a8c9-43b9-93d8-7c08771ea548] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T22:59:00.938440763Z [2024-05-10 22:59:00,929: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T22:59:01.188816930Z [2024-05-10 22:59:01,173: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T22:59:01.196134574Z [2024-05-10 22:59:01,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T22:59:01.454142735Z [2024-05-10 22:59:01,453: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T22:59:01.461348145Z [2024-05-10 22:59:01,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:59:01.537308462Z [2024-05-10 22:59:01,536: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T22:59:01.539571783Z [2024-05-10 22:59:01,539: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T22:59:01.539627345Z [2024-05-10 22:59:01,539: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T22:59:01.539679311Z [2024-05-10 22:59:01,539: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T22:59:01.539894684Z [2024-05-10 22:59:01,539: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T22:59:01.671377752Z [2024-05-10 22:59:01,671: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:59:02.395259815Z [2024-05-10 22:59:02,394: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29feccc0-a8c9-43b9-93d8-7c08771ea548] succeeded in 1.9649657289996867s: None 2024-05-10T22:59:02.560917004Z [2024-05-10 22:59:02,560: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T22:59:02.564966836Z [2024-05-10 22:59:02,564: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:59:02.590183220Z [2024-05-10 22:59:02,589: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T22:59:02.591851028Z [2024-05-10 22:59:02,591: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:59:02.591982612Z [2024-05-10 22:59:02,591: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:59:02.592237323Z [2024-05-10 22:59:02,591: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:59:02.592350861Z [2024-05-10 22:59:02,592: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T22:59:02.592822649Z [2024-05-10 22:59:02,592: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T22:59:02.592845813Z [2024-05-10 22:59:02,592: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:59:02.727665087Z [2024-05-10 22:59:02,727: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:59:02.771279810Z [2024-05-10 22:59:02,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T22:59:02.775516000Z [2024-05-10 22:59:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T22:59:02.819499738Z [2024-05-10 22:59:02,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T22:59:02.822877460Z [2024-05-10 22:59:02,822: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T22:59:02.822924381Z [2024-05-10 22:59:02,822: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T22:59:02.823235221Z [2024-05-10 22:59:02,822: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T22:59:02.823340018Z [2024-05-10 22:59:02,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T22:59:02.824117671Z [2024-05-10 22:59:02,823: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T22:59:02.824276868Z [2024-05-10 22:59:02,824: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T22:59:02.935218270Z [2024-05-10 22:59:02,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T22:59:05.222748354Z [2024-05-10 22:59:05,222: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20c3a359-3f4b-428b-a32f-82ee15aac9f4] succeeded in 4.807766177999838s: None 2024-05-10T22:59:05.569489918Z [2024-05-10 22:59:05,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef605aea-a2e2-4a36-8490-7df0e920233a] succeeded in 5.1667215399997986s: None 2024-05-10T23:00:00.754259677Z [2024-05-10 23:00:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9596ac66-fce1-4439-9ac4-736eecd67267] received 2024-05-10T23:00:00.756012693Z [2024-05-10 23:00:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[276e2243-eeb4-486a-ad55-a009a627aea2] received 2024-05-10T23:00:00.757808506Z [2024-05-10 23:00:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6079ede-14b6-4d63-9d1f-d9cfbb6c2b93] received 2024-05-10T23:00:00.764441082Z [2024-05-10 23:00:00,764: INFO/ForkPoolWorker-15] [9596ac66-fce1-4439-9ac4-736eecd67267] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:00:00.766831681Z [2024-05-10 23:00:00,766: INFO/ForkPoolWorker-1] [f6079ede-14b6-4d63-9d1f-d9cfbb6c2b93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:00.770013547Z [2024-05-10 23:00:00,768: INFO/ForkPoolWorker-16] [276e2243-eeb4-486a-ad55-a009a627aea2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:00:00.773574520Z [2024-05-10 23:00:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d4cefb-b724-4af0-b9fe-2323659a715b] received 2024-05-10T23:00:00.777190659Z [2024-05-10 23:00:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a412c1d8-2b10-44cb-9505-6490f2f03466] received 2024-05-10T23:00:00.787727183Z [2024-05-10 23:00:00,787: INFO/ForkPoolWorker-3] [a412c1d8-2b10-44cb-9505-6490f2f03466] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:00:00.787759928Z [2024-05-10 23:00:00,787: INFO/ForkPoolWorker-2] [20d4cefb-b724-4af0-b9fe-2323659a715b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:00:01.149624052Z [2024-05-10 23:00:01,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:00:01.227440707Z [2024-05-10 23:00:01,221: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:00:01.520875164Z [2024-05-10 23:00:01,503: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:00:01.533714283Z [2024-05-10 23:00:01,533: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:00:01.535705399Z [2024-05-10 23:00:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:00:01.538770766Z [2024-05-10 23:00:01,538: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:01.582309376Z [2024-05-10 23:00:01,582: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:00:01.587640949Z [2024-05-10 23:00:01,587: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:00:01.588178917Z [2024-05-10 23:00:01,587: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:00:01.588531610Z [2024-05-10 23:00:01,588: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:00:01.588955645Z [2024-05-10 23:00:01,588: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:00:01.617069581Z [2024-05-10 23:00:01,612: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:00:01.744888842Z [2024-05-10 23:00:01,744: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:02.105274409Z [2024-05-10 23:00:02,105: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:02.722337548Z [2024-05-10 23:00:02,721: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20d4cefb-b724-4af0-b9fe-2323659a715b] succeeded in 1.9430180470003506s: None 2024-05-10T23:00:02.754733459Z [2024-05-10 23:00:02,754: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:00:02.758550462Z [2024-05-10 23:00:02,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:02.786972540Z [2024-05-10 23:00:02,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:00:02.788111460Z [2024-05-10 23:00:02,787: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:02.788168116Z [2024-05-10 23:00:02,788: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:02.788380356Z [2024-05-10 23:00:02,788: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:02.788453747Z [2024-05-10 23:00:02,788: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:00:02.788860966Z [2024-05-10 23:00:02,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:00:02.788869718Z [2024-05-10 23:00:02,788: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:02.860660867Z [2024-05-10 23:00:02,860: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a412c1d8-2b10-44cb-9505-6490f2f03466] succeeded in 2.0811848339999415s: None 2024-05-10T23:00:02.895580097Z [2024-05-10 23:00:02,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:03.339164551Z [2024-05-10 23:00:03,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:00:03.343472468Z [2024-05-10 23:00:03,343: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:03.366705392Z [2024-05-10 23:00:03,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:00:03.367752747Z [2024-05-10 23:00:03,367: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:03.367948233Z [2024-05-10 23:00:03,367: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:03.368117880Z [2024-05-10 23:00:03,367: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:03.368128619Z [2024-05-10 23:00:03,367: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:00:03.368411215Z [2024-05-10 23:00:03,368: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:00:03.368427431Z [2024-05-10 23:00:03,368: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:03.430154164Z [2024-05-10 23:00:03,429: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:00:03.433621079Z [2024-05-10 23:00:03,432: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:03.452631511Z [2024-05-10 23:00:03,452: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:03.456737734Z [2024-05-10 23:00:03,456: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:00:03.458500681Z [2024-05-10 23:00:03,458: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:03.458732700Z [2024-05-10 23:00:03,458: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:03.458824201Z [2024-05-10 23:00:03,458: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:03.458961793Z [2024-05-10 23:00:03,458: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:00:03.459513098Z [2024-05-10 23:00:03,459: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:00:03.459649194Z [2024-05-10 23:00:03,459: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:03.596228712Z [2024-05-10 23:00:03,595: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:04.198955678Z [2024-05-10 23:00:04,198: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6079ede-14b6-4d63-9d1f-d9cfbb6c2b93] succeeded in 3.439749500999824s: None 2024-05-10T23:00:04.487330290Z [2024-05-10 23:00:04,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9596ac66-fce1-4439-9ac4-736eecd67267] succeeded in 3.73112318099993s: None 2024-05-10T23:00:04.834779203Z [2024-05-10 23:00:04,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f53e87ce-4510-4a1e-9280-ef6cbb318530] received 2024-05-10T23:00:04.844921400Z [2024-05-10 23:00:04,844: INFO/ForkPoolWorker-15] [f53e87ce-4510-4a1e-9280-ef6cbb318530] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:05.124703878Z [2024-05-10 23:00:05,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:00:05.353580554Z [2024-05-10 23:00:05,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[276e2243-eeb4-486a-ad55-a009a627aea2] succeeded in 4.595604653999999s: None 2024-05-10T23:00:06.264159109Z [2024-05-10 23:00:06,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:00:06.267520781Z [2024-05-10 23:00:06,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:06.287676850Z [2024-05-10 23:00:06,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:00:06.288889637Z [2024-05-10 23:00:06,288: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:06.288901147Z [2024-05-10 23:00:06,288: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:06.289081098Z [2024-05-10 23:00:06,288: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:06.289091110Z [2024-05-10 23:00:06,288: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:00:06.289281568Z [2024-05-10 23:00:06,289: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:00:06.289312014Z [2024-05-10 23:00:06,289: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:06.402392178Z [2024-05-10 23:00:06,402: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:07.116558469Z [2024-05-10 23:00:07,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f53e87ce-4510-4a1e-9280-ef6cbb318530] succeeded in 2.27913421500034s: None 2024-05-10T23:00:07.218535277Z [2024-05-10 23:00:07,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9adba6b-3bbe-4d74-8d2f-27df1ca1799d] received 2024-05-10T23:00:07.227335454Z [2024-05-10 23:00:07,227: INFO/ForkPoolWorker-15] [e9adba6b-3bbe-4d74-8d2f-27df1ca1799d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:00:07.543210876Z [2024-05-10 23:00:07,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:00:08.698014588Z [2024-05-10 23:00:08,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:00:08.702231975Z [2024-05-10 23:00:08,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:08.720706505Z [2024-05-10 23:00:08,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:00:08.721821238Z [2024-05-10 23:00:08,721: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:08.721933164Z [2024-05-10 23:00:08,721: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:08.722107946Z [2024-05-10 23:00:08,721: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:08.722173293Z [2024-05-10 23:00:08,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:00:08.722511624Z [2024-05-10 23:00:08,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:00:08.722552736Z [2024-05-10 23:00:08,722: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:08.818380164Z [2024-05-10 23:00:08,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:09.453059047Z [2024-05-10 23:00:09,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9adba6b-3bbe-4d74-8d2f-27df1ca1799d] succeeded in 2.232209750000038s: None 2024-05-10T23:00:09.618493535Z [2024-05-10 23:00:09,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c353ba09-fea9-4ff1-8ae2-a3db047c5b40] received 2024-05-10T23:00:09.625119265Z [2024-05-10 23:00:09,624: INFO/ForkPoolWorker-15] [c353ba09-fea9-4ff1-8ae2-a3db047c5b40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:00:09.981897504Z [2024-05-10 23:00:09,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:00:11.152668597Z [2024-05-10 23:00:11,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:00:11.156768143Z [2024-05-10 23:00:11,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:00:11.187215083Z [2024-05-10 23:00:11,187: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:00:11.188487476Z [2024-05-10 23:00:11,188: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:00:11.188544785Z [2024-05-10 23:00:11,188: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:00:11.188723612Z [2024-05-10 23:00:11,188: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:00:11.188819937Z [2024-05-10 23:00:11,188: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:00:11.189074810Z [2024-05-10 23:00:11,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:00:11.189126629Z [2024-05-10 23:00:11,189: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:00:11.283393157Z [2024-05-10 23:00:11,282: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:00:11.933804067Z [2024-05-10 23:00:11,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c353ba09-fea9-4ff1-8ae2-a3db047c5b40] succeeded in 2.313885960999869s: None 2024-05-10T23:01:01.239361074Z [2024-05-10 23:01:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33829e27-63e4-4092-841d-731aba04fcf7] received 2024-05-10T23:01:01.247227227Z [2024-05-10 23:01:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d2e38f7-3381-49f7-a5e4-fba1c96eb324] received 2024-05-10T23:01:01.248558063Z [2024-05-10 23:01:01,248: INFO/ForkPoolWorker-15] [33829e27-63e4-4092-841d-731aba04fcf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:01:01.249900983Z [2024-05-10 23:01:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72e076aa-3b1a-4844-91a0-e4076ed4238b] received 2024-05-10T23:01:01.258326146Z [2024-05-10 23:01:01,258: INFO/ForkPoolWorker-1] [72e076aa-3b1a-4844-91a0-e4076ed4238b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:01:01.262664534Z [2024-05-10 23:01:01,262: INFO/ForkPoolWorker-16] [9d2e38f7-3381-49f7-a5e4-fba1c96eb324] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:01:01.557629137Z [2024-05-10 23:01:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:01:01.574788260Z [2024-05-10 23:01:01,570: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:01:01.575364008Z [2024-05-10 23:01:01,571: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:01:01.729024321Z [2024-05-10 23:01:01,728: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:01:01.733582549Z [2024-05-10 23:01:01,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:01:01.763230119Z [2024-05-10 23:01:01,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:01:01.771269262Z [2024-05-10 23:01:01,770: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:01:01.771315242Z [2024-05-10 23:01:01,771: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:01:01.771337478Z [2024-05-10 23:01:01,771: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:01:01.771555416Z [2024-05-10 23:01:01,771: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:01:01.922513885Z [2024-05-10 23:01:01,922: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:01:02.713416244Z [2024-05-10 23:01:02,712: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72e076aa-3b1a-4844-91a0-e4076ed4238b] succeeded in 1.4617177720001564s: None 2024-05-10T23:01:02.909984450Z [2024-05-10 23:01:02,909: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:01:02.914375486Z [2024-05-10 23:01:02,913: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:01:02.959912440Z [2024-05-10 23:01:02,958: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:01:02.961374321Z [2024-05-10 23:01:02,961: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:01:02.961504246Z [2024-05-10 23:01:02,961: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:01:02.961925931Z [2024-05-10 23:01:02,961: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:01:02.962209021Z [2024-05-10 23:01:02,961: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:01:02.962669495Z [2024-05-10 23:01:02,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:01:02.962998379Z [2024-05-10 23:01:02,962: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:01:02.964592732Z [2024-05-10 23:01:02,962: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:01:02.971291839Z [2024-05-10 23:01:02,970: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:01:03.014948047Z [2024-05-10 23:01:03,014: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:01:03.016863940Z [2024-05-10 23:01:03,016: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:01:03.016938620Z [2024-05-10 23:01:03,016: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:01:03.016960212Z [2024-05-10 23:01:03,016: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:01:03.017103667Z [2024-05-10 23:01:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:01:03.020122367Z [2024-05-10 23:01:03,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:01:03.020313176Z [2024-05-10 23:01:03,020: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:01:03.096315892Z [2024-05-10 23:01:03,095: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:01:03.147134441Z [2024-05-10 23:01:03,146: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:01:04.632414777Z [2024-05-10 23:01:04,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33829e27-63e4-4092-841d-731aba04fcf7] succeeded in 3.3911701500001072s: None 2024-05-10T23:01:05.130937073Z [2024-05-10 23:01:05,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d2e38f7-3381-49f7-a5e4-fba1c96eb324] succeeded in 3.874813996999819s: None 2024-05-10T23:02:00.568013953Z [2024-05-10 23:02:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb9f6b29-748f-4fd1-ade8-0db94ca80c8e] received 2024-05-10T23:02:00.572692822Z [2024-05-10 23:02:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab8b5411-e20e-468d-aed6-09f32b82afa4] received 2024-05-10T23:02:00.581581253Z [2024-05-10 23:02:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f79a1c05-4efd-4af9-8492-399fe0986c18] received 2024-05-10T23:02:00.582082277Z [2024-05-10 23:02:00,581: INFO/ForkPoolWorker-16] [ab8b5411-e20e-468d-aed6-09f32b82afa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:02:00.583301018Z [2024-05-10 23:02:00,583: INFO/ForkPoolWorker-15] [fb9f6b29-748f-4fd1-ade8-0db94ca80c8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:02:00.583847430Z [2024-05-10 23:02:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efd979c0-cc1e-474f-b775-ac912ac1bf58] received 2024-05-10T23:02:00.593198732Z [2024-05-10 23:02:00,592: INFO/ForkPoolWorker-2] [efd979c0-cc1e-474f-b775-ac912ac1bf58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:02:00.620461010Z [2024-05-10 23:02:00,620: INFO/ForkPoolWorker-1] [f79a1c05-4efd-4af9-8492-399fe0986c18] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:02:00.882606183Z [2024-05-10 23:02:00,879: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:02:00.919836753Z [2024-05-10 23:02:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:02:00.920248883Z [2024-05-10 23:02:00,914: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:02:01.059111553Z [2024-05-10 23:02:01,055: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:02:01.289382374Z [2024-05-10 23:02:01,288: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:02:01.294360838Z [2024-05-10 23:02:01,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:02:01.318968148Z [2024-05-10 23:02:01,318: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:02:01.320546150Z [2024-05-10 23:02:01,320: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:02:01.320796606Z [2024-05-10 23:02:01,320: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:02:01.320996291Z [2024-05-10 23:02:01,320: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:02:01.321611878Z [2024-05-10 23:02:01,321: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:02:01.408208382Z [2024-05-10 23:02:01,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:02:01.462792276Z [2024-05-10 23:02:01,462: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:02:01.996256041Z [2024-05-10 23:02:01,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb9f6b29-748f-4fd1-ade8-0db94ca80c8e] succeeded in 1.4217691940002624s: None 2024-05-10T23:02:02.132790044Z [2024-05-10 23:02:02,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f79a1c05-4efd-4af9-8492-399fe0986c18] succeeded in 1.5479056389999641s: None 2024-05-10T23:02:02.400215149Z [2024-05-10 23:02:02,399: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:02:02.403857359Z [2024-05-10 23:02:02,403: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:02:02.429472777Z [2024-05-10 23:02:02,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:02:02.434446349Z [2024-05-10 23:02:02,434: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:02:02.434730218Z [2024-05-10 23:02:02,434: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:02:02.435070555Z [2024-05-10 23:02:02,434: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:02:02.435280697Z [2024-05-10 23:02:02,435: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:02:02.435886477Z [2024-05-10 23:02:02,435: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:02:02.436135298Z [2024-05-10 23:02:02,435: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:02:02.504944005Z [2024-05-10 23:02:02,504: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:02:02.509833464Z [2024-05-10 23:02:02,509: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:02:02.543326895Z [2024-05-10 23:02:02,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:02:02.548537831Z [2024-05-10 23:02:02,548: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:02:02.550183374Z [2024-05-10 23:02:02,549: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:02:02.550276210Z [2024-05-10 23:02:02,550: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:02:02.550573446Z [2024-05-10 23:02:02,550: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:02:02.550592180Z [2024-05-10 23:02:02,550: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:02:02.551103910Z [2024-05-10 23:02:02,550: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:02:02.551174861Z [2024-05-10 23:02:02,551: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:02:02.677768098Z [2024-05-10 23:02:02,677: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:02:04.119369189Z [2024-05-10 23:02:04,118: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab8b5411-e20e-468d-aed6-09f32b82afa4] succeeded in 3.5433376010000757s: None 2024-05-10T23:02:04.618283744Z [2024-05-10 23:02:04,617: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[efd979c0-cc1e-474f-b775-ac912ac1bf58] succeeded in 4.031759752000198s: None 2024-05-10T23:03:00.218852942Z [2024-05-10 23:03:00,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07545613-6dce-4869-8e01-b55d0c77c645] received 2024-05-10T23:03:00.222242618Z [2024-05-10 23:03:00,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[731e030a-a5d6-4350-a08d-5cddf0c73022] received 2024-05-10T23:03:00.228906193Z [2024-05-10 23:03:00,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3c1ea61-dff4-41d6-9a8c-93ebbc7f1503] received 2024-05-10T23:03:00.233470863Z [2024-05-10 23:03:00,233: INFO/ForkPoolWorker-15] [07545613-6dce-4869-8e01-b55d0c77c645] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:03:00.236394584Z [2024-05-10 23:03:00,236: INFO/ForkPoolWorker-16] [731e030a-a5d6-4350-a08d-5cddf0c73022] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:03:00.237588334Z [2024-05-10 23:03:00,237: INFO/ForkPoolWorker-1] [f3c1ea61-dff4-41d6-9a8c-93ebbc7f1503] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:03:00.555648682Z [2024-05-10 23:03:00,551: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:03:00.622236701Z [2024-05-10 23:03:00,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:03:00.631770465Z [2024-05-10 23:03:00,628: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:03:00.723263245Z [2024-05-10 23:03:00,722: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:03:00.727558652Z [2024-05-10 23:03:00,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:03:00.749584845Z [2024-05-10 23:03:00,749: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:03:00.750984611Z [2024-05-10 23:03:00,750: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:03:00.751611109Z [2024-05-10 23:03:00,751: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:03:00.751654425Z [2024-05-10 23:03:00,751: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:03:00.751904127Z [2024-05-10 23:03:00,751: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:03:00.872410496Z [2024-05-10 23:03:00,872: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:03:01.577068569Z [2024-05-10 23:03:01,576: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3c1ea61-dff4-41d6-9a8c-93ebbc7f1503] succeeded in 1.3467060329999185s: None 2024-05-10T23:03:01.919282838Z [2024-05-10 23:03:01,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:03:01.922605240Z [2024-05-10 23:03:01,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:03:01.936961782Z [2024-05-10 23:03:01,936: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:03:01.940987603Z [2024-05-10 23:03:01,940: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:03:01.941134964Z [2024-05-10 23:03:01,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:03:01.942269863Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:03:01.942297637Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:03:01.942378597Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:03:01.942427971Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:03:01.942623842Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:03:01.942635573Z [2024-05-10 23:03:01,942: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:03:01.963863191Z [2024-05-10 23:03:01,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:03:01.965475429Z [2024-05-10 23:03:01,965: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:03:01.965668114Z [2024-05-10 23:03:01,965: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:03:01.965925946Z [2024-05-10 23:03:01,965: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:03:01.966109887Z [2024-05-10 23:03:01,965: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:03:01.966506263Z [2024-05-10 23:03:01,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:03:01.966654010Z [2024-05-10 23:03:01,966: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:03:02.027708512Z [2024-05-10 23:03:02,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:03:02.066641511Z [2024-05-10 23:03:02,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:03:03.756071127Z [2024-05-10 23:03:03,755: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07545613-6dce-4869-8e01-b55d0c77c645] succeeded in 3.529190395999649s: None 2024-05-10T23:03:05.834333659Z [2024-05-10 23:03:05,833: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[731e030a-a5d6-4350-a08d-5cddf0c73022] succeeded in 5.607023022000249s: None 2024-05-10T23:04:00.553775705Z [2024-05-10 23:04:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b91396c-abd5-4e8d-8aba-a4ae0fc425b4] received 2024-05-10T23:04:00.559112013Z [2024-05-10 23:04:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31666330-0c23-430a-b6fe-27138b21bddb] received 2024-05-10T23:04:00.565493019Z [2024-05-10 23:04:00,565: INFO/ForkPoolWorker-15] [6b91396c-abd5-4e8d-8aba-a4ae0fc425b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:04:00.569975185Z [2024-05-10 23:04:00,569: INFO/ForkPoolWorker-16] [31666330-0c23-430a-b6fe-27138b21bddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:04:00.584989444Z [2024-05-10 23:04:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c191060-a534-425f-b627-dc210968f40f] received 2024-05-10T23:04:00.586679752Z [2024-05-10 23:04:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7fe0c5d-d78d-4c76-a5f3-ba29b8dba340] received 2024-05-10T23:04:00.591448441Z [2024-05-10 23:04:00,591: INFO/ForkPoolWorker-1] [1c191060-a534-425f-b627-dc210968f40f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:04:00.613485066Z [2024-05-10 23:04:00,613: INFO/ForkPoolWorker-2] [a7fe0c5d-d78d-4c76-a5f3-ba29b8dba340] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:04:00.893308486Z [2024-05-10 23:04:00,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:04:00.915533842Z [2024-05-10 23:04:00,911: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:04:00.993520907Z [2024-05-10 23:04:00,984: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:04:01.121975013Z [2024-05-10 23:04:01,116: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:04:01.125977838Z [2024-05-10 23:04:01,124: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:04:01.205962821Z [2024-05-10 23:04:01,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:04:01.257836667Z [2024-05-10 23:04:01,257: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:04:01.258254821Z [2024-05-10 23:04:01,258: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:04:01.258501868Z [2024-05-10 23:04:01,258: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:04:01.258732681Z [2024-05-10 23:04:01,258: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:04:01.277211079Z [2024-05-10 23:04:01,272: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:04:01.330051956Z [2024-05-10 23:04:01,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:04:01.396898450Z [2024-05-10 23:04:01,396: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:04:01.952747670Z [2024-05-10 23:04:01,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31666330-0c23-430a-b6fe-27138b21bddb] succeeded in 1.3911653639997894s: None 2024-05-10T23:04:01.953519823Z [2024-05-10 23:04:01,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b91396c-abd5-4e8d-8aba-a4ae0fc425b4] succeeded in 1.3968953509997846s: None 2024-05-10T23:04:02.421348423Z [2024-05-10 23:04:02,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:04:02.424458000Z [2024-05-10 23:04:02,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:04:02.443508884Z [2024-05-10 23:04:02,443: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:04:02.445211421Z [2024-05-10 23:04:02,444: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:04:02.445244844Z [2024-05-10 23:04:02,445: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:04:02.445449870Z [2024-05-10 23:04:02,445: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:04:02.445618791Z [2024-05-10 23:04:02,445: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:04:02.446168060Z [2024-05-10 23:04:02,445: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:04:02.446312757Z [2024-05-10 23:04:02,446: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:04:02.560958868Z [2024-05-10 23:04:02,560: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:04:02.674271795Z [2024-05-10 23:04:02,673: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:04:02.678122356Z [2024-05-10 23:04:02,677: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:04:02.698839343Z [2024-05-10 23:04:02,698: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:04:02.700462585Z [2024-05-10 23:04:02,700: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:04:02.700709819Z [2024-05-10 23:04:02,700: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:04:02.700989558Z [2024-05-10 23:04:02,700: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:04:02.701209921Z [2024-05-10 23:04:02,701: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:04:02.701607580Z [2024-05-10 23:04:02,701: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:04:02.701934893Z [2024-05-10 23:04:02,701: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:04:02.792595274Z [2024-05-10 23:04:02,792: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:04:04.303697825Z [2024-05-10 23:04:04,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c191060-a534-425f-b627-dc210968f40f] succeeded in 3.7168395970002166s: None 2024-05-10T23:04:04.386507151Z [2024-05-10 23:04:04,386: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a7fe0c5d-d78d-4c76-a5f3-ba29b8dba340] succeeded in 3.791157170999668s: None 2024-05-10T23:05:00.767484558Z [2024-05-10 23:05:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d48eefb-4323-4230-85bb-52ebac08a021] received 2024-05-10T23:05:00.773372188Z [2024-05-10 23:05:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b975353-0175-4b10-b8ff-9b477f4e0d78] received 2024-05-10T23:05:00.777310410Z [2024-05-10 23:05:00,777: INFO/ForkPoolWorker-15] [9d48eefb-4323-4230-85bb-52ebac08a021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:00.782122688Z [2024-05-10 23:05:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a65f156-dc4d-44d6-82c9-a2bf64e34feb] received 2024-05-10T23:05:00.783095408Z [2024-05-10 23:05:00,782: INFO/ForkPoolWorker-16] [0b975353-0175-4b10-b8ff-9b477f4e0d78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:05:00.785439889Z [2024-05-10 23:05:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72f9d956-2f70-43f3-bc97-4d5311f539b6] received 2024-05-10T23:05:00.795667150Z [2024-05-10 23:05:00,795: INFO/ForkPoolWorker-1] [4a65f156-dc4d-44d6-82c9-a2bf64e34feb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:05:00.796206045Z [2024-05-10 23:05:00,795: INFO/ForkPoolWorker-2] [72f9d956-2f70-43f3-bc97-4d5311f539b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:05:01.191976948Z [2024-05-10 23:05:01,188: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:05:01.260178825Z [2024-05-10 23:05:01,252: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:05:01.265782856Z [2024-05-10 23:05:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:05:01.422088106Z [2024-05-10 23:05:01,418: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:05:01.520515910Z [2024-05-10 23:05:01,520: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:05:01.524521402Z [2024-05-10 23:05:01,524: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:01.559737699Z [2024-05-10 23:05:01,559: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:05:01.562892202Z [2024-05-10 23:05:01,562: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:05:01.563182298Z [2024-05-10 23:05:01,562: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:05:01.563369807Z [2024-05-10 23:05:01,563: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:05:01.563883447Z [2024-05-10 23:05:01,563: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:05:01.704585351Z [2024-05-10 23:05:01,704: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:02.329964051Z [2024-05-10 23:05:02,329: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b975353-0175-4b10-b8ff-9b477f4e0d78] succeeded in 1.5545604339999954s: None 2024-05-10T23:05:02.702694157Z [2024-05-10 23:05:02,702: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:05:02.706172026Z [2024-05-10 23:05:02,705: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:02.738688874Z [2024-05-10 23:05:02,738: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:05:02.743269600Z [2024-05-10 23:05:02,742: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:02.743295243Z [2024-05-10 23:05:02,743: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:02.743452059Z [2024-05-10 23:05:02,743: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:02.743495058Z [2024-05-10 23:05:02,743: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:05:02.743826864Z [2024-05-10 23:05:02,743: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:05:02.743885159Z [2024-05-10 23:05:02,743: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:02.780988398Z [2024-05-10 23:05:02,780: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:05:02.784428173Z [2024-05-10 23:05:02,783: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:02.835318931Z [2024-05-10 23:05:02,835: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:05:02.836558903Z [2024-05-10 23:05:02,836: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:02.836614221Z [2024-05-10 23:05:02,836: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:02.836850260Z [2024-05-10 23:05:02,836: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:02.836870722Z [2024-05-10 23:05:02,836: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:05:02.837100831Z [2024-05-10 23:05:02,836: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:05:02.837179902Z [2024-05-10 23:05:02,837: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:02.847545303Z [2024-05-10 23:05:02,847: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:02.930739600Z [2024-05-10 23:05:02,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:02.938884456Z [2024-05-10 23:05:02,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:05:02.944107653Z [2024-05-10 23:05:02,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:02.963518934Z [2024-05-10 23:05:02,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:05:02.964792519Z [2024-05-10 23:05:02,964: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:02.964935784Z [2024-05-10 23:05:02,964: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:02.965490274Z [2024-05-10 23:05:02,965: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:02.965587899Z [2024-05-10 23:05:02,965: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:05:02.966190816Z [2024-05-10 23:05:02,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:05:02.966336600Z [2024-05-10 23:05:02,966: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:03.062551857Z [2024-05-10 23:05:03,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:03.754836085Z [2024-05-10 23:05:03,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23c37d84-aa65-449d-a825-562ecabcade6] received 2024-05-10T23:05:03.763725012Z [2024-05-10 23:05:03,763: INFO/ForkPoolWorker-16] [23c37d84-aa65-449d-a825-562ecabcade6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:03.807988782Z [2024-05-10 23:05:03,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d48eefb-4323-4230-85bb-52ebac08a021] succeeded in 3.03607313800012s: None 2024-05-10T23:05:04.053441320Z [2024-05-10 23:05:04,050: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:05:04.529711743Z [2024-05-10 23:05:04,529: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a65f156-dc4d-44d6-82c9-a2bf64e34feb] succeeded in 3.7452352810000775s: None 2024-05-10T23:05:05.266379715Z [2024-05-10 23:05:05,265: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:05:05.269663757Z [2024-05-10 23:05:05,269: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:05.287279948Z [2024-05-10 23:05:05,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:05:05.288646788Z [2024-05-10 23:05:05,288: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:05.288802623Z [2024-05-10 23:05:05,288: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:05.288916893Z [2024-05-10 23:05:05,288: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:05.288925510Z [2024-05-10 23:05:05,288: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:05:05.289128121Z [2024-05-10 23:05:05,288: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:05:05.289230526Z [2024-05-10 23:05:05,289: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:05.385621212Z [2024-05-10 23:05:05,385: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:06.107747272Z [2024-05-10 23:05:06,107: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23c37d84-aa65-449d-a825-562ecabcade6] succeeded in 2.351040312999885s: None 2024-05-10T23:05:06.150456182Z [2024-05-10 23:05:06,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa691ecf-5b5a-4586-a864-79f286698a39] received 2024-05-10T23:05:06.175418147Z [2024-05-10 23:05:06,175: INFO/ForkPoolWorker-15] [fa691ecf-5b5a-4586-a864-79f286698a39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:05:06.288532813Z [2024-05-10 23:05:06,288: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[72f9d956-2f70-43f3-bc97-4d5311f539b6] succeeded in 5.500284277999981s: None 2024-05-10T23:05:06.474368227Z [2024-05-10 23:05:06,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:05:07.722968415Z [2024-05-10 23:05:07,722: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:05:07.726540166Z [2024-05-10 23:05:07,726: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:07.745004214Z [2024-05-10 23:05:07,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:05:07.746722469Z [2024-05-10 23:05:07,746: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:07.746845275Z [2024-05-10 23:05:07,746: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:07.747017376Z [2024-05-10 23:05:07,746: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:07.747114923Z [2024-05-10 23:05:07,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:05:07.747413333Z [2024-05-10 23:05:07,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:05:07.747510164Z [2024-05-10 23:05:07,747: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:07.837195431Z [2024-05-10 23:05:07,836: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:08.426019798Z [2024-05-10 23:05:08,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa691ecf-5b5a-4586-a864-79f286698a39] succeeded in 2.273992331000045s: None 2024-05-10T23:05:08.816389169Z [2024-05-10 23:05:08,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571d2a28-51c3-4ad3-bc0b-43e7e369a037] received 2024-05-10T23:05:08.825950923Z [2024-05-10 23:05:08,825: INFO/ForkPoolWorker-15] [571d2a28-51c3-4ad3-bc0b-43e7e369a037] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:05:09.175231802Z [2024-05-10 23:05:09,172: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:05:10.244762356Z [2024-05-10 23:05:10,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:05:10.248397306Z [2024-05-10 23:05:10,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:05:10.264200031Z [2024-05-10 23:05:10,263: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:05:10.265416775Z [2024-05-10 23:05:10,265: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:05:10.265540543Z [2024-05-10 23:05:10,265: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:05:10.265756843Z [2024-05-10 23:05:10,265: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:05:10.265896922Z [2024-05-10 23:05:10,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:05:10.266508960Z [2024-05-10 23:05:10,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:05:10.266639205Z [2024-05-10 23:05:10,266: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:05:10.351865863Z [2024-05-10 23:05:10,351: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:05:10.937701128Z [2024-05-10 23:05:10,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[571d2a28-51c3-4ad3-bc0b-43e7e369a037] succeeded in 2.1193947060000937s: None 2024-05-10T23:06:01.150946418Z [2024-05-10 23:06:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddb4ff5d-6360-48ec-8648-200d151fa302] received 2024-05-10T23:06:01.154860359Z [2024-05-10 23:06:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4ec2f8a-cfed-4041-8540-1c5ee48c55cb] received 2024-05-10T23:06:01.161668681Z [2024-05-10 23:06:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e669d698-5634-4669-a502-8cc14d4ee02b] received 2024-05-10T23:06:01.171294459Z [2024-05-10 23:06:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4798f16c-0066-48ef-87dc-81c33bbc58ea] received 2024-05-10T23:06:01.184819047Z [2024-05-10 23:06:01,184: INFO/ForkPoolWorker-15] [ddb4ff5d-6360-48ec-8648-200d151fa302] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:06:01.192145956Z [2024-05-10 23:06:01,191: INFO/ForkPoolWorker-1] [e669d698-5634-4669-a502-8cc14d4ee02b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:06:01.213960628Z [2024-05-10 23:06:01,213: INFO/ForkPoolWorker-2] [4798f16c-0066-48ef-87dc-81c33bbc58ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:06:01.225032928Z [2024-05-10 23:06:01,224: INFO/ForkPoolWorker-16] [d4ec2f8a-cfed-4041-8540-1c5ee48c55cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:06:01.530826747Z [2024-05-10 23:06:01,526: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:06:01.675932252Z [2024-05-10 23:06:01,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:06:01.715688725Z [2024-05-10 23:06:01,705: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:06:01.747422706Z [2024-05-10 23:06:01,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:06:02.056027877Z [2024-05-10 23:06:02,055: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:06:02.056707272Z [2024-05-10 23:06:02,056: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:06:02.060586330Z [2024-05-10 23:06:02,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:06:02.113018052Z [2024-05-10 23:06:02,112: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:06:02.116079612Z [2024-05-10 23:06:02,115: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:06:02.116227776Z [2024-05-10 23:06:02,115: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:06:02.116333340Z [2024-05-10 23:06:02,116: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:06:02.116607198Z [2024-05-10 23:06:02,116: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:06:02.233837303Z [2024-05-10 23:06:02,233: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:06:02.944613809Z [2024-05-10 23:06:02,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e669d698-5634-4669-a502-8cc14d4ee02b] succeeded in 1.7761969140001383s: None 2024-05-10T23:06:02.945838407Z [2024-05-10 23:06:02,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4ec2f8a-cfed-4041-8540-1c5ee48c55cb] succeeded in 1.756265144000281s: None 2024-05-10T23:06:03.164731273Z [2024-05-10 23:06:03,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:06:03.168125651Z [2024-05-10 23:06:03,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:06:03.185550875Z [2024-05-10 23:06:03,185: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:06:03.186578836Z [2024-05-10 23:06:03,186: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:06:03.186633399Z [2024-05-10 23:06:03,186: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:06:03.186793430Z [2024-05-10 23:06:03,186: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:06:03.186856746Z [2024-05-10 23:06:03,186: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:06:03.187103336Z [2024-05-10 23:06:03,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:06:03.187220914Z [2024-05-10 23:06:03,187: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:06:03.285166901Z [2024-05-10 23:06:03,284: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:06:03.486073998Z [2024-05-10 23:06:03,482: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:06:03.486105514Z [2024-05-10 23:06:03,485: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:06:03.528466793Z [2024-05-10 23:06:03,528: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:06:03.529517484Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:06:03.529568183Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:06:03.529664099Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:06:03.529728131Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:06:03.530035639Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:06:03.530043153Z [2024-05-10 23:06:03,529: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:06:03.606962121Z [2024-05-10 23:06:03,606: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:06:04.799166073Z [2024-05-10 23:06:04,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddb4ff5d-6360-48ec-8648-200d151fa302] succeeded in 3.6459415270001045s: None 2024-05-10T23:06:05.443840984Z [2024-05-10 23:06:05,443: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4798f16c-0066-48ef-87dc-81c33bbc58ea] succeeded in 4.251318325000284s: None 2024-05-10T23:07:00.694791771Z [2024-05-10 23:07:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c4e9e11-25d2-4af7-a950-54c0174eee0a] received 2024-05-10T23:07:00.709736522Z [2024-05-10 23:07:00,708: INFO/ForkPoolWorker-15] [3c4e9e11-25d2-4af7-a950-54c0174eee0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:07:00.719376081Z [2024-05-10 23:07:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[637ea296-53fb-4c86-a4be-1d3992089c10] received 2024-05-10T23:07:00.738985500Z [2024-05-10 23:07:00,738: INFO/ForkPoolWorker-16] [637ea296-53fb-4c86-a4be-1d3992089c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:07:00.759454430Z [2024-05-10 23:07:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3974ea0c-137f-4f78-9aa6-5c1ee18db57b] received 2024-05-10T23:07:00.768558181Z [2024-05-10 23:07:00,767: INFO/ForkPoolWorker-1] [3974ea0c-137f-4f78-9aa6-5c1ee18db57b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:07:01.161139871Z [2024-05-10 23:07:01,157: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:07:01.163645460Z [2024-05-10 23:07:01,156: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:07:01.242599270Z [2024-05-10 23:07:01,239: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:07:01.355260871Z [2024-05-10 23:07:01,354: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:07:01.359926005Z [2024-05-10 23:07:01,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:07:01.387388783Z [2024-05-10 23:07:01,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:07:01.390691283Z [2024-05-10 23:07:01,390: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:07:01.390874067Z [2024-05-10 23:07:01,390: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:07:01.390994710Z [2024-05-10 23:07:01,390: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:07:01.391270664Z [2024-05-10 23:07:01,391: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:07:01.517612929Z [2024-05-10 23:07:01,517: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:07:02.198256952Z [2024-05-10 23:07:02,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c4e9e11-25d2-4af7-a950-54c0174eee0a] succeeded in 1.5015933549998408s: None 2024-05-10T23:07:02.477266924Z [2024-05-10 23:07:02,476: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:07:02.480567216Z [2024-05-10 23:07:02,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:07:02.504289262Z [2024-05-10 23:07:02,503: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:07:02.508302442Z [2024-05-10 23:07:02,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:07:02.508662256Z [2024-05-10 23:07:02,508: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:07:02.509553098Z [2024-05-10 23:07:02,509: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:07:02.509596052Z [2024-05-10 23:07:02,509: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:07:02.509720277Z [2024-05-10 23:07:02,509: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:07:02.509762727Z [2024-05-10 23:07:02,509: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:07:02.510429872Z [2024-05-10 23:07:02,510: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:07:02.510668374Z [2024-05-10 23:07:02,510: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:07:02.534194139Z [2024-05-10 23:07:02,533: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:07:02.535762892Z [2024-05-10 23:07:02,535: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:07:02.535903237Z [2024-05-10 23:07:02,535: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:07:02.536180644Z [2024-05-10 23:07:02,535: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:07:02.536313819Z [2024-05-10 23:07:02,536: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:07:02.536628176Z [2024-05-10 23:07:02,536: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:07:02.537059142Z [2024-05-10 23:07:02,536: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:07:02.593631369Z [2024-05-10 23:07:02,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:07:02.611397604Z [2024-05-10 23:07:02,611: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:07:04.705415641Z [2024-05-10 23:07:04,702: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3974ea0c-137f-4f78-9aa6-5c1ee18db57b] succeeded in 3.9411483859998953s: None 2024-05-10T23:07:05.171336600Z [2024-05-10 23:07:05,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[637ea296-53fb-4c86-a4be-1d3992089c10] succeeded in 4.448172623000119s: None 2024-05-10T23:08:00.561201688Z [2024-05-10 23:08:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95129280-272c-47c7-aa0e-27e5521cdd12] received 2024-05-10T23:08:00.562965355Z [2024-05-10 23:08:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b570d62-952c-44f0-a909-1bd4e80d19d9] received 2024-05-10T23:08:00.565606209Z [2024-05-10 23:08:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74a3b575-574c-4a79-8fe0-0ea60cd62029] received 2024-05-10T23:08:00.575853072Z [2024-05-10 23:08:00,575: INFO/ForkPoolWorker-16] [7b570d62-952c-44f0-a909-1bd4e80d19d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:08:00.576994791Z [2024-05-10 23:08:00,576: INFO/ForkPoolWorker-1] [74a3b575-574c-4a79-8fe0-0ea60cd62029] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:08:00.577846388Z [2024-05-10 23:08:00,577: INFO/ForkPoolWorker-15] [95129280-272c-47c7-aa0e-27e5521cdd12] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:08:00.578323540Z [2024-05-10 23:08:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[048ccae8-cbae-4509-8691-48e1361797f1] received 2024-05-10T23:08:00.628918282Z [2024-05-10 23:08:00,628: INFO/ForkPoolWorker-2] [048ccae8-cbae-4509-8691-48e1361797f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:08:00.978418629Z [2024-05-10 23:08:00,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:08:01.146309486Z [2024-05-10 23:08:01,142: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:08:01.392514404Z [2024-05-10 23:08:01,392: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:08:01.402598514Z [2024-05-10 23:08:01,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:08:01.438426079Z [2024-05-10 23:08:01,435: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:08:01.458501541Z [2024-05-10 23:08:01,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:08:01.465659767Z [2024-05-10 23:08:01,465: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:08:01.465782757Z [2024-05-10 23:08:01,465: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:08:01.465873406Z [2024-05-10 23:08:01,465: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:08:01.467511943Z [2024-05-10 23:08:01,467: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:08:01.538539151Z [2024-05-10 23:08:01,535: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:08:01.566764078Z [2024-05-10 23:08:01,563: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:08:01.657588825Z [2024-05-10 23:08:01,656: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:08:02.267016958Z [2024-05-10 23:08:02,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b570d62-952c-44f0-a909-1bd4e80d19d9] succeeded in 1.6995039039998119s: None 2024-05-10T23:08:02.494070719Z [2024-05-10 23:08:02,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95129280-272c-47c7-aa0e-27e5521cdd12] succeeded in 1.9281877669995993s: None 2024-05-10T23:08:02.878546717Z [2024-05-10 23:08:02,878: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:08:02.881697068Z [2024-05-10 23:08:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:08:02.902127769Z [2024-05-10 23:08:02,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:08:02.903554539Z [2024-05-10 23:08:02,903: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:08:02.903705068Z [2024-05-10 23:08:02,903: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:08:02.903965833Z [2024-05-10 23:08:02,903: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:08:02.904111855Z [2024-05-10 23:08:02,903: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:08:02.904438634Z [2024-05-10 23:08:02,904: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:08:02.904583498Z [2024-05-10 23:08:02,904: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:08:03.012599127Z [2024-05-10 23:08:03,012: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:08:03.143150879Z [2024-05-10 23:08:03,142: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:08:03.147925700Z [2024-05-10 23:08:03,147: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:08:03.175402005Z [2024-05-10 23:08:03,175: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:08:03.178133258Z [2024-05-10 23:08:03,177: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:08:03.178378641Z [2024-05-10 23:08:03,178: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:08:03.178749987Z [2024-05-10 23:08:03,178: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:08:03.178964938Z [2024-05-10 23:08:03,178: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:08:03.179547116Z [2024-05-10 23:08:03,179: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:08:03.180457584Z [2024-05-10 23:08:03,180: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:08:03.262108041Z [2024-05-10 23:08:03,261: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:08:04.763651853Z [2024-05-10 23:08:04,763: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[048ccae8-cbae-4509-8691-48e1361797f1] succeeded in 4.1789787550001165s: None 2024-05-10T23:08:05.107981755Z [2024-05-10 23:08:05,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[74a3b575-574c-4a79-8fe0-0ea60cd62029] succeeded in 4.541127812000013s: None 2024-05-10T23:09:00.715720871Z [2024-05-10 23:09:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8bbc129-d184-48e5-928f-5122f40ca721] received 2024-05-10T23:09:00.719996028Z [2024-05-10 23:09:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d464569-6810-4291-9faa-997585cf6032] received 2024-05-10T23:09:00.722977978Z [2024-05-10 23:09:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be40cc9-75e7-4965-a2c8-2208d928e1c2] received 2024-05-10T23:09:00.729226050Z [2024-05-10 23:09:00,728: INFO/ForkPoolWorker-15] [b8bbc129-d184-48e5-928f-5122f40ca721] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:09:00.731408509Z [2024-05-10 23:09:00,731: INFO/ForkPoolWorker-16] [0d464569-6810-4291-9faa-997585cf6032] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:09:00.733314062Z [2024-05-10 23:09:00,733: INFO/ForkPoolWorker-1] [5be40cc9-75e7-4965-a2c8-2208d928e1c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:09:01.036518752Z [2024-05-10 23:09:01,033: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:09:01.062115224Z [2024-05-10 23:09:01,059: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:09:01.134673844Z [2024-05-10 23:09:01,131: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:09:01.285157254Z [2024-05-10 23:09:01,284: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:09:01.288915459Z [2024-05-10 23:09:01,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:09:01.319568247Z [2024-05-10 23:09:01,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:09:01.323378212Z [2024-05-10 23:09:01,323: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:09:01.323483079Z [2024-05-10 23:09:01,323: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:09:01.323540870Z [2024-05-10 23:09:01,323: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:09:01.323817248Z [2024-05-10 23:09:01,323: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:09:01.421805549Z [2024-05-10 23:09:01,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:09:02.016226326Z [2024-05-10 23:09:02,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8bbc129-d184-48e5-928f-5122f40ca721] succeeded in 1.2986118659996464s: None 2024-05-10T23:09:02.311971528Z [2024-05-10 23:09:02,311: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:09:02.315262126Z [2024-05-10 23:09:02,314: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:09:02.325312467Z [2024-05-10 23:09:02,324: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:09:02.328791492Z [2024-05-10 23:09:02,328: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:09:02.339399457Z [2024-05-10 23:09:02,339: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:09:02.341051295Z [2024-05-10 23:09:02,340: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:09:02.341070402Z [2024-05-10 23:09:02,340: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:09:02.341210974Z [2024-05-10 23:09:02,341: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:09:02.341232310Z [2024-05-10 23:09:02,341: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:09:02.341551391Z [2024-05-10 23:09:02,341: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:09:02.342099927Z [2024-05-10 23:09:02,341: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:09:02.357548964Z [2024-05-10 23:09:02,357: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:09:02.359662355Z [2024-05-10 23:09:02,359: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:09:02.360079825Z [2024-05-10 23:09:02,359: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:09:02.360652411Z [2024-05-10 23:09:02,360: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:09:02.361313575Z [2024-05-10 23:09:02,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:09:02.361826928Z [2024-05-10 23:09:02,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:09:02.362070223Z [2024-05-10 23:09:02,361: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:09:02.440977191Z [2024-05-10 23:09:02,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:09:02.449561058Z [2024-05-10 23:09:02,449: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:09:03.918087656Z [2024-05-10 23:09:03,917: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d464569-6810-4291-9faa-997585cf6032] succeeded in 3.1931794820002324s: None 2024-05-10T23:09:04.398168881Z [2024-05-10 23:09:04,397: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5be40cc9-75e7-4965-a2c8-2208d928e1c2] succeeded in 3.671156706000147s: None 2024-05-10T23:10:01.033310853Z [2024-05-10 23:10:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[024bd804-4240-4a5f-b00e-89416f01c61c] received 2024-05-10T23:10:01.044439152Z [2024-05-10 23:10:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8717ac-6b17-4225-861d-ffc2ec05d237] received 2024-05-10T23:10:01.058554871Z [2024-05-10 23:10:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a24d685-d6e8-4639-882e-7aac97d9a0b7] received 2024-05-10T23:10:01.058582023Z [2024-05-10 23:10:01,053: INFO/ForkPoolWorker-15] [024bd804-4240-4a5f-b00e-89416f01c61c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:01.058586732Z [2024-05-10 23:10:01,054: INFO/ForkPoolWorker-16] [bd8717ac-6b17-4225-861d-ffc2ec05d237] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:10:01.061036142Z [2024-05-10 23:10:01,060: INFO/ForkPoolWorker-1] [1a24d685-d6e8-4639-882e-7aac97d9a0b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:10:01.061839015Z [2024-05-10 23:10:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d69248c0-1562-442c-948d-7baef77f1028] received 2024-05-10T23:10:01.114521904Z [2024-05-10 23:10:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339516c9-02e9-4eaf-a834-250f89627640] received 2024-05-10T23:10:01.139516130Z [2024-05-10 23:10:01,139: INFO/ForkPoolWorker-2] [d69248c0-1562-442c-948d-7baef77f1028] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:10:01.142917360Z [2024-05-10 23:10:01,142: INFO/ForkPoolWorker-3] [339516c9-02e9-4eaf-a834-250f89627640] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:10:01.415631021Z [2024-05-10 23:10:01,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:10:01.529377727Z [2024-05-10 23:10:01,525: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:10:01.537730840Z [2024-05-10 23:10:01,534: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:10:01.595097744Z [2024-05-10 23:10:01,591: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:10:01.709946493Z [2024-05-10 23:10:01,709: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T23:10:01.714278097Z [2024-05-10 23:10:01,713: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:01.754646991Z [2024-05-10 23:10:01,754: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T23:10:01.756895124Z [2024-05-10 23:10:01,756: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:10:01.757200217Z [2024-05-10 23:10:01,757: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:10:01.757458433Z [2024-05-10 23:10:01,757: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T23:10:01.757791892Z [2024-05-10 23:10:01,757: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:10:01.758668609Z [2024-05-10 23:10:01,754: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:10:01.890936596Z [2024-05-10 23:10:01,890: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:02.145492018Z [2024-05-10 23:10:02,145: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:02.579019108Z [2024-05-10 23:10:02,578: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[339516c9-02e9-4eaf-a834-250f89627640] succeeded in 1.458283129999927s: None 2024-05-10T23:10:02.784576946Z [2024-05-10 23:10:02,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd8717ac-6b17-4225-861d-ffc2ec05d237] succeeded in 1.7388172760001908s: None 2024-05-10T23:10:03.086837096Z [2024-05-10 23:10:03,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:10:03.090427849Z [2024-05-10 23:10:03,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:03.098969495Z [2024-05-10 23:10:03,098: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:10:03.102283879Z [2024-05-10 23:10:03,101: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:03.112008149Z [2024-05-10 23:10:03,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:10:03.113780994Z [2024-05-10 23:10:03,113: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:03.113925473Z [2024-05-10 23:10:03,113: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:03.114107159Z [2024-05-10 23:10:03,113: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:03.114189606Z [2024-05-10 23:10:03,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:10:03.114480534Z [2024-05-10 23:10:03,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:10:03.114548356Z [2024-05-10 23:10:03,114: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:03.132018833Z [2024-05-10 23:10:03,131: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:10:03.133399617Z [2024-05-10 23:10:03,133: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:03.133481312Z [2024-05-10 23:10:03,133: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:03.133646710Z [2024-05-10 23:10:03,133: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:03.133707110Z [2024-05-10 23:10:03,133: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:10:03.134002392Z [2024-05-10 23:10:03,133: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:10:03.134355319Z [2024-05-10 23:10:03,134: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:03.176457291Z [2024-05-10 23:10:03,176: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:10:03.179800024Z [2024-05-10 23:10:03,179: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:03.211618930Z [2024-05-10 23:10:03,211: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:10:03.211723373Z [2024-05-10 23:10:03,211: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:03.213722974Z [2024-05-10 23:10:03,213: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:03.214251346Z [2024-05-10 23:10:03,213: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:03.214734618Z [2024-05-10 23:10:03,214: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:03.215082623Z [2024-05-10 23:10:03,214: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:10:03.215648673Z [2024-05-10 23:10:03,215: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:10:03.215930599Z [2024-05-10 23:10:03,215: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:03.223455529Z [2024-05-10 23:10:03,223: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:03.310977936Z [2024-05-10 23:10:03,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:03.947707695Z [2024-05-10 23:10:03,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67315727-8d51-4ea4-ad84-41d1d490caf6] received 2024-05-10T23:10:03.958642666Z [2024-05-10 23:10:03,958: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[024bd804-4240-4a5f-b00e-89416f01c61c] succeeded in 2.91284652000013s: None 2024-05-10T23:10:03.960752818Z [2024-05-10 23:10:03,960: INFO/ForkPoolWorker-16] [67315727-8d51-4ea4-ad84-41d1d490caf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:04.239240319Z [2024-05-10 23:10:04,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:10:05.205883427Z [2024-05-10 23:10:05,205: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d69248c0-1562-442c-948d-7baef77f1028] succeeded in 4.089716558999953s: None 2024-05-10T23:10:05.413575612Z [2024-05-10 23:10:05,413: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:10:05.417148904Z [2024-05-10 23:10:05,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:05.439317119Z [2024-05-10 23:10:05,439: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:10:05.440464573Z [2024-05-10 23:10:05,440: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:05.440488606Z [2024-05-10 23:10:05,440: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:05.440653304Z [2024-05-10 23:10:05,440: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:05.440793744Z [2024-05-10 23:10:05,440: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:10:05.441171944Z [2024-05-10 23:10:05,440: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:10:05.441336602Z [2024-05-10 23:10:05,441: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:05.517240782Z [2024-05-10 23:10:05,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:05.855371514Z [2024-05-10 23:10:05,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a24d685-d6e8-4639-882e-7aac97d9a0b7] succeeded in 4.801120443999935s: None 2024-05-10T23:10:06.093280938Z [2024-05-10 23:10:06,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2341a413-8ced-4bbb-a579-340a86f20fa4] received 2024-05-10T23:10:06.100403638Z [2024-05-10 23:10:06,100: INFO/ForkPoolWorker-15] [2341a413-8ced-4bbb-a579-340a86f20fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:10:06.192029641Z [2024-05-10 23:10:06,191: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67315727-8d51-4ea4-ad84-41d1d490caf6] succeeded in 2.2415027090000876s: None 2024-05-10T23:10:06.364703940Z [2024-05-10 23:10:06,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:10:07.444429796Z [2024-05-10 23:10:07,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:10:07.447835983Z [2024-05-10 23:10:07,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:07.476431227Z [2024-05-10 23:10:07,475: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:10:07.478921753Z [2024-05-10 23:10:07,478: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:07.479151527Z [2024-05-10 23:10:07,478: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:07.479336597Z [2024-05-10 23:10:07,478: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:07.479613882Z [2024-05-10 23:10:07,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:10:07.480209469Z [2024-05-10 23:10:07,479: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:10:07.480427637Z [2024-05-10 23:10:07,480: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:07.575958092Z [2024-05-10 23:10:07,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:08.219725334Z [2024-05-10 23:10:08,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2341a413-8ced-4bbb-a579-340a86f20fa4] succeeded in 2.1246618499999386s: None 2024-05-10T23:10:09.044486709Z [2024-05-10 23:10:09,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac1f901b-ebf6-422e-b4a2-c683f2415789] received 2024-05-10T23:10:09.054077541Z [2024-05-10 23:10:09,053: INFO/ForkPoolWorker-15] [ac1f901b-ebf6-422e-b4a2-c683f2415789] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:10:09.341410228Z [2024-05-10 23:10:09,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:10:10.470987268Z [2024-05-10 23:10:10,470: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:10:10.474462815Z [2024-05-10 23:10:10,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:10:10.490244637Z [2024-05-10 23:10:10,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:10:10.491206828Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:10:10.491219689Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:10:10.491342510Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:10:10.491379555Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:10:10.491585115Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:10:10.491632851Z [2024-05-10 23:10:10,491: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:10:10.574798308Z [2024-05-10 23:10:10,574: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:10:11.164101327Z [2024-05-10 23:10:11,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac1f901b-ebf6-422e-b4a2-c683f2415789] succeeded in 2.1169014830002197s: None 2024-05-10T23:11:01.305838466Z [2024-05-10 23:11:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e1c127f-9591-4ef3-bbff-07b7affb2555] received 2024-05-10T23:11:01.314415574Z [2024-05-10 23:11:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e640b64-d007-4f79-85a2-4e66f63a4383] received 2024-05-10T23:11:01.320807815Z [2024-05-10 23:11:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc428d62-f9c3-4dea-b9da-e31e7d582d22] received 2024-05-10T23:11:01.324885934Z [2024-05-10 23:11:01,324: INFO/ForkPoolWorker-15] [4e1c127f-9591-4ef3-bbff-07b7affb2555] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:11:01.327393262Z [2024-05-10 23:11:01,327: INFO/ForkPoolWorker-16] [2e640b64-d007-4f79-85a2-4e66f63a4383] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:11:01.329133033Z [2024-05-10 23:11:01,328: INFO/ForkPoolWorker-1] [fc428d62-f9c3-4dea-b9da-e31e7d582d22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:11:01.637324310Z [2024-05-10 23:11:01,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:11:01.657720081Z [2024-05-10 23:11:01,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:11:01.668481284Z [2024-05-10 23:11:01,665: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:11:01.853015627Z [2024-05-10 23:11:01,852: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:11:01.857487884Z [2024-05-10 23:11:01,856: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:11:01.878659111Z [2024-05-10 23:11:01,878: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:11:01.879963198Z [2024-05-10 23:11:01,879: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:11:01.880041300Z [2024-05-10 23:11:01,879: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:11:01.880163166Z [2024-05-10 23:11:01,879: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:11:01.880415507Z [2024-05-10 23:11:01,880: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:11:01.985013011Z [2024-05-10 23:11:01,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:11:02.629221534Z [2024-05-10 23:11:02,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc428d62-f9c3-4dea-b9da-e31e7d582d22] succeeded in 1.306403868000416s: None 2024-05-10T23:11:02.778754010Z [2024-05-10 23:11:02,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:11:02.782337813Z [2024-05-10 23:11:02,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:11:02.803011238Z [2024-05-10 23:11:02,802: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:11:02.804529833Z [2024-05-10 23:11:02,804: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:11:02.804555467Z [2024-05-10 23:11:02,804: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:11:02.804762936Z [2024-05-10 23:11:02,804: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:11:02.804889962Z [2024-05-10 23:11:02,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:11:02.805319115Z [2024-05-10 23:11:02,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:11:02.805341293Z [2024-05-10 23:11:02,805: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:11:02.814670384Z [2024-05-10 23:11:02,814: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:11:02.818192656Z [2024-05-10 23:11:02,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:11:02.839902117Z [2024-05-10 23:11:02,839: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:11:02.841419312Z [2024-05-10 23:11:02,841: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:11:02.841432337Z [2024-05-10 23:11:02,841: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:11:02.841671161Z [2024-05-10 23:11:02,841: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:11:02.841766361Z [2024-05-10 23:11:02,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:11:02.842128883Z [2024-05-10 23:11:02,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:11:02.842204856Z [2024-05-10 23:11:02,842: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:11:02.917274069Z [2024-05-10 23:11:02,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:11:02.945647270Z [2024-05-10 23:11:02,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:11:04.448537915Z [2024-05-10 23:11:04,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e1c127f-9591-4ef3-bbff-07b7affb2555] succeeded in 3.140237260000049s: None 2024-05-10T23:11:04.950169741Z [2024-05-10 23:11:04,949: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e640b64-d007-4f79-85a2-4e66f63a4383] succeeded in 3.633087741000054s: None 2024-05-10T23:12:00.550072812Z [2024-05-10 23:12:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53e69a5f-8a58-4c26-b1d2-8f3492b00b09] received 2024-05-10T23:12:00.554450360Z [2024-05-10 23:12:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e5fbaac-2c9b-4ea3-bedd-2fad8a9ceb58] received 2024-05-10T23:12:00.556098764Z [2024-05-10 23:12:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[033d3f9d-69b4-4d0c-959e-6abb472080eb] received 2024-05-10T23:12:00.563590964Z [2024-05-10 23:12:00,563: INFO/ForkPoolWorker-16] [1e5fbaac-2c9b-4ea3-bedd-2fad8a9ceb58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:12:00.568217776Z [2024-05-10 23:12:00,567: INFO/ForkPoolWorker-1] [033d3f9d-69b4-4d0c-959e-6abb472080eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:12:00.569963431Z [2024-05-10 23:12:00,569: INFO/ForkPoolWorker-15] [53e69a5f-8a58-4c26-b1d2-8f3492b00b09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:12:00.570451386Z [2024-05-10 23:12:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20e6f663-8ac8-4fe5-8ae9-c1571b625b6d] received 2024-05-10T23:12:00.582434077Z [2024-05-10 23:12:00,582: INFO/ForkPoolWorker-2] [20e6f663-8ac8-4fe5-8ae9-c1571b625b6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:12:00.868879054Z [2024-05-10 23:12:00,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:12:00.883974828Z [2024-05-10 23:12:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:12:00.909805662Z [2024-05-10 23:12:00,906: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:12:01.005097211Z [2024-05-10 23:12:00,999: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:12:01.296913321Z [2024-05-10 23:12:01,296: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:12:01.300853734Z [2024-05-10 23:12:01,300: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:12:01.322516115Z [2024-05-10 23:12:01,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:12:01.347069978Z [2024-05-10 23:12:01,346: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:12:01.351281681Z [2024-05-10 23:12:01,351: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:12:01.351357659Z [2024-05-10 23:12:01,351: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:12:01.351362887Z [2024-05-10 23:12:01,351: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:12:01.351561163Z [2024-05-10 23:12:01,351: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:12:01.482006830Z [2024-05-10 23:12:01,481: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:12:02.036375989Z [2024-05-10 23:12:02,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e5fbaac-2c9b-4ea3-bedd-2fad8a9ceb58] succeeded in 1.480206360000011s: None 2024-05-10T23:12:02.224859585Z [2024-05-10 23:12:02,224: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20e6f663-8ac8-4fe5-8ae9-c1571b625b6d] succeeded in 1.6475496339999154s: None 2024-05-10T23:12:02.343850146Z [2024-05-10 23:12:02,343: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:12:02.347332873Z [2024-05-10 23:12:02,346: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:12:02.372729614Z [2024-05-10 23:12:02,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:12:02.374530623Z [2024-05-10 23:12:02,374: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:12:02.374543671Z [2024-05-10 23:12:02,374: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:12:02.374702333Z [2024-05-10 23:12:02,374: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:12:02.374754075Z [2024-05-10 23:12:02,374: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:12:02.375116812Z [2024-05-10 23:12:02,374: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:12:02.375196472Z [2024-05-10 23:12:02,375: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:12:02.384501186Z [2024-05-10 23:12:02,384: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:12:02.387776560Z [2024-05-10 23:12:02,387: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:12:02.409396971Z [2024-05-10 23:12:02,409: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:12:02.411012499Z [2024-05-10 23:12:02,410: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:12:02.411165123Z [2024-05-10 23:12:02,410: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:12:02.411351881Z [2024-05-10 23:12:02,411: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:12:02.411525330Z [2024-05-10 23:12:02,411: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:12:02.411762500Z [2024-05-10 23:12:02,411: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:12:02.411949024Z [2024-05-10 23:12:02,411: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:12:02.471661744Z [2024-05-10 23:12:02,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:12:02.495086266Z [2024-05-10 23:12:02,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:12:04.388851384Z [2024-05-10 23:12:04,388: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53e69a5f-8a58-4c26-b1d2-8f3492b00b09] succeeded in 3.8349047249998875s: None 2024-05-10T23:12:05.427152677Z [2024-05-10 23:12:05,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[033d3f9d-69b4-4d0c-959e-6abb472080eb] succeeded in 4.8693177069999365s: None 2024-05-10T23:13:00.470702806Z [2024-05-10 23:13:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b0f0f93-9f90-41e6-b6a8-ba2c9249b11b] received 2024-05-10T23:13:00.484822765Z [2024-05-10 23:13:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[162b9658-954b-4165-ac20-e74d21d42eaf] received 2024-05-10T23:13:00.485239772Z [2024-05-10 23:13:00,485: INFO/ForkPoolWorker-15] [4b0f0f93-9f90-41e6-b6a8-ba2c9249b11b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:13:00.496619754Z [2024-05-10 23:13:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ccaf595-0c31-4545-99b8-bab3b347bf45] received 2024-05-10T23:13:00.505008665Z [2024-05-10 23:13:00,504: INFO/ForkPoolWorker-1] [8ccaf595-0c31-4545-99b8-bab3b347bf45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:13:00.514899387Z [2024-05-10 23:13:00,514: INFO/ForkPoolWorker-16] [162b9658-954b-4165-ac20-e74d21d42eaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:13:00.819021597Z [2024-05-10 23:13:00,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:13:00.836494780Z [2024-05-10 23:13:00,833: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:13:00.870672640Z [2024-05-10 23:13:00,867: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:13:01.045491649Z [2024-05-10 23:13:01,045: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:13:01.050110652Z [2024-05-10 23:13:01,049: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:13:01.097812096Z [2024-05-10 23:13:01,097: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:13:01.101020641Z [2024-05-10 23:13:01,099: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:13:01.101037947Z [2024-05-10 23:13:01,100: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:13:01.101041870Z [2024-05-10 23:13:01,100: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:13:01.101045253Z [2024-05-10 23:13:01,100: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:13:01.237053727Z [2024-05-10 23:13:01,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:13:01.829777117Z [2024-05-10 23:13:01,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[162b9658-954b-4165-ac20-e74d21d42eaf] succeeded in 1.3427159059997393s: None 2024-05-10T23:13:02.024907836Z [2024-05-10 23:13:02,024: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:13:02.028276131Z [2024-05-10 23:13:02,027: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:13:02.054633444Z [2024-05-10 23:13:02,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:13:02.056182229Z [2024-05-10 23:13:02,055: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:13:02.058447519Z [2024-05-10 23:13:02,058: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:13:02.059021285Z [2024-05-10 23:13:02,058: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:13:02.059211256Z [2024-05-10 23:13:02,058: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:13:02.059328238Z [2024-05-10 23:13:02,059: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:13:02.059597404Z [2024-05-10 23:13:02,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:13:02.059951965Z [2024-05-10 23:13:02,059: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:13:02.060101096Z [2024-05-10 23:13:02,059: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:13:02.082360990Z [2024-05-10 23:13:02,082: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:13:02.083515923Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:13:02.083567865Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:13:02.083598069Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:13:02.083667214Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:13:02.083883476Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:13:02.083891535Z [2024-05-10 23:13:02,083: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:13:02.173696005Z [2024-05-10 23:13:02,173: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:13:02.175661092Z [2024-05-10 23:13:02,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:13:03.660429993Z [2024-05-10 23:13:03,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b0f0f93-9f90-41e6-b6a8-ba2c9249b11b] succeeded in 3.1848515950000547s: None 2024-05-10T23:13:03.995761589Z [2024-05-10 23:13:03,995: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ccaf595-0c31-4545-99b8-bab3b347bf45] succeeded in 3.4968345520001094s: None 2024-05-10T23:14:01.079934539Z [2024-05-10 23:14:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f84bb86-0008-4cae-a52d-aee7e4695f11] received 2024-05-10T23:14:01.079976667Z [2024-05-10 23:14:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfe42fe1-3b3d-4f62-bfec-23cb5800a404] received 2024-05-10T23:14:01.100281815Z [2024-05-10 23:14:01,099: INFO/ForkPoolWorker-16] [cfe42fe1-3b3d-4f62-bfec-23cb5800a404] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:14:01.102689533Z [2024-05-10 23:14:01,102: INFO/ForkPoolWorker-15] [2f84bb86-0008-4cae-a52d-aee7e4695f11] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:14:01.115113085Z [2024-05-10 23:14:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12c0d533-b112-4ec3-bf46-ffc63746d35a] received 2024-05-10T23:14:01.147336583Z [2024-05-10 23:14:01,147: INFO/ForkPoolWorker-1] [12c0d533-b112-4ec3-bf46-ffc63746d35a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:14:01.147903187Z [2024-05-10 23:14:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99d252bf-b9b5-4619-a685-3cd6cf28fecf] received 2024-05-10T23:14:01.165307346Z [2024-05-10 23:14:01,165: INFO/ForkPoolWorker-2] [99d252bf-b9b5-4619-a685-3cd6cf28fecf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:14:01.561787985Z [2024-05-10 23:14:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:14:01.616648637Z [2024-05-10 23:14:01,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:14:01.735519784Z [2024-05-10 23:14:01,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:14:01.736799807Z [2024-05-10 23:14:01,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:14:01.864169465Z [2024-05-10 23:14:01,853: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:14:01.872877950Z [2024-05-10 23:14:01,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:14:01.919447135Z [2024-05-10 23:14:01,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:14:01.922694528Z [2024-05-10 23:14:01,922: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:14:01.922825130Z [2024-05-10 23:14:01,922: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:14:01.922939036Z [2024-05-10 23:14:01,922: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:14:01.923219290Z [2024-05-10 23:14:01,923: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:14:02.060654334Z [2024-05-10 23:14:02,060: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:14:02.157819446Z [2024-05-10 23:14:02,157: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:14:02.869240974Z [2024-05-10 23:14:02,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f84bb86-0008-4cae-a52d-aee7e4695f11] succeeded in 1.7881507580000289s: None 2024-05-10T23:14:02.954886121Z [2024-05-10 23:14:02,954: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cfe42fe1-3b3d-4f62-bfec-23cb5800a404] succeeded in 1.8704209360003006s: None 2024-05-10T23:14:03.350605190Z [2024-05-10 23:14:03,350: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:14:03.354055914Z [2024-05-10 23:14:03,353: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:14:03.378809894Z [2024-05-10 23:14:03,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:14:03.380232764Z [2024-05-10 23:14:03,379: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:14:03.380378096Z [2024-05-10 23:14:03,380: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:14:03.380550672Z [2024-05-10 23:14:03,380: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:14:03.380656905Z [2024-05-10 23:14:03,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:14:03.380938397Z [2024-05-10 23:14:03,380: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:14:03.381362413Z [2024-05-10 23:14:03,381: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:14:03.479362300Z [2024-05-10 23:14:03,479: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:14:03.548973373Z [2024-05-10 23:14:03,542: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:14:03.548997786Z [2024-05-10 23:14:03,546: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:14:03.573571902Z [2024-05-10 23:14:03,573: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:14:03.576171055Z [2024-05-10 23:14:03,575: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:14:03.576375841Z [2024-05-10 23:14:03,576: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:14:03.576632385Z [2024-05-10 23:14:03,576: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:14:03.576781739Z [2024-05-10 23:14:03,576: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:14:03.577087070Z [2024-05-10 23:14:03,576: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:14:03.577624390Z [2024-05-10 23:14:03,577: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:14:03.654390641Z [2024-05-10 23:14:03,654: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:14:05.111779273Z [2024-05-10 23:14:05,111: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99d252bf-b9b5-4619-a685-3cd6cf28fecf] succeeded in 3.9536517129999993s: None 2024-05-10T23:14:05.323548634Z [2024-05-10 23:14:05,323: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12c0d533-b112-4ec3-bf46-ffc63746d35a] succeeded in 4.196368869999787s: None 2024-05-10T23:15:01.207392903Z [2024-05-10 23:15:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[335a048a-b751-4c14-a185-7e8ddce7cba5] received 2024-05-10T23:15:01.213736220Z [2024-05-10 23:15:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445c6ed5-571c-43ee-bd8b-b562afccf6d4] received 2024-05-10T23:15:01.214520608Z [2024-05-10 23:15:01,214: INFO/ForkPoolWorker-15] [335a048a-b751-4c14-a185-7e8ddce7cba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:01.225980487Z [2024-05-10 23:15:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d848480-d336-4e32-a8da-9e29761aab75] received 2024-05-10T23:15:01.232999893Z [2024-05-10 23:15:01,232: INFO/ForkPoolWorker-16] [445c6ed5-571c-43ee-bd8b-b562afccf6d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:15:01.236439164Z [2024-05-10 23:15:01,236: INFO/ForkPoolWorker-1] [3d848480-d336-4e32-a8da-9e29761aab75] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:15:01.244954237Z [2024-05-10 23:15:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d211d181-e3bc-446e-ba17-78971669df6c] received 2024-05-10T23:15:01.257091379Z [2024-05-10 23:15:01,256: INFO/ForkPoolWorker-2] [d211d181-e3bc-446e-ba17-78971669df6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:15:01.534886740Z [2024-05-10 23:15:01,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:15:01.552383432Z [2024-05-10 23:15:01,548: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:15:01.597944305Z [2024-05-10 23:15:01,593: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:15:01.605080496Z [2024-05-10 23:15:01,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:15:01.789472545Z [2024-05-10 23:15:01,789: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:15:01.795521310Z [2024-05-10 23:15:01,793: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:01.822478376Z [2024-05-10 23:15:01,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:15:01.823807288Z [2024-05-10 23:15:01,823: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:15:01.824053438Z [2024-05-10 23:15:01,823: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:15:01.824258020Z [2024-05-10 23:15:01,824: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:15:01.825397409Z [2024-05-10 23:15:01,825: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:15:01.969572561Z [2024-05-10 23:15:01,969: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:02.641041446Z [2024-05-10 23:15:02,640: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d848480-d336-4e32-a8da-9e29761aab75] succeeded in 1.4136798229997112s: None 2024-05-10T23:15:03.223686990Z [2024-05-10 23:15:03,223: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:15:03.227218101Z [2024-05-10 23:15:03,226: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:03.236747780Z [2024-05-10 23:15:03,236: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:15:03.240964435Z [2024-05-10 23:15:03,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:03.253356185Z [2024-05-10 23:15:03,253: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:15:03.255264462Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:03.255358826Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:03.255488303Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:03.255500105Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:15:03.255701959Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:15:03.255736302Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:15:03.255792919Z [2024-05-10 23:15:03,255: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:03.259421846Z [2024-05-10 23:15:03,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:03.275476130Z [2024-05-10 23:15:03,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:15:03.277285339Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:03.277301461Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:03.277434650Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:03.277443976Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:15:03.277788678Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:15:03.277817590Z [2024-05-10 23:15:03,277: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:03.301462449Z [2024-05-10 23:15:03,301: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:15:03.303770461Z [2024-05-10 23:15:03,303: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:03.303837347Z [2024-05-10 23:15:03,303: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:03.304017279Z [2024-05-10 23:15:03,303: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:03.304111390Z [2024-05-10 23:15:03,304: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:15:03.304386139Z [2024-05-10 23:15:03,304: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:15:03.304471000Z [2024-05-10 23:15:03,304: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:03.333115098Z [2024-05-10 23:15:03,332: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:03.380441401Z [2024-05-10 23:15:03,380: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:03.423042335Z [2024-05-10 23:15:03,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:04.086048090Z [2024-05-10 23:15:04,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0466bb71-840b-49ac-adae-9970b68ef1e8] received 2024-05-10T23:15:04.099330259Z [2024-05-10 23:15:04,096: INFO/ForkPoolWorker-1] [0466bb71-840b-49ac-adae-9970b68ef1e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:04.126156257Z [2024-05-10 23:15:04,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[335a048a-b751-4c14-a185-7e8ddce7cba5] succeeded in 2.917215585000122s: None 2024-05-10T23:15:04.382480258Z [2024-05-10 23:15:04,379: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:15:05.195300685Z [2024-05-10 23:15:05,194: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d211d181-e3bc-446e-ba17-78971669df6c] succeeded in 3.9489520909996827s: None 2024-05-10T23:15:05.292724885Z [2024-05-10 23:15:05,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[445c6ed5-571c-43ee-bd8b-b562afccf6d4] succeeded in 4.06422534100011s: None 2024-05-10T23:15:05.571989594Z [2024-05-10 23:15:05,571: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:15:05.575159252Z [2024-05-10 23:15:05,574: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:05.614404207Z [2024-05-10 23:15:05,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:15:05.615781938Z [2024-05-10 23:15:05,615: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:05.615892528Z [2024-05-10 23:15:05,615: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:05.616083367Z [2024-05-10 23:15:05,615: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:05.616219252Z [2024-05-10 23:15:05,616: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:15:05.616517074Z [2024-05-10 23:15:05,616: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:15:05.616634393Z [2024-05-10 23:15:05,616: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:05.688697935Z [2024-05-10 23:15:05,688: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:06.320951433Z [2024-05-10 23:15:06,320: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0466bb71-840b-49ac-adae-9970b68ef1e8] succeeded in 2.234938408999824s: None 2024-05-10T23:15:06.539697309Z [2024-05-10 23:15:06,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4624d747-9eee-49d3-94a7-e58b84c7f5eb] received 2024-05-10T23:15:06.560177318Z [2024-05-10 23:15:06,559: INFO/ForkPoolWorker-15] [4624d747-9eee-49d3-94a7-e58b84c7f5eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:15:06.886275743Z [2024-05-10 23:15:06,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:15:08.084971230Z [2024-05-10 23:15:08,084: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:15:08.088275525Z [2024-05-10 23:15:08,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:08.111815111Z [2024-05-10 23:15:08,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:15:08.113028074Z [2024-05-10 23:15:08,112: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:08.113106225Z [2024-05-10 23:15:08,112: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:08.113257222Z [2024-05-10 23:15:08,113: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:08.113304832Z [2024-05-10 23:15:08,113: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:15:08.113523699Z [2024-05-10 23:15:08,113: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:15:08.113597639Z [2024-05-10 23:15:08,113: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:08.190737567Z [2024-05-10 23:15:08,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:10.427304391Z [2024-05-10 23:15:10,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4624d747-9eee-49d3-94a7-e58b84c7f5eb] succeeded in 3.8818186359999345s: None 2024-05-10T23:15:11.378641723Z [2024-05-10 23:15:11,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54d6d81b-0c13-46e6-867d-45a4f936e235] received 2024-05-10T23:15:11.398611262Z [2024-05-10 23:15:11,398: INFO/ForkPoolWorker-15] [54d6d81b-0c13-46e6-867d-45a4f936e235] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:15:11.704200582Z [2024-05-10 23:15:11,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:15:12.881904491Z [2024-05-10 23:15:12,881: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:15:12.885722232Z [2024-05-10 23:15:12,885: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:15:12.920403719Z [2024-05-10 23:15:12,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:15:12.921945279Z [2024-05-10 23:15:12,921: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:15:12.922146898Z [2024-05-10 23:15:12,921: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:15:12.922413605Z [2024-05-10 23:15:12,922: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:15:12.922563682Z [2024-05-10 23:15:12,922: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:15:12.923130279Z [2024-05-10 23:15:12,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:15:12.923190858Z [2024-05-10 23:15:12,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:15:13.023357884Z [2024-05-10 23:15:13,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:15:13.640331887Z [2024-05-10 23:15:13,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54d6d81b-0c13-46e6-867d-45a4f936e235] succeeded in 2.259848164000232s: None 2024-05-10T23:16:01.196260386Z [2024-05-10 23:16:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5253aaf-f5ef-47f0-b15d-5fc3533f717a] received 2024-05-10T23:16:01.200422437Z [2024-05-10 23:16:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c243fd7-a386-4087-b101-e5a51d77aed4] received 2024-05-10T23:16:01.202512651Z [2024-05-10 23:16:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a1c4181-ee82-484c-bd6b-9a69c6565d8d] received 2024-05-10T23:16:01.204758167Z [2024-05-10 23:16:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e32726c6-527c-4bb4-8bf8-834a4ef57bca] received 2024-05-10T23:16:01.206702626Z [2024-05-10 23:16:01,206: INFO/ForkPoolWorker-15] [a5253aaf-f5ef-47f0-b15d-5fc3533f717a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:16:01.215248155Z [2024-05-10 23:16:01,214: INFO/ForkPoolWorker-16] [0c243fd7-a386-4087-b101-e5a51d77aed4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:16:01.218335985Z [2024-05-10 23:16:01,218: INFO/ForkPoolWorker-2] [e32726c6-527c-4bb4-8bf8-834a4ef57bca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:16:01.222603961Z [2024-05-10 23:16:01,222: INFO/ForkPoolWorker-1] [4a1c4181-ee82-484c-bd6b-9a69c6565d8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:16:01.538386671Z [2024-05-10 23:16:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:16:01.542769662Z [2024-05-10 23:16:01,539: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:16:01.565357175Z [2024-05-10 23:16:01,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:16:01.583826088Z [2024-05-10 23:16:01,577: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:16:01.716403350Z [2024-05-10 23:16:01,715: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:16:01.720498523Z [2024-05-10 23:16:01,719: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:16:01.760086220Z [2024-05-10 23:16:01,759: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:16:01.761770619Z [2024-05-10 23:16:01,761: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:16:01.762130163Z [2024-05-10 23:16:01,761: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:16:01.762260954Z [2024-05-10 23:16:01,762: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:16:01.762547771Z [2024-05-10 23:16:01,762: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:16:01.894657903Z [2024-05-10 23:16:01,894: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:16:02.048805097Z [2024-05-10 23:16:02,048: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:16:02.618518772Z [2024-05-10 23:16:02,618: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e32726c6-527c-4bb4-8bf8-834a4ef57bca] succeeded in 1.4110183989996585s: None 2024-05-10T23:16:02.757013673Z [2024-05-10 23:16:02,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a1c4181-ee82-484c-bd6b-9a69c6565d8d] succeeded in 1.5504686909998782s: None 2024-05-10T23:16:03.134584379Z [2024-05-10 23:16:03,134: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:16:03.138372060Z [2024-05-10 23:16:03,137: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:16:03.170078569Z [2024-05-10 23:16:03,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:16:03.175407455Z [2024-05-10 23:16:03,175: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:16:03.175641060Z [2024-05-10 23:16:03,175: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:16:03.175949697Z [2024-05-10 23:16:03,175: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:16:03.176125440Z [2024-05-10 23:16:03,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:16:03.176591617Z [2024-05-10 23:16:03,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:16:03.176872559Z [2024-05-10 23:16:03,176: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:16:03.196634529Z [2024-05-10 23:16:03,196: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:16:03.200990158Z [2024-05-10 23:16:03,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:16:03.228445687Z [2024-05-10 23:16:03,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:16:03.230542982Z [2024-05-10 23:16:03,230: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:16:03.230737281Z [2024-05-10 23:16:03,230: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:16:03.230966133Z [2024-05-10 23:16:03,230: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:16:03.230993667Z [2024-05-10 23:16:03,230: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:16:03.231571922Z [2024-05-10 23:16:03,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:16:03.231615225Z [2024-05-10 23:16:03,231: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:16:03.271727568Z [2024-05-10 23:16:03,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:16:03.328630066Z [2024-05-10 23:16:03,328: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:16:04.702041935Z [2024-05-10 23:16:04,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5253aaf-f5ef-47f0-b15d-5fc3533f717a] succeeded in 3.5029430750000756s: None 2024-05-10T23:16:05.151274616Z [2024-05-10 23:16:05,150: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c243fd7-a386-4087-b101-e5a51d77aed4] succeeded in 3.9443471339995995s: None 2024-05-10T23:17:00.927736301Z [2024-05-10 23:17:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae6f6922-c193-481d-a8ce-8a9312405c3a] received 2024-05-10T23:17:00.930281992Z [2024-05-10 23:17:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6913b8b2-7686-47d4-95be-98b0491a13b7] received 2024-05-10T23:17:00.936341145Z [2024-05-10 23:17:00,936: INFO/ForkPoolWorker-16] [6913b8b2-7686-47d4-95be-98b0491a13b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:17:00.936599659Z [2024-05-10 23:17:00,936: INFO/ForkPoolWorker-15] [ae6f6922-c193-481d-a8ce-8a9312405c3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:17:00.943462878Z [2024-05-10 23:17:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de959b7d-d234-4bca-a44a-a34c5589ae5a] received 2024-05-10T23:17:00.949760204Z [2024-05-10 23:17:00,949: INFO/ForkPoolWorker-1] [de959b7d-d234-4bca-a44a-a34c5589ae5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:17:01.330811273Z [2024-05-10 23:17:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:17:01.378840791Z [2024-05-10 23:17:01,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:17:01.390174914Z [2024-05-10 23:17:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:17:01.542988051Z [2024-05-10 23:17:01,542: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:17:01.547255336Z [2024-05-10 23:17:01,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:17:01.569129995Z [2024-05-10 23:17:01,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:17:01.570867207Z [2024-05-10 23:17:01,570: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:17:01.571232106Z [2024-05-10 23:17:01,570: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:17:01.571350862Z [2024-05-10 23:17:01,571: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:17:01.571984172Z [2024-05-10 23:17:01,571: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:17:01.665249551Z [2024-05-10 23:17:01,664: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:17:02.271346560Z [2024-05-10 23:17:02,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae6f6922-c193-481d-a8ce-8a9312405c3a] succeeded in 1.3408111100002316s: None 2024-05-10T23:17:02.562279814Z [2024-05-10 23:17:02,561: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:17:02.563133317Z [2024-05-10 23:17:02,562: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:17:02.566148877Z [2024-05-10 23:17:02,565: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:17:02.566593822Z [2024-05-10 23:17:02,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:17:02.584039295Z [2024-05-10 23:17:02,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:17:02.585452080Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:17:02.585494759Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:17:02.585695934Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:17:02.585720980Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:17:02.585946621Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:17:02.586014898Z [2024-05-10 23:17:02,585: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:17:02.596156870Z [2024-05-10 23:17:02,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:17:02.599064255Z [2024-05-10 23:17:02,598: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:17:02.599211220Z [2024-05-10 23:17:02,599: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:17:02.599408521Z [2024-05-10 23:17:02,599: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:17:02.599535263Z [2024-05-10 23:17:02,599: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:17:02.599891189Z [2024-05-10 23:17:02,599: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:17:02.600038870Z [2024-05-10 23:17:02,599: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:17:02.667743186Z [2024-05-10 23:17:02,667: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:17:02.684904739Z [2024-05-10 23:17:02,684: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:17:04.162099552Z [2024-05-10 23:17:04,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6913b8b2-7686-47d4-95be-98b0491a13b7] succeeded in 3.229977600999973s: None 2024-05-10T23:17:04.430659816Z [2024-05-10 23:17:04,430: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de959b7d-d234-4bca-a44a-a34c5589ae5a] succeeded in 3.485544864000076s: None 2024-05-10T23:18:00.465127236Z [2024-05-10 23:18:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86fd8700-0ffe-4532-a85a-03ae40218141] received 2024-05-10T23:18:00.470334600Z [2024-05-10 23:18:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9eee9e1-24e4-411f-9df3-18939107b541] received 2024-05-10T23:18:00.472074977Z [2024-05-10 23:18:00,471: INFO/ForkPoolWorker-15] [86fd8700-0ffe-4532-a85a-03ae40218141] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:18:00.477343241Z [2024-05-10 23:18:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[232725aa-ea7a-4e76-9912-c57d53a90100] received 2024-05-10T23:18:00.480962700Z [2024-05-10 23:18:00,480: INFO/ForkPoolWorker-16] [c9eee9e1-24e4-411f-9df3-18939107b541] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:18:00.486462145Z [2024-05-10 23:18:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4dc3241-6c89-45bc-9285-a84d67bd4d07] received 2024-05-10T23:18:00.503992817Z [2024-05-10 23:18:00,503: INFO/ForkPoolWorker-2] [a4dc3241-6c89-45bc-9285-a84d67bd4d07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:18:00.518543971Z [2024-05-10 23:18:00,518: INFO/ForkPoolWorker-1] [232725aa-ea7a-4e76-9912-c57d53a90100] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:18:00.798471465Z [2024-05-10 23:18:00,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:18:00.808332813Z [2024-05-10 23:18:00,805: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:18:00.839353194Z [2024-05-10 23:18:00,836: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:18:00.840823775Z [2024-05-10 23:18:00,837: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:18:00.973693301Z [2024-05-10 23:18:00,973: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:18:00.977550441Z [2024-05-10 23:18:00,977: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:18:01.025400424Z [2024-05-10 23:18:01,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:18:01.025411003Z [2024-05-10 23:18:01,022: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:18:01.025414683Z [2024-05-10 23:18:01,022: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:18:01.025418334Z [2024-05-10 23:18:01,022: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:18:01.034046555Z [2024-05-10 23:18:01,025: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:18:01.254703953Z [2024-05-10 23:18:01,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:18:01.267646689Z [2024-05-10 23:18:01,267: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:18:01.807271387Z [2024-05-10 23:18:01,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86fd8700-0ffe-4532-a85a-03ae40218141] succeeded in 1.3407733670001107s: None 2024-05-10T23:18:01.924701171Z [2024-05-10 23:18:01,924: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[232725aa-ea7a-4e76-9912-c57d53a90100] succeeded in 1.4336105879997376s: None 2024-05-10T23:18:02.147317504Z [2024-05-10 23:18:02,146: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:18:02.150588244Z [2024-05-10 23:18:02,150: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:18:02.172961458Z [2024-05-10 23:18:02,172: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:18:02.175173673Z [2024-05-10 23:18:02,174: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:18:02.175261611Z [2024-05-10 23:18:02,175: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:18:02.175483478Z [2024-05-10 23:18:02,175: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:18:02.175578186Z [2024-05-10 23:18:02,175: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:18:02.175913364Z [2024-05-10 23:18:02,175: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:18:02.176018175Z [2024-05-10 23:18:02,175: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:18:02.223347931Z [2024-05-10 23:18:02,223: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:18:02.226775114Z [2024-05-10 23:18:02,226: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:18:02.247909070Z [2024-05-10 23:18:02,247: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:18:02.249195881Z [2024-05-10 23:18:02,248: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:18:02.249208327Z [2024-05-10 23:18:02,249: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:18:02.249399981Z [2024-05-10 23:18:02,249: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:18:02.249464171Z [2024-05-10 23:18:02,249: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:18:02.249956151Z [2024-05-10 23:18:02,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:18:02.250053827Z [2024-05-10 23:18:02,249: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:18:02.270702542Z [2024-05-10 23:18:02,270: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:18:02.346751693Z [2024-05-10 23:18:02,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:18:03.738786154Z [2024-05-10 23:18:03,738: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4dc3241-6c89-45bc-9285-a84d67bd4d07] succeeded in 3.2499932280002213s: None 2024-05-10T23:18:04.081990900Z [2024-05-10 23:18:04,078: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9eee9e1-24e4-411f-9df3-18939107b541] succeeded in 3.6060963099998844s: None 2024-05-10T23:19:00.828017643Z [2024-05-10 23:19:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60120e7a-60d9-42dc-a97b-814ee1c85e3a] received 2024-05-10T23:19:00.839513432Z [2024-05-10 23:19:00,839: INFO/ForkPoolWorker-15] [60120e7a-60d9-42dc-a97b-814ee1c85e3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:19:00.846784412Z [2024-05-10 23:19:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5daacce1-add3-4254-8665-65ee3231967c] received 2024-05-10T23:19:00.851642917Z [2024-05-10 23:19:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4b94a1f-bb64-41b3-bbbe-e0ebe23b27d7] received 2024-05-10T23:19:00.858553232Z [2024-05-10 23:19:00,858: INFO/ForkPoolWorker-16] [5daacce1-add3-4254-8665-65ee3231967c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:19:00.863522402Z [2024-05-10 23:19:00,863: INFO/ForkPoolWorker-1] [d4b94a1f-bb64-41b3-bbbe-e0ebe23b27d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:19:01.298976790Z [2024-05-10 23:19:01,294: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:19:01.322895208Z [2024-05-10 23:19:01,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:19:01.330221731Z [2024-05-10 23:19:01,327: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:19:01.523100896Z [2024-05-10 23:19:01,522: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:19:01.527150428Z [2024-05-10 23:19:01,526: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:19:01.553447505Z [2024-05-10 23:19:01,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:19:01.554554476Z [2024-05-10 23:19:01,554: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:19:01.554702311Z [2024-05-10 23:19:01,554: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:19:01.555675646Z [2024-05-10 23:19:01,554: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:19:01.555868861Z [2024-05-10 23:19:01,555: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:19:01.649897066Z [2024-05-10 23:19:01,649: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:19:02.218970548Z [2024-05-10 23:19:02,218: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60120e7a-60d9-42dc-a97b-814ee1c85e3a] succeeded in 1.388855668999895s: None 2024-05-10T23:19:02.510988985Z [2024-05-10 23:19:02,510: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:19:02.514581622Z [2024-05-10 23:19:02,514: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:19:02.539263546Z [2024-05-10 23:19:02,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:19:02.541472162Z [2024-05-10 23:19:02,541: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:19:02.541590480Z [2024-05-10 23:19:02,541: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:19:02.541793772Z [2024-05-10 23:19:02,541: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:19:02.541993175Z [2024-05-10 23:19:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:19:02.542320157Z [2024-05-10 23:19:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:19:02.542432084Z [2024-05-10 23:19:02,542: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:19:02.629690258Z [2024-05-10 23:19:02,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:19:02.684010658Z [2024-05-10 23:19:02,683: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:19:02.687656244Z [2024-05-10 23:19:02,687: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:19:02.711940091Z [2024-05-10 23:19:02,711: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:19:02.713150709Z [2024-05-10 23:19:02,712: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:19:02.713343785Z [2024-05-10 23:19:02,713: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:19:02.713596978Z [2024-05-10 23:19:02,713: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:19:02.713760346Z [2024-05-10 23:19:02,713: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:19:02.714214957Z [2024-05-10 23:19:02,714: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:19:02.714375850Z [2024-05-10 23:19:02,714: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:19:02.796076265Z [2024-05-10 23:19:02,795: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:19:04.211591269Z [2024-05-10 23:19:04,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5daacce1-add3-4254-8665-65ee3231967c] succeeded in 3.3630617529997835s: None 2024-05-10T23:19:04.793895042Z [2024-05-10 23:19:04,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4b94a1f-bb64-41b3-bbbe-e0ebe23b27d7] succeeded in 3.9403921510001965s: None 2024-05-10T23:20:01.267078802Z [2024-05-10 23:20:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97b05561-2e3a-41fa-af2f-3f333d74107e] received 2024-05-10T23:20:01.269721527Z [2024-05-10 23:20:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8fbcbfd-3a2a-4e1b-88b5-4e64f7ca7d45] received 2024-05-10T23:20:01.274138272Z [2024-05-10 23:20:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b3b579-f10c-42f0-bf33-58a66d91307b] received 2024-05-10T23:20:01.278135293Z [2024-05-10 23:20:01,277: INFO/ForkPoolWorker-15] [97b05561-2e3a-41fa-af2f-3f333d74107e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:01.279852616Z [2024-05-10 23:20:01,279: INFO/ForkPoolWorker-16] [d8fbcbfd-3a2a-4e1b-88b5-4e64f7ca7d45] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:20:01.281233128Z [2024-05-10 23:20:01,281: INFO/ForkPoolWorker-1] [11b3b579-f10c-42f0-bf33-58a66d91307b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:20:01.285555986Z [2024-05-10 23:20:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571b606d-80c1-4824-8e35-df10fe431ae9] received 2024-05-10T23:20:01.288066057Z [2024-05-10 23:20:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42cf24c7-d0a5-41a7-8ef8-1043b9618260] received 2024-05-10T23:20:01.297011369Z [2024-05-10 23:20:01,296: INFO/ForkPoolWorker-3] [42cf24c7-d0a5-41a7-8ef8-1043b9618260] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:20:01.298232020Z [2024-05-10 23:20:01,297: INFO/ForkPoolWorker-2] [571b606d-80c1-4824-8e35-df10fe431ae9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:20:01.592380232Z [2024-05-10 23:20:01,589: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:20:01.621656195Z [2024-05-10 23:20:01,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:20:01.726526305Z [2024-05-10 23:20:01,714: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:20:01.889026694Z [2024-05-10 23:20:01,885: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:20:01.940243486Z [2024-05-10 23:20:01,921: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:20:02.189114938Z [2024-05-10 23:20:02,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:02.303349906Z [2024-05-10 23:20:02,302: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T23:20:02.307599242Z [2024-05-10 23:20:02,307: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:02.350824430Z [2024-05-10 23:20:02,350: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T23:20:02.353972203Z [2024-05-10 23:20:02,353: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:20:02.354285907Z [2024-05-10 23:20:02,353: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:20:02.354500268Z [2024-05-10 23:20:02,354: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T23:20:02.354888487Z [2024-05-10 23:20:02,354: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:20:02.523218412Z [2024-05-10 23:20:02,519: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:02.975104676Z [2024-05-10 23:20:02,974: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8fbcbfd-3a2a-4e1b-88b5-4e64f7ca7d45] succeeded in 1.703639499000019s: None 2024-05-10T23:20:02.982874163Z [2024-05-10 23:20:02,982: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:20:02.986730405Z [2024-05-10 23:20:02,985: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:03.014938511Z [2024-05-10 23:20:03,014: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:20:03.016233736Z [2024-05-10 23:20:03,015: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:03.016260446Z [2024-05-10 23:20:03,016: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:03.016341483Z [2024-05-10 23:20:03,016: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:03.016361652Z [2024-05-10 23:20:03,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:20:03.016628219Z [2024-05-10 23:20:03,016: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:20:03.016649952Z [2024-05-10 23:20:03,016: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:03.108327411Z [2024-05-10 23:20:03,108: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:03.157151581Z [2024-05-10 23:20:03,156: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:20:03.160420910Z [2024-05-10 23:20:03,159: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:03.183996251Z [2024-05-10 23:20:03,183: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:20:03.185755718Z [2024-05-10 23:20:03,185: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:03.185776372Z [2024-05-10 23:20:03,185: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:03.185990395Z [2024-05-10 23:20:03,185: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:03.186053596Z [2024-05-10 23:20:03,185: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:20:03.187515232Z [2024-05-10 23:20:03,186: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:20:03.187526508Z [2024-05-10 23:20:03,186: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:03.207080679Z [2024-05-10 23:20:03,206: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[42cf24c7-d0a5-41a7-8ef8-1043b9618260] succeeded in 1.9173443829999997s: None 2024-05-10T23:20:03.272975967Z [2024-05-10 23:20:03,272: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:03.611641978Z [2024-05-10 23:20:03,611: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:20:03.615723009Z [2024-05-10 23:20:03,615: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:03.638443157Z [2024-05-10 23:20:03,638: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:20:03.641382539Z [2024-05-10 23:20:03,641: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:03.641631575Z [2024-05-10 23:20:03,641: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:03.641896333Z [2024-05-10 23:20:03,641: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:03.642073158Z [2024-05-10 23:20:03,641: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:20:03.642496057Z [2024-05-10 23:20:03,642: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:20:03.642656536Z [2024-05-10 23:20:03,642: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:03.731131875Z [2024-05-10 23:20:03,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:03.765919180Z [2024-05-10 23:20:03,765: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97b05561-2e3a-41fa-af2f-3f333d74107e] succeeded in 2.496128251999835s: None 2024-05-10T23:20:04.539707968Z [2024-05-10 23:20:04,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93839413-2374-4745-a4cb-f28deeb9e187] received 2024-05-10T23:20:04.551087891Z [2024-05-10 23:20:04,550: INFO/ForkPoolWorker-15] [93839413-2374-4745-a4cb-f28deeb9e187] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:04.818776884Z [2024-05-10 23:20:04,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:20:04.873390961Z [2024-05-10 23:20:04,873: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[571b606d-80c1-4824-8e35-df10fe431ae9] succeeded in 3.5836795910004184s: None 2024-05-10T23:20:05.497748078Z [2024-05-10 23:20:05,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[11b3b579-f10c-42f0-bf33-58a66d91307b] succeeded in 4.222254344999783s: None 2024-05-10T23:20:06.003132160Z [2024-05-10 23:20:06,002: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:20:06.006938831Z [2024-05-10 23:20:06,006: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:06.043070546Z [2024-05-10 23:20:06,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:20:06.046866276Z [2024-05-10 23:20:06,046: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:06.047050571Z [2024-05-10 23:20:06,046: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:06.047271017Z [2024-05-10 23:20:06,047: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:06.047408734Z [2024-05-10 23:20:06,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:20:06.047737092Z [2024-05-10 23:20:06,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:20:06.047885884Z [2024-05-10 23:20:06,047: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:06.131503542Z [2024-05-10 23:20:06,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:06.778038908Z [2024-05-10 23:20:06,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93839413-2374-4745-a4cb-f28deeb9e187] succeeded in 2.232894211999792s: None 2024-05-10T23:20:07.113369262Z [2024-05-10 23:20:07,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a9934f5-b4f6-401f-9873-aac896030eb3] received 2024-05-10T23:20:07.118860063Z [2024-05-10 23:20:07,118: INFO/ForkPoolWorker-15] [5a9934f5-b4f6-401f-9873-aac896030eb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:20:07.384450409Z [2024-05-10 23:20:07,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:20:08.481750526Z [2024-05-10 23:20:08,481: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:20:08.485170269Z [2024-05-10 23:20:08,484: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:08.506392061Z [2024-05-10 23:20:08,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:20:08.507706728Z [2024-05-10 23:20:08,507: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:08.507770449Z [2024-05-10 23:20:08,507: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:08.507874062Z [2024-05-10 23:20:08,507: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:08.507931123Z [2024-05-10 23:20:08,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:20:08.508152248Z [2024-05-10 23:20:08,508: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:20:08.508259332Z [2024-05-10 23:20:08,508: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:08.611083745Z [2024-05-10 23:20:08,610: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:09.178916531Z [2024-05-10 23:20:09,178: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a9934f5-b4f6-401f-9873-aac896030eb3] succeeded in 2.064063095000165s: None 2024-05-10T23:20:10.101314385Z [2024-05-10 23:20:10,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0c525b6-c811-47fe-a780-56dd374ea08f] received 2024-05-10T23:20:10.107342368Z [2024-05-10 23:20:10,107: INFO/ForkPoolWorker-15] [c0c525b6-c811-47fe-a780-56dd374ea08f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:20:10.370963406Z [2024-05-10 23:20:10,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:20:11.527554896Z [2024-05-10 23:20:11,527: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:20:11.531796990Z [2024-05-10 23:20:11,531: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:20:11.553577715Z [2024-05-10 23:20:11,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:20:11.554729654Z [2024-05-10 23:20:11,554: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:20:11.554752916Z [2024-05-10 23:20:11,554: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:20:11.554865580Z [2024-05-10 23:20:11,554: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:20:11.554876863Z [2024-05-10 23:20:11,554: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:20:11.555108343Z [2024-05-10 23:20:11,554: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:20:11.555129097Z [2024-05-10 23:20:11,555: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:20:11.632612463Z [2024-05-10 23:20:11,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:20:12.164635919Z [2024-05-10 23:20:12,164: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0c525b6-c811-47fe-a780-56dd374ea08f] succeeded in 2.0624164380001275s: None 2024-05-10T23:21:00.593486537Z [2024-05-10 23:21:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[826990d5-d30e-4f1c-af9d-a993131e2308] received 2024-05-10T23:21:00.598498908Z [2024-05-10 23:21:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[929aea8f-ec28-4e00-aee0-218530da429e] received 2024-05-10T23:21:00.600525970Z [2024-05-10 23:21:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02712b1d-3c4b-4ca4-a227-7987c31473c9] received 2024-05-10T23:21:00.610252744Z [2024-05-10 23:21:00,609: INFO/ForkPoolWorker-15] [826990d5-d30e-4f1c-af9d-a993131e2308] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:21:00.611939126Z [2024-05-10 23:21:00,611: INFO/ForkPoolWorker-16] [929aea8f-ec28-4e00-aee0-218530da429e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:21:00.616993889Z [2024-05-10 23:21:00,616: INFO/ForkPoolWorker-1] [02712b1d-3c4b-4ca4-a227-7987c31473c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:21:00.890597918Z [2024-05-10 23:21:00,887: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:21:00.914321240Z [2024-05-10 23:21:00,911: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:21:00.928323989Z [2024-05-10 23:21:00,925: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:21:01.102469076Z [2024-05-10 23:21:01,102: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:21:01.106735363Z [2024-05-10 23:21:01,106: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:21:01.212758624Z [2024-05-10 23:21:01,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:21:01.216885950Z [2024-05-10 23:21:01,216: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:21:01.216964758Z [2024-05-10 23:21:01,216: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:21:01.217160096Z [2024-05-10 23:21:01,217: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:21:01.217425836Z [2024-05-10 23:21:01,217: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:21:01.322407324Z [2024-05-10 23:21:01,322: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:21:01.921201582Z [2024-05-10 23:21:01,920: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02712b1d-3c4b-4ca4-a227-7987c31473c9] succeeded in 1.3192523909997362s: None 2024-05-10T23:21:02.043747781Z [2024-05-10 23:21:02,043: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:21:02.047373848Z [2024-05-10 23:21:02,046: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:21:02.071716068Z [2024-05-10 23:21:02,071: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:21:02.073476949Z [2024-05-10 23:21:02,073: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:21:02.073512041Z [2024-05-10 23:21:02,073: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:21:02.073730476Z [2024-05-10 23:21:02,073: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:21:02.073798725Z [2024-05-10 23:21:02,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:21:02.074142864Z [2024-05-10 23:21:02,073: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:21:02.074250385Z [2024-05-10 23:21:02,074: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:21:02.113307158Z [2024-05-10 23:21:02,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:21:02.117089431Z [2024-05-10 23:21:02,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:21:02.135664942Z [2024-05-10 23:21:02,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:21:02.137014286Z [2024-05-10 23:21:02,136: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:21:02.137115815Z [2024-05-10 23:21:02,136: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:21:02.137292067Z [2024-05-10 23:21:02,137: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:21:02.137370652Z [2024-05-10 23:21:02,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:21:02.137698195Z [2024-05-10 23:21:02,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:21:02.137752154Z [2024-05-10 23:21:02,137: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:21:02.153473514Z [2024-05-10 23:21:02,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:21:02.216299474Z [2024-05-10 23:21:02,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:21:03.747924081Z [2024-05-10 23:21:03,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[826990d5-d30e-4f1c-af9d-a993131e2308] succeeded in 3.152357420000044s: None 2024-05-10T23:21:05.166435316Z [2024-05-10 23:21:05,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[929aea8f-ec28-4e00-aee0-218530da429e] succeeded in 4.564020509999864s: None 2024-05-10T23:22:01.105117062Z [2024-05-10 23:22:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc31db60-bfb1-4e4f-8455-3ee2d92df467] received 2024-05-10T23:22:01.109336086Z [2024-05-10 23:22:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0111e6de-0d4f-4e46-9036-b5d01f2a3b41] received 2024-05-10T23:22:01.123846783Z [2024-05-10 23:22:01,123: INFO/ForkPoolWorker-16] [0111e6de-0d4f-4e46-9036-b5d01f2a3b41] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:22:01.132045124Z [2024-05-10 23:22:01,131: INFO/ForkPoolWorker-15] [dc31db60-bfb1-4e4f-8455-3ee2d92df467] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:22:01.142448854Z [2024-05-10 23:22:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a66b5493-9110-40ee-900d-60b6883b39d9] received 2024-05-10T23:22:01.145820309Z [2024-05-10 23:22:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[664ed74d-91e6-486c-9800-b8676496e1bd] received 2024-05-10T23:22:01.152941304Z [2024-05-10 23:22:01,152: INFO/ForkPoolWorker-1] [a66b5493-9110-40ee-900d-60b6883b39d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:22:01.153456376Z [2024-05-10 23:22:01,153: INFO/ForkPoolWorker-2] [664ed74d-91e6-486c-9800-b8676496e1bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:22:01.445613351Z [2024-05-10 23:22:01,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:22:01.577998390Z [2024-05-10 23:22:01,574: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:22:01.589463389Z [2024-05-10 23:22:01,585: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:22:01.656435461Z [2024-05-10 23:22:01,653: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:22:01.681609307Z [2024-05-10 23:22:01,681: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:22:01.845890253Z [2024-05-10 23:22:01,845: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:22:01.849750803Z [2024-05-10 23:22:01,849: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:22:01.880590452Z [2024-05-10 23:22:01,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:22:01.882183926Z [2024-05-10 23:22:01,881: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:22:01.882283326Z [2024-05-10 23:22:01,882: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:22:01.882364059Z [2024-05-10 23:22:01,882: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:22:01.882918606Z [2024-05-10 23:22:01,882: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:22:01.971180418Z [2024-05-10 23:22:01,970: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:22:02.275016603Z [2024-05-10 23:22:02,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc31db60-bfb1-4e4f-8455-3ee2d92df467] succeeded in 1.1644520330000887s: None 2024-05-10T23:22:02.586226050Z [2024-05-10 23:22:02,585: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0111e6de-0d4f-4e46-9036-b5d01f2a3b41] succeeded in 1.472129003000191s: None 2024-05-10T23:22:02.785011752Z [2024-05-10 23:22:02,784: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:22:02.788280008Z [2024-05-10 23:22:02,787: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:22:02.810956891Z [2024-05-10 23:22:02,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:22:02.812438084Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:22:02.812454622Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:22:02.812599540Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:22:02.812615400Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:22:02.812908856Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:22:02.812922248Z [2024-05-10 23:22:02,812: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:22:02.882111824Z [2024-05-10 23:22:02,881: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:22:02.885635159Z [2024-05-10 23:22:02,885: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:22:02.897980440Z [2024-05-10 23:22:02,897: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:22:02.916623255Z [2024-05-10 23:22:02,916: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:22:02.918173407Z [2024-05-10 23:22:02,917: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:22:02.918548089Z [2024-05-10 23:22:02,918: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:22:02.918808335Z [2024-05-10 23:22:02,918: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:22:02.919064945Z [2024-05-10 23:22:02,918: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:22:02.919630462Z [2024-05-10 23:22:02,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:22:02.919807590Z [2024-05-10 23:22:02,919: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:22:03.014612701Z [2024-05-10 23:22:03,014: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:22:04.749061891Z [2024-05-10 23:22:04,748: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a66b5493-9110-40ee-900d-60b6883b39d9] succeeded in 3.6044962080000005s: None 2024-05-10T23:22:05.077638456Z [2024-05-10 23:22:05,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[664ed74d-91e6-486c-9800-b8676496e1bd] succeeded in 3.9294822049996583s: None 2024-05-10T23:23:00.450167630Z [2024-05-10 23:23:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[176cd42c-8122-4184-b156-3b36b62ed05b] received 2024-05-10T23:23:00.458897164Z [2024-05-10 23:23:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[315577b1-8e24-4852-9458-86c29d795762] received 2024-05-10T23:23:00.459209224Z [2024-05-10 23:23:00,459: INFO/ForkPoolWorker-15] [176cd42c-8122-4184-b156-3b36b62ed05b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:23:00.464961299Z [2024-05-10 23:23:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e160bf9d-d464-4684-8de8-9d5f7e22053d] received 2024-05-10T23:23:00.474890657Z [2024-05-10 23:23:00,474: INFO/ForkPoolWorker-16] [315577b1-8e24-4852-9458-86c29d795762] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:23:00.475922422Z [2024-05-10 23:23:00,475: INFO/ForkPoolWorker-1] [e160bf9d-d464-4684-8de8-9d5f7e22053d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:23:00.859956618Z [2024-05-10 23:23:00,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:23:00.876253599Z [2024-05-10 23:23:00,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:23:00.933445073Z [2024-05-10 23:23:00,930: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:23:01.075886733Z [2024-05-10 23:23:01,075: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:23:01.082020280Z [2024-05-10 23:23:01,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:23:01.214089610Z [2024-05-10 23:23:01,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:23:01.217750660Z [2024-05-10 23:23:01,217: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:23:01.218404739Z [2024-05-10 23:23:01,217: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:23:01.219814553Z [2024-05-10 23:23:01,218: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:23:01.220062918Z [2024-05-10 23:23:01,219: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:23:01.355955140Z [2024-05-10 23:23:01,355: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:23:02.134583821Z [2024-05-10 23:23:02,134: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e160bf9d-d464-4684-8de8-9d5f7e22053d] succeeded in 1.6674758819999624s: None 2024-05-10T23:23:02.487441316Z [2024-05-10 23:23:02,486: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:23:02.499835593Z [2024-05-10 23:23:02,499: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:23:02.527148531Z [2024-05-10 23:23:02,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:23:02.531692789Z [2024-05-10 23:23:02,531: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:23:02.531753626Z [2024-05-10 23:23:02,531: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:23:02.531916715Z [2024-05-10 23:23:02,531: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:23:02.531976769Z [2024-05-10 23:23:02,531: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:23:02.532333066Z [2024-05-10 23:23:02,532: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:23:02.532405446Z [2024-05-10 23:23:02,532: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:23:02.612791045Z [2024-05-10 23:23:02,612: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:23:02.616754033Z [2024-05-10 23:23:02,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:23:02.632945336Z [2024-05-10 23:23:02,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:23:02.654604254Z [2024-05-10 23:23:02,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:23:02.658459733Z [2024-05-10 23:23:02,658: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:23:02.658616707Z [2024-05-10 23:23:02,658: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:23:02.658925250Z [2024-05-10 23:23:02,658: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:23:02.659097837Z [2024-05-10 23:23:02,658: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:23:02.659481502Z [2024-05-10 23:23:02,659: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:23:02.659861819Z [2024-05-10 23:23:02,659: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:23:02.772967565Z [2024-05-10 23:23:02,772: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:23:05.463129509Z [2024-05-10 23:23:05,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[315577b1-8e24-4852-9458-86c29d795762] succeeded in 5.000714168999366s: None 2024-05-10T23:23:05.778260996Z [2024-05-10 23:23:05,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[176cd42c-8122-4184-b156-3b36b62ed05b] succeeded in 5.325297535999198s: None 2024-05-10T23:24:01.009718937Z [2024-05-10 23:24:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[419789ed-6ce9-4ebf-9a76-6d3a649e4896] received 2024-05-10T23:24:01.019614966Z [2024-05-10 23:24:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eab431b9-a94d-4c53-ac88-6694fea86e33] received 2024-05-10T23:24:01.025843019Z [2024-05-10 23:24:01,022: INFO/ForkPoolWorker-15] [419789ed-6ce9-4ebf-9a76-6d3a649e4896] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:24:01.028527754Z [2024-05-10 23:24:01,026: INFO/ForkPoolWorker-16] [eab431b9-a94d-4c53-ac88-6694fea86e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:24:01.038029792Z [2024-05-10 23:24:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2430168-8b2b-4693-b49d-7fd906cb1234] received 2024-05-10T23:24:01.041252993Z [2024-05-10 23:24:01,041: INFO/ForkPoolWorker-1] [a2430168-8b2b-4693-b49d-7fd906cb1234] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:24:01.054851234Z [2024-05-10 23:24:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a790ebe7-8486-4db9-aff2-f0ab079d4904] received 2024-05-10T23:24:01.092666901Z [2024-05-10 23:24:01,091: INFO/ForkPoolWorker-2] [a790ebe7-8486-4db9-aff2-f0ab079d4904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:24:01.571314445Z [2024-05-10 23:24:01,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:24:01.677306489Z [2024-05-10 23:24:01,673: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:24:01.815073133Z [2024-05-10 23:24:01,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:24:01.956186491Z [2024-05-10 23:24:01,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:24:02.099636166Z [2024-05-10 23:24:02,099: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:24:02.104231564Z [2024-05-10 23:24:02,103: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:24:02.167662206Z [2024-05-10 23:24:02,167: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:24:02.175650841Z [2024-05-10 23:24:02,175: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:24:02.175700555Z [2024-05-10 23:24:02,175: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:24:02.176190972Z [2024-05-10 23:24:02,175: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:24:02.176451251Z [2024-05-10 23:24:02,176: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:24:02.330883379Z [2024-05-10 23:24:02,330: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:24:02.644687114Z [2024-05-10 23:24:02,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:24:03.160399683Z [2024-05-10 23:24:03,159: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2430168-8b2b-4693-b49d-7fd906cb1234] succeeded in 2.1271721049997723s: None 2024-05-10T23:24:03.206240406Z [2024-05-10 23:24:03,205: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:24:03.209453783Z [2024-05-10 23:24:03,208: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:24:03.258273340Z [2024-05-10 23:24:03,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:24:03.262660145Z [2024-05-10 23:24:03,262: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:24:03.262679664Z [2024-05-10 23:24:03,262: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:24:03.262831268Z [2024-05-10 23:24:03,262: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:24:03.262897181Z [2024-05-10 23:24:03,262: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:24:03.263410422Z [2024-05-10 23:24:03,263: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:24:03.263571817Z [2024-05-10 23:24:03,263: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:24:03.270370365Z [2024-05-10 23:24:03,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[419789ed-6ce9-4ebf-9a76-6d3a649e4896] succeeded in 2.2551597100000436s: None 2024-05-10T23:24:03.365199813Z [2024-05-10 23:24:03,364: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:24:03.388860191Z [2024-05-10 23:24:03,388: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:24:03.392448173Z [2024-05-10 23:24:03,391: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:24:03.413040904Z [2024-05-10 23:24:03,412: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:24:03.415258976Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:24:03.415365008Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:24:03.415564967Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:24:03.415666198Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:24:03.416025751Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:24:03.416211603Z [2024-05-10 23:24:03,415: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:24:03.549127843Z [2024-05-10 23:24:03,548: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:24:05.097993401Z [2024-05-10 23:24:05,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eab431b9-a94d-4c53-ac88-6694fea86e33] succeeded in 4.075496294999539s: None 2024-05-10T23:24:05.348588239Z [2024-05-10 23:24:05,348: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a790ebe7-8486-4db9-aff2-f0ab079d4904] succeeded in 4.290874055000131s: None 2024-05-10T23:25:00.903294247Z [2024-05-10 23:25:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cb7b4cc-ce0b-4583-b7ac-339fd049dfc8] received 2024-05-10T23:25:00.907406465Z [2024-05-10 23:25:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[384c23d6-ce3e-4f5c-bc57-e950d6cbd101] received 2024-05-10T23:25:00.910936222Z [2024-05-10 23:25:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1d2be36-69ac-45e8-bef8-ee7374c499b1] received 2024-05-10T23:25:00.913718325Z [2024-05-10 23:25:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d84132d-7aec-43c3-aaa0-58f4b0d34322] received 2024-05-10T23:25:00.918577302Z [2024-05-10 23:25:00,918: INFO/ForkPoolWorker-16] [384c23d6-ce3e-4f5c-bc57-e950d6cbd101] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:25:00.920443305Z [2024-05-10 23:25:00,920: INFO/ForkPoolWorker-1] [f1d2be36-69ac-45e8-bef8-ee7374c499b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:25:00.932161497Z [2024-05-10 23:25:00,931: INFO/ForkPoolWorker-15] [9cb7b4cc-ce0b-4583-b7ac-339fd049dfc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:00.942452732Z [2024-05-10 23:25:00,942: INFO/ForkPoolWorker-2] [0d84132d-7aec-43c3-aaa0-58f4b0d34322] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:25:01.297580336Z [2024-05-10 23:25:01,293: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:25:01.402883197Z [2024-05-10 23:25:01,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:25:01.412912070Z [2024-05-10 23:25:01,409: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:25:01.467359871Z [2024-05-10 23:25:01,462: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:25:01.688816910Z [2024-05-10 23:25:01,688: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:25:01.697162778Z [2024-05-10 23:25:01,696: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:01.729406937Z [2024-05-10 23:25:01,729: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:25:01.730537286Z [2024-05-10 23:25:01,730: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:25:01.730652919Z [2024-05-10 23:25:01,730: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:25:01.730727984Z [2024-05-10 23:25:01,730: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:25:01.730950237Z [2024-05-10 23:25:01,730: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:25:01.850666195Z [2024-05-10 23:25:01,850: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:02.550800602Z [2024-05-10 23:25:02,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[384c23d6-ce3e-4f5c-bc57-e950d6cbd101] succeeded in 1.6416349290002472s: None 2024-05-10T23:25:02.593824807Z [2024-05-10 23:25:02,593: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:25:02.602083379Z [2024-05-10 23:25:02,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:02.624061697Z [2024-05-10 23:25:02,623: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:25:02.625599655Z [2024-05-10 23:25:02,625: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:02.625855700Z [2024-05-10 23:25:02,625: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:02.626349897Z [2024-05-10 23:25:02,626: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:02.626554190Z [2024-05-10 23:25:02,626: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:25:02.626931427Z [2024-05-10 23:25:02,626: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:25:02.627789052Z [2024-05-10 23:25:02,627: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:02.666961323Z [2024-05-10 23:25:02,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:25:02.670467001Z [2024-05-10 23:25:02,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:02.704894700Z [2024-05-10 23:25:02,704: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:02.715422154Z [2024-05-10 23:25:02,715: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:25:02.718566798Z [2024-05-10 23:25:02,718: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:02.718717840Z [2024-05-10 23:25:02,718: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:02.718925057Z [2024-05-10 23:25:02,718: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:02.719073602Z [2024-05-10 23:25:02,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:25:02.719474335Z [2024-05-10 23:25:02,719: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:25:02.719614121Z [2024-05-10 23:25:02,719: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:02.824980366Z [2024-05-10 23:25:02,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:02.858915258Z [2024-05-10 23:25:02,858: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:25:02.862211866Z [2024-05-10 23:25:02,861: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:02.891926881Z [2024-05-10 23:25:02,891: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:25:02.893697381Z [2024-05-10 23:25:02,893: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:02.893960053Z [2024-05-10 23:25:02,893: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:02.894252713Z [2024-05-10 23:25:02,894: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:02.894422341Z [2024-05-10 23:25:02,894: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:25:02.895022349Z [2024-05-10 23:25:02,894: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:25:02.895170527Z [2024-05-10 23:25:02,895: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:03.005094086Z [2024-05-10 23:25:03,004: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:03.396007892Z [2024-05-10 23:25:03,395: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9cb7b4cc-ce0b-4583-b7ac-339fd049dfc8] succeeded in 2.4863685059999625s: None 2024-05-10T23:25:03.813041853Z [2024-05-10 23:25:03,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fed212f-d4b3-48b5-9850-24be848c1c80] received 2024-05-10T23:25:03.821894494Z [2024-05-10 23:25:03,821: INFO/ForkPoolWorker-15] [0fed212f-d4b3-48b5-9850-24be848c1c80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:04.110784528Z [2024-05-10 23:25:04,106: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:25:04.542889410Z [2024-05-10 23:25:04,542: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1d2be36-69ac-45e8-bef8-ee7374c499b1] succeeded in 3.6273019000000204s: None 2024-05-10T23:25:04.544755355Z [2024-05-10 23:25:04,544: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0d84132d-7aec-43c3-aaa0-58f4b0d34322] succeeded in 3.6283548380006323s: None 2024-05-10T23:25:05.260317714Z [2024-05-10 23:25:05,259: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:25:05.263693402Z [2024-05-10 23:25:05,263: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:05.288961223Z [2024-05-10 23:25:05,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:25:05.291157232Z [2024-05-10 23:25:05,290: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:05.291177295Z [2024-05-10 23:25:05,290: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:05.291498761Z [2024-05-10 23:25:05,291: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:05.291751526Z [2024-05-10 23:25:05,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:25:05.292507195Z [2024-05-10 23:25:05,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:25:05.292943839Z [2024-05-10 23:25:05,292: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:05.414905427Z [2024-05-10 23:25:05,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:06.036453748Z [2024-05-10 23:25:06,035: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fed212f-d4b3-48b5-9850-24be848c1c80] succeeded in 2.221996147000027s: None 2024-05-10T23:25:07.019868011Z [2024-05-10 23:25:07,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a31debcd-7786-4fa7-95cc-ee4bdd8c13e0] received 2024-05-10T23:25:07.030061577Z [2024-05-10 23:25:07,029: INFO/ForkPoolWorker-15] [a31debcd-7786-4fa7-95cc-ee4bdd8c13e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:25:07.430743636Z [2024-05-10 23:25:07,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:25:08.692719228Z [2024-05-10 23:25:08,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:25:08.696060112Z [2024-05-10 23:25:08,695: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:08.720493264Z [2024-05-10 23:25:08,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:25:08.721789735Z [2024-05-10 23:25:08,721: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:08.722000581Z [2024-05-10 23:25:08,721: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:08.722167555Z [2024-05-10 23:25:08,721: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:08.722289453Z [2024-05-10 23:25:08,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:25:08.722543699Z [2024-05-10 23:25:08,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:25:08.722664394Z [2024-05-10 23:25:08,722: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:08.801761780Z [2024-05-10 23:25:08,801: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:09.345579310Z [2024-05-10 23:25:09,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a31debcd-7786-4fa7-95cc-ee4bdd8c13e0] succeeded in 2.3217352100000426s: None 2024-05-10T23:25:10.080660090Z [2024-05-10 23:25:10,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d29914b-2db7-41fc-bbee-5737480ad054] received 2024-05-10T23:25:10.092312969Z [2024-05-10 23:25:10,091: INFO/ForkPoolWorker-15] [3d29914b-2db7-41fc-bbee-5737480ad054] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:25:10.366510064Z [2024-05-10 23:25:10,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:25:11.480469328Z [2024-05-10 23:25:11,479: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:25:11.483953630Z [2024-05-10 23:25:11,483: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:25:11.510515694Z [2024-05-10 23:25:11,510: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:25:11.512255597Z [2024-05-10 23:25:11,511: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:25:11.512283533Z [2024-05-10 23:25:11,512: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:25:11.512434711Z [2024-05-10 23:25:11,512: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:25:11.512508772Z [2024-05-10 23:25:11,512: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:25:11.512767674Z [2024-05-10 23:25:11,512: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:25:11.512795066Z [2024-05-10 23:25:11,512: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:25:11.603292419Z [2024-05-10 23:25:11,602: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:25:12.206675786Z [2024-05-10 23:25:12,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d29914b-2db7-41fc-bbee-5737480ad054] succeeded in 2.1245661000002656s: None 2024-05-10T23:26:00.930876898Z [2024-05-10 23:26:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[273c210b-f70c-41ce-87cf-0e3c0db62c9f] received 2024-05-10T23:26:00.945991223Z [2024-05-10 23:26:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66961496-7c08-4825-a540-e84686cc0ea2] received 2024-05-10T23:26:00.948355214Z [2024-05-10 23:26:00,947: INFO/ForkPoolWorker-15] [273c210b-f70c-41ce-87cf-0e3c0db62c9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:26:00.952122139Z [2024-05-10 23:26:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce564efe-d10e-4fcb-8574-670fd5120e2b] received 2024-05-10T23:26:00.958225305Z [2024-05-10 23:26:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e9b2992-d349-4cce-9a93-a1088c2e7c29] received 2024-05-10T23:26:00.960572277Z [2024-05-10 23:26:00,960: INFO/ForkPoolWorker-1] [ce564efe-d10e-4fcb-8574-670fd5120e2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:26:00.965501129Z [2024-05-10 23:26:00,965: INFO/ForkPoolWorker-2] [9e9b2992-d349-4cce-9a93-a1088c2e7c29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:26:00.967597135Z [2024-05-10 23:26:00,967: INFO/ForkPoolWorker-16] [66961496-7c08-4825-a540-e84686cc0ea2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:26:01.321580545Z [2024-05-10 23:26:01,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:26:01.483552546Z [2024-05-10 23:26:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:26:01.505249208Z [2024-05-10 23:26:01,500: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:26:01.505747059Z [2024-05-10 23:26:01,502: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:26:01.615476319Z [2024-05-10 23:26:01,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:26:01.688850547Z [2024-05-10 23:26:01,688: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:26:01.695369856Z [2024-05-10 23:26:01,694: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:26:01.738377122Z [2024-05-10 23:26:01,737: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:26:01.741360707Z [2024-05-10 23:26:01,740: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:26:01.741801260Z [2024-05-10 23:26:01,741: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:26:01.742395409Z [2024-05-10 23:26:01,742: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:26:01.743239248Z [2024-05-10 23:26:01,742: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:26:01.863877028Z [2024-05-10 23:26:01,863: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:26:02.195998795Z [2024-05-10 23:26:02,195: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[273c210b-f70c-41ce-87cf-0e3c0db62c9f] succeeded in 1.2598208760000489s: None 2024-05-10T23:26:02.582363979Z [2024-05-10 23:26:02,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce564efe-d10e-4fcb-8574-670fd5120e2b] succeeded in 1.6280229920002967s: None 2024-05-10T23:26:02.795715594Z [2024-05-10 23:26:02,795: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:26:02.799040746Z [2024-05-10 23:26:02,798: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:26:02.825654887Z [2024-05-10 23:26:02,825: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:26:02.827209204Z [2024-05-10 23:26:02,826: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:26:02.827400889Z [2024-05-10 23:26:02,827: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:26:02.827521382Z [2024-05-10 23:26:02,827: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:26:02.827573860Z [2024-05-10 23:26:02,827: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:26:02.827678123Z [2024-05-10 23:26:02,827: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:26:02.827756911Z [2024-05-10 23:26:02,827: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:26:02.923324192Z [2024-05-10 23:26:02,922: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:26:03.031639118Z [2024-05-10 23:26:03,031: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:26:03.035564650Z [2024-05-10 23:26:03,035: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:26:03.067393452Z [2024-05-10 23:26:03,066: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:26:03.069275289Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:26:03.069336741Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:26:03.069659376Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:26:03.069762058Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:26:03.069942811Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:26:03.070011619Z [2024-05-10 23:26:03,069: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:26:03.174672436Z [2024-05-10 23:26:03,174: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:26:05.360995010Z [2024-05-10 23:26:05,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e9b2992-d349-4cce-9a93-a1088c2e7c29] succeeded in 4.399806248999994s: None 2024-05-10T23:26:05.395696482Z [2024-05-10 23:26:05,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66961496-7c08-4825-a540-e84686cc0ea2] succeeded in 4.440828024999973s: None 2024-05-10T23:27:00.758019964Z [2024-05-10 23:27:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6da77507-8f1c-48d1-9a6d-48640928d20a] received 2024-05-10T23:27:00.768023980Z [2024-05-10 23:27:00,767: INFO/ForkPoolWorker-15] [6da77507-8f1c-48d1-9a6d-48640928d20a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:27:00.769978925Z [2024-05-10 23:27:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d75bc3-d9cb-4612-8f33-49651b8644c2] received 2024-05-10T23:27:00.776355937Z [2024-05-10 23:27:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d518598-fbe2-4328-9a18-ba95957b8c5e] received 2024-05-10T23:27:00.779550038Z [2024-05-10 23:27:00,779: INFO/ForkPoolWorker-16] [72d75bc3-d9cb-4612-8f33-49651b8644c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:27:00.793287438Z [2024-05-10 23:27:00,792: INFO/ForkPoolWorker-1] [8d518598-fbe2-4328-9a18-ba95957b8c5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:27:01.158604822Z [2024-05-10 23:27:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:27:01.187610205Z [2024-05-10 23:27:01,184: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:27:01.308407597Z [2024-05-10 23:27:01,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:27:01.385182993Z [2024-05-10 23:27:01,384: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:27:01.389766501Z [2024-05-10 23:27:01,389: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:27:01.421658816Z [2024-05-10 23:27:01,421: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:27:01.423243985Z [2024-05-10 23:27:01,422: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:27:01.423429052Z [2024-05-10 23:27:01,423: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:27:01.423544849Z [2024-05-10 23:27:01,423: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:27:01.423832375Z [2024-05-10 23:27:01,423: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:27:01.538703585Z [2024-05-10 23:27:01,538: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:27:02.295853282Z [2024-05-10 23:27:02,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d518598-fbe2-4328-9a18-ba95957b8c5e] succeeded in 1.517780710999432s: None 2024-05-10T23:27:02.622181178Z [2024-05-10 23:27:02,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:27:02.625825911Z [2024-05-10 23:27:02,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:27:02.652254177Z [2024-05-10 23:27:02,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:27:02.653726478Z [2024-05-10 23:27:02,653: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:27:02.653738579Z [2024-05-10 23:27:02,653: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:27:02.653935032Z [2024-05-10 23:27:02,653: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:27:02.653976694Z [2024-05-10 23:27:02,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:27:02.654282086Z [2024-05-10 23:27:02,654: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:27:02.654294130Z [2024-05-10 23:27:02,654: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:27:02.676197483Z [2024-05-10 23:27:02,675: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:27:02.679989994Z [2024-05-10 23:27:02,679: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:27:02.706709102Z [2024-05-10 23:27:02,706: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:27:02.708248020Z [2024-05-10 23:27:02,708: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:27:02.708387376Z [2024-05-10 23:27:02,708: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:27:02.708576310Z [2024-05-10 23:27:02,708: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:27:02.708697718Z [2024-05-10 23:27:02,708: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:27:02.709263541Z [2024-05-10 23:27:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:27:02.709408789Z [2024-05-10 23:27:02,709: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:27:02.778852749Z [2024-05-10 23:27:02,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:27:02.810590109Z [2024-05-10 23:27:02,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:27:04.474483702Z [2024-05-10 23:27:04,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6da77507-8f1c-48d1-9a6d-48640928d20a] succeeded in 3.7147132630007036s: None 2024-05-10T23:27:04.665336763Z [2024-05-10 23:27:04,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72d75bc3-d9cb-4612-8f33-49651b8644c2] succeeded in 3.893372618000285s: None 2024-05-10T23:28:00.639411613Z [2024-05-10 23:28:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32a82198-df68-4767-90b5-ac7f23b80b98] received 2024-05-10T23:28:00.641096572Z [2024-05-10 23:28:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c365fb-c27d-4bde-886c-0690b1b3f529] received 2024-05-10T23:28:00.644166109Z [2024-05-10 23:28:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23fe0b41-35e4-4d0e-9aba-327001683ff0] received 2024-05-10T23:28:00.650860715Z [2024-05-10 23:28:00,650: INFO/ForkPoolWorker-1] [23fe0b41-35e4-4d0e-9aba-327001683ff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:28:00.653194691Z [2024-05-10 23:28:00,652: INFO/ForkPoolWorker-16] [97c365fb-c27d-4bde-886c-0690b1b3f529] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:28:00.654687826Z [2024-05-10 23:28:00,654: INFO/ForkPoolWorker-15] [32a82198-df68-4767-90b5-ac7f23b80b98] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:28:00.656972325Z [2024-05-10 23:28:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb76177d-bb42-4dd6-9c55-4168d83c97c2] received 2024-05-10T23:28:00.665639680Z [2024-05-10 23:28:00,665: INFO/ForkPoolWorker-2] [cb76177d-bb42-4dd6-9c55-4168d83c97c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:28:00.949094267Z [2024-05-10 23:28:00,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:28:01.033994676Z [2024-05-10 23:28:01,022: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:28:01.041986460Z [2024-05-10 23:28:01,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:28:01.047986451Z [2024-05-10 23:28:01,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:28:01.257559816Z [2024-05-10 23:28:01,257: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:28:01.261612539Z [2024-05-10 23:28:01,261: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:28:01.285918545Z [2024-05-10 23:28:01,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:28:01.287032065Z [2024-05-10 23:28:01,286: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:28:01.287159961Z [2024-05-10 23:28:01,286: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:28:01.287221544Z [2024-05-10 23:28:01,287: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:28:01.287434571Z [2024-05-10 23:28:01,287: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:28:01.378155770Z [2024-05-10 23:28:01,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:28:01.460692257Z [2024-05-10 23:28:01,460: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:28:02.024412617Z [2024-05-10 23:28:02,024: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23fe0b41-35e4-4d0e-9aba-327001683ff0] succeeded in 1.378924243000256s: None 2024-05-10T23:28:02.045299892Z [2024-05-10 23:28:02,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32a82198-df68-4767-90b5-ac7f23b80b98] succeeded in 1.403275904000111s: None 2024-05-10T23:28:02.407871825Z [2024-05-10 23:28:02,407: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:28:02.411356420Z [2024-05-10 23:28:02,410: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:28:02.431038712Z [2024-05-10 23:28:02,430: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:28:02.433705774Z [2024-05-10 23:28:02,433: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:28:02.434936387Z [2024-05-10 23:28:02,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:28:02.435472372Z [2024-05-10 23:28:02,435: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:28:02.435637709Z [2024-05-10 23:28:02,435: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:28:02.435844788Z [2024-05-10 23:28:02,435: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:28:02.435945617Z [2024-05-10 23:28:02,435: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:28:02.436539361Z [2024-05-10 23:28:02,436: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:28:02.436632908Z [2024-05-10 23:28:02,436: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:28:02.458687387Z [2024-05-10 23:28:02,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:28:02.460313950Z [2024-05-10 23:28:02,460: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:28:02.461024655Z [2024-05-10 23:28:02,460: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:28:02.461070510Z [2024-05-10 23:28:02,460: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:28:02.461109694Z [2024-05-10 23:28:02,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:28:02.461335509Z [2024-05-10 23:28:02,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:28:02.461348455Z [2024-05-10 23:28:02,461: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:28:02.522118061Z [2024-05-10 23:28:02,521: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:28:02.543201717Z [2024-05-10 23:28:02,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:28:04.120447930Z [2024-05-10 23:28:04,120: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb76177d-bb42-4dd6-9c55-4168d83c97c2] succeeded in 3.460234725999726s: None 2024-05-10T23:28:04.714310610Z [2024-05-10 23:28:04,713: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97c365fb-c27d-4bde-886c-0690b1b3f529] succeeded in 4.070907831000113s: None 2024-05-10T23:29:00.306629852Z [2024-05-10 23:29:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9517d02e-f1ab-4b34-9216-702dbf1c9876] received 2024-05-10T23:29:00.318317685Z [2024-05-10 23:29:00,311: INFO/ForkPoolWorker-15] [9517d02e-f1ab-4b34-9216-702dbf1c9876] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:29:00.338351557Z [2024-05-10 23:29:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26da115f-d515-48f4-a65b-0e7e37a24cf3] received 2024-05-10T23:29:00.350044627Z [2024-05-10 23:29:00,345: INFO/ForkPoolWorker-16] [26da115f-d515-48f4-a65b-0e7e37a24cf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:29:00.358100049Z [2024-05-10 23:29:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cccab82-aa6e-4a72-a783-d57b1aacc2a0] received 2024-05-10T23:29:00.366606283Z [2024-05-10 23:29:00,366: INFO/ForkPoolWorker-1] [2cccab82-aa6e-4a72-a783-d57b1aacc2a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:29:00.764099233Z [2024-05-10 23:29:00,758: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:29:00.853586044Z [2024-05-10 23:29:00,849: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:29:01.100547942Z [2024-05-10 23:29:01,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:29:01.138820848Z [2024-05-10 23:29:01,138: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:29:01.143139413Z [2024-05-10 23:29:01,142: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:29:01.208384251Z [2024-05-10 23:29:01,208: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:29:01.210859293Z [2024-05-10 23:29:01,210: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:29:01.210946053Z [2024-05-10 23:29:01,210: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:29:01.210981024Z [2024-05-10 23:29:01,210: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:29:01.211344877Z [2024-05-10 23:29:01,211: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:29:01.339849019Z [2024-05-10 23:29:01,339: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:29:02.052786489Z [2024-05-10 23:29:02,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9517d02e-f1ab-4b34-9216-702dbf1c9876] succeeded in 1.750189753000086s: None 2024-05-10T23:29:02.222051319Z [2024-05-10 23:29:02,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:29:02.225778610Z [2024-05-10 23:29:02,225: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:29:02.259587257Z [2024-05-10 23:29:02,259: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:29:02.261367164Z [2024-05-10 23:29:02,261: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:29:02.261623219Z [2024-05-10 23:29:02,261: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:29:02.261908098Z [2024-05-10 23:29:02,261: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:29:02.262100630Z [2024-05-10 23:29:02,261: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:29:02.262723823Z [2024-05-10 23:29:02,262: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:29:02.262819733Z [2024-05-10 23:29:02,262: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:29:02.388470191Z [2024-05-10 23:29:02,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:29:02.524111813Z [2024-05-10 23:29:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:29:02.527765723Z [2024-05-10 23:29:02,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:29:02.549111869Z [2024-05-10 23:29:02,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:29:02.550990111Z [2024-05-10 23:29:02,550: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:29:02.551033738Z [2024-05-10 23:29:02,550: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:29:02.551186329Z [2024-05-10 23:29:02,551: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:29:02.551221039Z [2024-05-10 23:29:02,551: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:29:02.551673292Z [2024-05-10 23:29:02,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:29:02.551712359Z [2024-05-10 23:29:02,551: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:29:02.645034094Z [2024-05-10 23:29:02,644: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:29:04.065115762Z [2024-05-10 23:29:04,061: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2cccab82-aa6e-4a72-a783-d57b1aacc2a0] succeeded in 3.70687598800032s: None 2024-05-10T23:29:04.672296763Z [2024-05-10 23:29:04,671: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26da115f-d515-48f4-a65b-0e7e37a24cf3] succeeded in 4.331701678999707s: None 2024-05-10T23:30:01.286491372Z [2024-05-10 23:30:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d133cf7-ce7a-44b8-9957-eed00858a4d5] received 2024-05-10T23:30:01.289933896Z [2024-05-10 23:30:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc66060a-cb26-41e7-b3bd-7df36eae6877] received 2024-05-10T23:30:01.293237951Z [2024-05-10 23:30:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e285551b-15f4-4979-8235-15e1cbb6eb20] received 2024-05-10T23:30:01.295295487Z [2024-05-10 23:30:01,294: INFO/ForkPoolWorker-15] [3d133cf7-ce7a-44b8-9957-eed00858a4d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:30:01.302438155Z [2024-05-10 23:30:01,302: INFO/ForkPoolWorker-1] [e285551b-15f4-4979-8235-15e1cbb6eb20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:30:01.304552030Z [2024-05-10 23:30:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[833feec0-9d2a-405a-80c4-6ac7f0c02c9b] received 2024-05-10T23:30:01.305279271Z [2024-05-10 23:30:01,304: INFO/ForkPoolWorker-16] [cc66060a-cb26-41e7-b3bd-7df36eae6877] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:01.315035313Z [2024-05-10 23:30:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1af61946-3ef2-49a7-9899-c39e114fa82b] received 2024-05-10T23:30:01.321599583Z [2024-05-10 23:30:01,321: INFO/ForkPoolWorker-2] [833feec0-9d2a-405a-80c4-6ac7f0c02c9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:30:01.325189925Z [2024-05-10 23:30:01,324: INFO/ForkPoolWorker-3] [1af61946-3ef2-49a7-9899-c39e114fa82b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:30:01.737165975Z [2024-05-10 23:30:01,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:30:01.764293673Z [2024-05-10 23:30:01,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:30:01.803740999Z [2024-05-10 23:30:01,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:30:01.814808107Z [2024-05-10 23:30:01,807: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:30:01.861451897Z [2024-05-10 23:30:01,856: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:30:01.974844966Z [2024-05-10 23:30:01,974: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:30:01.978813535Z [2024-05-10 23:30:01,978: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:02.035871215Z [2024-05-10 23:30:02,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:30:02.040387702Z [2024-05-10 23:30:02,040: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:30:02.040526644Z [2024-05-10 23:30:02,040: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:30:02.040598986Z [2024-05-10 23:30:02,040: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:30:02.040908208Z [2024-05-10 23:30:02,040: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:30:02.125113402Z [2024-05-10 23:30:02,124: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:02.186329544Z [2024-05-10 23:30:02,186: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:02.762911918Z [2024-05-10 23:30:02,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d133cf7-ce7a-44b8-9957-eed00858a4d5] succeeded in 1.4746682459999647s: None 2024-05-10T23:30:02.774149153Z [2024-05-10 23:30:02,773: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[833feec0-9d2a-405a-80c4-6ac7f0c02c9b] succeeded in 1.4580176150002444s: None 2024-05-10T23:30:03.325099928Z [2024-05-10 23:30:03,324: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:30:03.328666654Z [2024-05-10 23:30:03,328: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:03.356970354Z [2024-05-10 23:30:03,356: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:30:03.358422229Z [2024-05-10 23:30:03,358: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-10T23:30:03.359073134Z [2024-05-10 23:30:03,358: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:03.359283866Z [2024-05-10 23:30:03,359: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:03.359525410Z [2024-05-10 23:30:03,359: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:03.359707303Z [2024-05-10 23:30:03,359: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:30:03.360102530Z [2024-05-10 23:30:03,359: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:30:03.360286665Z [2024-05-10 23:30:03,360: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:03.362246547Z [2024-05-10 23:30:03,361: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:03.384114123Z [2024-05-10 23:30:03,383: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T23:30:03.385668147Z [2024-05-10 23:30:03,385: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:03.385679354Z [2024-05-10 23:30:03,385: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:03.385768429Z [2024-05-10 23:30:03,385: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:03.385815161Z [2024-05-10 23:30:03,385: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-10T23:30:03.386168384Z [2024-05-10 23:30:03,386: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:30:03.386196132Z [2024-05-10 23:30:03,386: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:03.438011827Z [2024-05-10 23:30:03,437: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:30:03.441582769Z [2024-05-10 23:30:03,441: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:03.451953686Z [2024-05-10 23:30:03,451: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:03.460653374Z [2024-05-10 23:30:03,460: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:30:03.461947834Z [2024-05-10 23:30:03,461: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:03.462030899Z [2024-05-10 23:30:03,461: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:03.462208290Z [2024-05-10 23:30:03,462: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:03.462276044Z [2024-05-10 23:30:03,462: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:30:03.462561077Z [2024-05-10 23:30:03,462: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:30:03.462568788Z [2024-05-10 23:30:03,462: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:03.469565206Z [2024-05-10 23:30:03,469: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:03.552522862Z [2024-05-10 23:30:03,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:04.162167260Z [2024-05-10 23:30:04,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc66060a-cb26-41e7-b3bd-7df36eae6877] succeeded in 2.8667090340004506s: None 2024-05-10T23:30:04.187445606Z [2024-05-10 23:30:04,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd47a26-21ff-4f7d-931c-54d281fe3b76] received 2024-05-10T23:30:04.198318320Z [2024-05-10 23:30:04,198: INFO/ForkPoolWorker-15] [4cd47a26-21ff-4f7d-931c-54d281fe3b76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:04.493103902Z [2024-05-10 23:30:04,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:30:05.227600595Z [2024-05-10 23:30:05,227: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e285551b-15f4-4979-8235-15e1cbb6eb20] succeeded in 3.93267165799989s: None 2024-05-10T23:30:05.504341021Z [2024-05-10 23:30:05,503: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1af61946-3ef2-49a7-9899-c39e114fa82b] succeeded in 4.187647745000504s: None 2024-05-10T23:30:05.630964402Z [2024-05-10 23:30:05,630: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:30:05.634289465Z [2024-05-10 23:30:05,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:05.656135322Z [2024-05-10 23:30:05,655: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:30:05.657524809Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:05.657563540Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:05.657685449Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:05.657696012Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:30:05.657703918Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:30:05.657834657Z [2024-05-10 23:30:05,657: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:05.760150484Z [2024-05-10 23:30:05,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:06.381276162Z [2024-05-10 23:30:06,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cd47a26-21ff-4f7d-931c-54d281fe3b76] succeeded in 2.190512877000401s: None 2024-05-10T23:30:07.297208407Z [2024-05-10 23:30:07,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a51b3cd5-18af-44f9-b86f-a067377ac721] received 2024-05-10T23:30:07.310832808Z [2024-05-10 23:30:07,310: INFO/ForkPoolWorker-15] [a51b3cd5-18af-44f9-b86f-a067377ac721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:30:07.621490037Z [2024-05-10 23:30:07,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:30:08.724301512Z [2024-05-10 23:30:08,723: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:30:08.727686874Z [2024-05-10 23:30:08,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:08.752443893Z [2024-05-10 23:30:08,752: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:30:08.754040150Z [2024-05-10 23:30:08,753: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:08.754241069Z [2024-05-10 23:30:08,753: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:08.754509056Z [2024-05-10 23:30:08,754: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:08.754735532Z [2024-05-10 23:30:08,754: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:30:08.755244734Z [2024-05-10 23:30:08,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:30:08.755444839Z [2024-05-10 23:30:08,755: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:08.880333875Z [2024-05-10 23:30:08,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:09.510828767Z [2024-05-10 23:30:09,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a51b3cd5-18af-44f9-b86f-a067377ac721] succeeded in 2.2101340449999043s: None 2024-05-10T23:30:10.344055523Z [2024-05-10 23:30:10,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f23e5c-1a4e-4f56-ad6e-05ab1652d7c7] received 2024-05-10T23:30:10.354185438Z [2024-05-10 23:30:10,353: INFO/ForkPoolWorker-15] [47f23e5c-1a4e-4f56-ad6e-05ab1652d7c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:30:10.632405175Z [2024-05-10 23:30:10,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:30:11.853416934Z [2024-05-10 23:30:11,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:30:11.856914749Z [2024-05-10 23:30:11,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:30:11.880908022Z [2024-05-10 23:30:11,880: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:30:11.882393533Z [2024-05-10 23:30:11,882: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:30:11.882475874Z [2024-05-10 23:30:11,882: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:30:11.882722597Z [2024-05-10 23:30:11,882: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:30:11.882824626Z [2024-05-10 23:30:11,882: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:30:11.883338671Z [2024-05-10 23:30:11,883: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:30:11.883424255Z [2024-05-10 23:30:11,883: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:30:11.977484152Z [2024-05-10 23:30:11,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:30:12.475846667Z [2024-05-10 23:30:12,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47f23e5c-1a4e-4f56-ad6e-05ab1652d7c7] succeeded in 2.128927398000087s: None 2024-05-10T23:31:01.214785070Z [2024-05-10 23:31:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e088a97-401c-40f4-9f72-9c25e7b9788e] received 2024-05-10T23:31:01.217331088Z [2024-05-10 23:31:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92f97e99-a1c3-4100-bc00-546f0ec9e690] received 2024-05-10T23:31:01.219864632Z [2024-05-10 23:31:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c58dfdaa-5ae5-49b6-ac0a-bc725de849a1] received 2024-05-10T23:31:01.223682880Z [2024-05-10 23:31:01,223: INFO/ForkPoolWorker-16] [92f97e99-a1c3-4100-bc00-546f0ec9e690] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:31:01.225017169Z [2024-05-10 23:31:01,224: INFO/ForkPoolWorker-15] [7e088a97-401c-40f4-9f72-9c25e7b9788e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:31:01.228726587Z [2024-05-10 23:31:01,228: INFO/ForkPoolWorker-1] [c58dfdaa-5ae5-49b6-ac0a-bc725de849a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:31:01.512269955Z [2024-05-10 23:31:01,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:31:01.551546059Z [2024-05-10 23:31:01,546: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:31:01.577184894Z [2024-05-10 23:31:01,573: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:31:01.682990015Z [2024-05-10 23:31:01,682: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:31:01.687532806Z [2024-05-10 23:31:01,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:31:01.716978000Z [2024-05-10 23:31:01,716: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:31:01.718278751Z [2024-05-10 23:31:01,717: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:31:01.718305920Z [2024-05-10 23:31:01,718: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:31:01.718352152Z [2024-05-10 23:31:01,718: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:31:01.718596822Z [2024-05-10 23:31:01,718: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:31:01.824199664Z [2024-05-10 23:31:01,823: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:31:02.549988408Z [2024-05-10 23:31:02,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e088a97-401c-40f4-9f72-9c25e7b9788e] succeeded in 1.332797269999901s: None 2024-05-10T23:31:02.816161788Z [2024-05-10 23:31:02,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:31:02.819352497Z [2024-05-10 23:31:02,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:31:02.842396967Z [2024-05-10 23:31:02,842: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:31:02.844240455Z [2024-05-10 23:31:02,843: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:31:02.844325560Z [2024-05-10 23:31:02,844: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:31:02.844550497Z [2024-05-10 23:31:02,844: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:31:02.844650433Z [2024-05-10 23:31:02,844: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:31:02.844974534Z [2024-05-10 23:31:02,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:31:02.845109334Z [2024-05-10 23:31:02,844: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:31:02.925918588Z [2024-05-10 23:31:02,925: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:31:02.953178457Z [2024-05-10 23:31:02,952: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:31:02.956989919Z [2024-05-10 23:31:02,956: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:31:02.981695766Z [2024-05-10 23:31:02,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:31:02.983413235Z [2024-05-10 23:31:02,983: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:31:02.983428130Z [2024-05-10 23:31:02,983: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:31:02.983666571Z [2024-05-10 23:31:02,983: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:31:02.983785017Z [2024-05-10 23:31:02,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:31:02.984309206Z [2024-05-10 23:31:02,984: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:31:02.984464649Z [2024-05-10 23:31:02,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:31:03.089426493Z [2024-05-10 23:31:03,089: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:31:05.300561636Z [2024-05-10 23:31:05,299: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[92f97e99-a1c3-4100-bc00-546f0ec9e690] succeeded in 4.0804255200000625s: None 2024-05-10T23:31:06.584938442Z [2024-05-10 23:31:06,584: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c58dfdaa-5ae5-49b6-ac0a-bc725de849a1] succeeded in 5.363049307000438s: None 2024-05-10T23:32:01.227543287Z [2024-05-10 23:32:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac40fcc2-4fad-4db4-87ed-b54f0cc4b1d3] received 2024-05-10T23:32:01.230055195Z [2024-05-10 23:32:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9580f45-f92d-4c5b-8f16-9edc5c851486] received 2024-05-10T23:32:01.234681740Z [2024-05-10 23:32:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47e8f277-a553-4323-9038-3a7dff81b869] received 2024-05-10T23:32:01.237292485Z [2024-05-10 23:32:01,237: INFO/ForkPoolWorker-16] [a9580f45-f92d-4c5b-8f16-9edc5c851486] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:32:01.238820381Z [2024-05-10 23:32:01,238: INFO/ForkPoolWorker-15] [ac40fcc2-4fad-4db4-87ed-b54f0cc4b1d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:32:01.255384211Z [2024-05-10 23:32:01,254: INFO/ForkPoolWorker-1] [47e8f277-a553-4323-9038-3a7dff81b869] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:32:01.260401999Z [2024-05-10 23:32:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[495c6910-f6e7-4fae-9a09-167fce779457] received 2024-05-10T23:32:01.277683745Z [2024-05-10 23:32:01,277: INFO/ForkPoolWorker-2] [495c6910-f6e7-4fae-9a09-167fce779457] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:32:01.630125562Z [2024-05-10 23:32:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:32:01.677828983Z [2024-05-10 23:32:01,673: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:32:01.735411139Z [2024-05-10 23:32:01,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:32:01.794812999Z [2024-05-10 23:32:01,790: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:32:02.027998812Z [2024-05-10 23:32:02,027: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:32:02.033408870Z [2024-05-10 23:32:02,032: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:32:02.066548984Z [2024-05-10 23:32:02,066: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:32:02.075118391Z [2024-05-10 23:32:02,074: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:32:02.077263049Z [2024-05-10 23:32:02,076: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:32:02.077548041Z [2024-05-10 23:32:02,077: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:32:02.077842836Z [2024-05-10 23:32:02,077: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:32:02.088489539Z [2024-05-10 23:32:02,088: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:32:02.204752634Z [2024-05-10 23:32:02,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:32:02.658510517Z [2024-05-10 23:32:02,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac40fcc2-4fad-4db4-87ed-b54f0cc4b1d3] succeeded in 1.4282882139996218s: None 2024-05-10T23:32:02.831773687Z [2024-05-10 23:32:02,831: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[47e8f277-a553-4323-9038-3a7dff81b869] succeeded in 1.5944208929995511s: None 2024-05-10T23:32:03.010434892Z [2024-05-10 23:32:03,010: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:32:03.013654348Z [2024-05-10 23:32:03,013: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:32:03.058005004Z [2024-05-10 23:32:03,057: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:32:03.059793821Z [2024-05-10 23:32:03,059: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:32:03.059820997Z [2024-05-10 23:32:03,059: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:32:03.059976979Z [2024-05-10 23:32:03,059: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:32:03.060046029Z [2024-05-10 23:32:03,059: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:32:03.060289127Z [2024-05-10 23:32:03,060: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:32:03.060300078Z [2024-05-10 23:32:03,060: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:32:03.170017127Z [2024-05-10 23:32:03,169: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:32:03.212098261Z [2024-05-10 23:32:03,211: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:32:03.215690581Z [2024-05-10 23:32:03,215: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:32:03.240609803Z [2024-05-10 23:32:03,240: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:32:03.242363611Z [2024-05-10 23:32:03,242: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:32:03.242625655Z [2024-05-10 23:32:03,242: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:32:03.242927476Z [2024-05-10 23:32:03,242: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:32:03.243171224Z [2024-05-10 23:32:03,243: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:32:03.243583444Z [2024-05-10 23:32:03,243: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:32:03.244117715Z [2024-05-10 23:32:03,243: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:32:03.343033790Z [2024-05-10 23:32:03,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:32:04.959910484Z [2024-05-10 23:32:04,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9580f45-f92d-4c5b-8f16-9edc5c851486] succeeded in 3.727966163999554s: None 2024-05-10T23:32:05.289053838Z [2024-05-10 23:32:05,288: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[495c6910-f6e7-4fae-9a09-167fce779457] succeeded in 4.021642137000526s: None 2024-05-10T23:33:01.336207468Z [2024-05-10 23:33:01,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d048c7c-ccc7-4fb0-af24-e8d300e9bb45] received 2024-05-10T23:33:01.346546981Z [2024-05-10 23:33:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a09b39c-a0fc-4165-8c07-d41a13aa63e7] received 2024-05-10T23:33:01.364924762Z [2024-05-10 23:33:01,364: INFO/ForkPoolWorker-15] [0d048c7c-ccc7-4fb0-af24-e8d300e9bb45] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:33:01.491537937Z [2024-05-10 23:33:01,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f130c68-c16e-4c0f-86e2-269d40b34499] received 2024-05-10T23:33:01.492743024Z [2024-05-10 23:33:01,492: INFO/ForkPoolWorker-16] [4a09b39c-a0fc-4165-8c07-d41a13aa63e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:33:01.507738880Z [2024-05-10 23:33:01,507: INFO/ForkPoolWorker-1] [1f130c68-c16e-4c0f-86e2-269d40b34499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:33:02.273061232Z [2024-05-10 23:33:02,266: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:33:02.514870071Z [2024-05-10 23:33:02,505: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:33:02.593610420Z [2024-05-10 23:33:02,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:33:02.609070263Z [2024-05-10 23:33:02,608: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:33:02.612870932Z [2024-05-10 23:33:02,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:33:02.679391375Z [2024-05-10 23:33:02,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:33:02.684004920Z [2024-05-10 23:33:02,683: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:33:02.684293896Z [2024-05-10 23:33:02,684: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:33:02.684548687Z [2024-05-10 23:33:02,684: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:33:02.684911118Z [2024-05-10 23:33:02,684: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:33:02.823212335Z [2024-05-10 23:33:02,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:33:03.864308119Z [2024-05-10 23:33:03,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d048c7c-ccc7-4fb0-af24-e8d300e9bb45] succeeded in 2.523698492999756s: None 2024-05-10T23:33:04.528931717Z [2024-05-10 23:33:04,528: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:33:04.532177202Z [2024-05-10 23:33:04,531: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:33:04.567607711Z [2024-05-10 23:33:04,567: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:33:04.568800756Z [2024-05-10 23:33:04,568: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:33:04.568837005Z [2024-05-10 23:33:04,568: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:33:04.568956175Z [2024-05-10 23:33:04,568: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:33:04.568991563Z [2024-05-10 23:33:04,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:33:04.569186728Z [2024-05-10 23:33:04,569: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:33:04.569227660Z [2024-05-10 23:33:04,569: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:33:04.748383708Z [2024-05-10 23:33:04,748: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:33:04.987964898Z [2024-05-10 23:33:04,987: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:33:04.991124231Z [2024-05-10 23:33:04,990: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:33:05.029385824Z [2024-05-10 23:33:05,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:33:05.032057290Z [2024-05-10 23:33:05,031: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:33:05.032348072Z [2024-05-10 23:33:05,031: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:33:05.032629946Z [2024-05-10 23:33:05,032: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:33:05.032778087Z [2024-05-10 23:33:05,032: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:33:05.033207443Z [2024-05-10 23:33:05,032: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:33:05.033387724Z [2024-05-10 23:33:05,033: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:33:05.129907673Z [2024-05-10 23:33:05,129: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:33:06.529401424Z [2024-05-10 23:33:06,529: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f130c68-c16e-4c0f-86e2-269d40b34499] succeeded in 5.034642653999981s: None 2024-05-10T23:33:06.608611422Z [2024-05-10 23:33:06,608: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a09b39c-a0fc-4165-8c07-d41a13aa63e7] succeeded in 5.205789562000064s: None 2024-05-10T23:34:01.322925333Z [2024-05-10 23:34:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90cebd27-cfc2-45ec-951e-bbb677b9b887] received 2024-05-10T23:34:01.326170891Z [2024-05-10 23:34:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16d51b53-d18c-44eb-8735-277eace8d5ac] received 2024-05-10T23:34:01.334893592Z [2024-05-10 23:34:01,334: INFO/ForkPoolWorker-15] [90cebd27-cfc2-45ec-951e-bbb677b9b887] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:34:01.335034094Z [2024-05-10 23:34:01,334: INFO/ForkPoolWorker-16] [16d51b53-d18c-44eb-8735-277eace8d5ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:34:01.339474867Z [2024-05-10 23:34:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b24d20f3-6fa6-4dcc-9ffb-ffb3711e05ef] received 2024-05-10T23:34:01.344537843Z [2024-05-10 23:34:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9948922e-f812-41cd-a77d-2766faf1de8a] received 2024-05-10T23:34:01.353684434Z [2024-05-10 23:34:01,353: INFO/ForkPoolWorker-2] [9948922e-f812-41cd-a77d-2766faf1de8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:34:01.354240483Z [2024-05-10 23:34:01,354: INFO/ForkPoolWorker-1] [b24d20f3-6fa6-4dcc-9ffb-ffb3711e05ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:34:01.832480325Z [2024-05-10 23:34:01,818: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:34:02.043792993Z [2024-05-10 23:34:02,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:34:02.116630910Z [2024-05-10 23:34:02,079: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:34:02.312979882Z [2024-05-10 23:34:02,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:34:02.481663148Z [2024-05-10 23:34:02,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:34:02.844813284Z [2024-05-10 23:34:02,844: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:34:02.849416445Z [2024-05-10 23:34:02,848: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:34:02.923953896Z [2024-05-10 23:34:02,923: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:34:02.973995171Z [2024-05-10 23:34:02,970: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:34:02.974031519Z [2024-05-10 23:34:02,970: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:34:02.974036570Z [2024-05-10 23:34:02,971: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:34:02.974039796Z [2024-05-10 23:34:02,971: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:34:03.338052026Z [2024-05-10 23:34:03,336: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:34:03.455181535Z [2024-05-10 23:34:03,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90cebd27-cfc2-45ec-951e-bbb677b9b887] succeeded in 2.12778772799993s: None 2024-05-10T23:34:03.994980633Z [2024-05-10 23:34:03,994: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:34:03.998715978Z [2024-05-10 23:34:03,998: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:34:04.144541019Z [2024-05-10 23:34:04,144: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:34:04.146428560Z [2024-05-10 23:34:04,146: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:34:04.146538791Z [2024-05-10 23:34:04,146: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:34:04.146709076Z [2024-05-10 23:34:04,146: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:34:04.146873139Z [2024-05-10 23:34:04,146: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:34:04.147317632Z [2024-05-10 23:34:04,147: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:34:04.147430870Z [2024-05-10 23:34:04,147: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:34:04.360025775Z [2024-05-10 23:34:04,359: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:34:04.614975055Z [2024-05-10 23:34:04,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16d51b53-d18c-44eb-8735-277eace8d5ac] succeeded in 3.2866023799997492s: None 2024-05-10T23:34:04.871699738Z [2024-05-10 23:34:04,871: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:34:04.875081336Z [2024-05-10 23:34:04,874: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:34:04.915209755Z [2024-05-10 23:34:04,915: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:34:04.916378729Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:34:04.916396347Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:34:04.916520773Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:34:04.916549769Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:34:04.916737214Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:34:04.916766633Z [2024-05-10 23:34:04,916: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:34:05.026978944Z [2024-05-10 23:34:05,026: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:34:07.418858223Z [2024-05-10 23:34:07,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b24d20f3-6fa6-4dcc-9ffb-ffb3711e05ef] succeeded in 6.077994184999625s: None 2024-05-10T23:34:07.494263158Z [2024-05-10 23:34:07,493: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9948922e-f812-41cd-a77d-2766faf1de8a] succeeded in 6.148286767999707s: None 2024-05-10T23:35:00.422115592Z [2024-05-10 23:35:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb9c6f69-9e4a-4cb3-8ff8-f5dd2f9d346e] received 2024-05-10T23:35:00.426541969Z [2024-05-10 23:35:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[413d845a-c288-4e42-8f7c-b22864710415] received 2024-05-10T23:35:00.432141013Z [2024-05-10 23:35:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5395dcdb-2b64-4696-912b-ed9d67aa60b8] received 2024-05-10T23:35:00.433930400Z [2024-05-10 23:35:00,433: INFO/ForkPoolWorker-15] [bb9c6f69-9e4a-4cb3-8ff8-f5dd2f9d346e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:35:00.435401344Z [2024-05-10 23:35:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67af3106-4c40-45a4-b162-d0c705ac275c] received 2024-05-10T23:35:00.439618326Z [2024-05-10 23:35:00,439: INFO/ForkPoolWorker-16] [413d845a-c288-4e42-8f7c-b22864710415] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:35:00.444166700Z [2024-05-10 23:35:00,443: INFO/ForkPoolWorker-2] [67af3106-4c40-45a4-b162-d0c705ac275c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:35:00.446674553Z [2024-05-10 23:35:00,446: INFO/ForkPoolWorker-1] [5395dcdb-2b64-4696-912b-ed9d67aa60b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:00.744030198Z [2024-05-10 23:35:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:35:00.752781779Z [2024-05-10 23:35:00,749: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:35:00.770797340Z [2024-05-10 23:35:00,767: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:35:00.773030674Z [2024-05-10 23:35:00,769: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:35:00.898158314Z [2024-05-10 23:35:00,897: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:35:00.902074379Z [2024-05-10 23:35:00,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:00.936179754Z [2024-05-10 23:35:00,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:35:00.937756699Z [2024-05-10 23:35:00,937: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:35:00.937913008Z [2024-05-10 23:35:00,937: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:35:00.938071108Z [2024-05-10 23:35:00,937: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:35:00.938412822Z [2024-05-10 23:35:00,938: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:35:01.052237740Z [2024-05-10 23:35:01,051: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:01.799131870Z [2024-05-10 23:35:01,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb9c6f69-9e4a-4cb3-8ff8-f5dd2f9d346e] succeeded in 1.3746358429998509s: None 2024-05-10T23:35:02.150631763Z [2024-05-10 23:35:02,150: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:35:02.153980301Z [2024-05-10 23:35:02,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:02.154597186Z [2024-05-10 23:35:02,154: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:35:02.158015869Z [2024-05-10 23:35:02,157: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:02.164935301Z [2024-05-10 23:35:02,164: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:35:02.168724840Z [2024-05-10 23:35:02,168: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:02.176104842Z [2024-05-10 23:35:02,175: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:35:02.177779511Z [2024-05-10 23:35:02,177: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:02.178054223Z [2024-05-10 23:35:02,177: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:02.178487584Z [2024-05-10 23:35:02,178: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:02.178676769Z [2024-05-10 23:35:02,178: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:35:02.179160479Z [2024-05-10 23:35:02,179: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:35:02.179353922Z [2024-05-10 23:35:02,179: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:02.188928287Z [2024-05-10 23:35:02,188: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:35:02.189362321Z [2024-05-10 23:35:02,189: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:35:02.190758424Z [2024-05-10 23:35:02,190: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:02.190899302Z [2024-05-10 23:35:02,190: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:02.191129663Z [2024-05-10 23:35:02,190: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:02.191520495Z [2024-05-10 23:35:02,191: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:35:02.191799163Z [2024-05-10 23:35:02,191: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:35:02.192237907Z [2024-05-10 23:35:02,192: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:02.192328111Z [2024-05-10 23:35:02,191: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:02.192396115Z [2024-05-10 23:35:02,192: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:02.192576926Z [2024-05-10 23:35:02,192: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:02.192782001Z [2024-05-10 23:35:02,192: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:35:02.193149927Z [2024-05-10 23:35:02,192: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:35:02.193291523Z [2024-05-10 23:35:02,193: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:02.280585450Z [2024-05-10 23:35:02,280: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:02.283007183Z [2024-05-10 23:35:02,282: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:02.309517987Z [2024-05-10 23:35:02,308: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:02.828537041Z [2024-05-10 23:35:02,827: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5395dcdb-2b64-4696-912b-ed9d67aa60b8] succeeded in 2.3936126300004616s: None 2024-05-10T23:35:03.579994222Z [2024-05-10 23:35:03,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d199e5a2-964d-4e28-ac16-0e73cafdbb9a] received 2024-05-10T23:35:03.591603605Z [2024-05-10 23:35:03,591: INFO/ForkPoolWorker-15] [d199e5a2-964d-4e28-ac16-0e73cafdbb9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:03.869561824Z [2024-05-10 23:35:03,869: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67af3106-4c40-45a4-b162-d0c705ac275c] succeeded in 3.431584494999697s: None 2024-05-10T23:35:03.880859725Z [2024-05-10 23:35:03,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:35:04.187463269Z [2024-05-10 23:35:04,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[413d845a-c288-4e42-8f7c-b22864710415] succeeded in 3.758129798000482s: None 2024-05-10T23:35:05.000445284Z [2024-05-10 23:35:04,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:35:05.003777155Z [2024-05-10 23:35:05,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:05.025647696Z [2024-05-10 23:35:05,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:35:05.027378140Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:05.027407033Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:05.027566048Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:05.027586090Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:35:05.027957393Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:35:05.027974056Z [2024-05-10 23:35:05,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:05.124557918Z [2024-05-10 23:35:05,124: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:05.744272037Z [2024-05-10 23:35:05,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d199e5a2-964d-4e28-ac16-0e73cafdbb9a] succeeded in 2.1612954199999876s: None 2024-05-10T23:35:06.388325539Z [2024-05-10 23:35:06,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cd44404-6864-4937-bbb0-e3a768915c4d] received 2024-05-10T23:35:06.400401776Z [2024-05-10 23:35:06,398: INFO/ForkPoolWorker-15] [3cd44404-6864-4937-bbb0-e3a768915c4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:35:06.702192524Z [2024-05-10 23:35:06,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:35:07.859222397Z [2024-05-10 23:35:07,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:35:07.862951664Z [2024-05-10 23:35:07,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:07.887514158Z [2024-05-10 23:35:07,887: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:35:07.888772320Z [2024-05-10 23:35:07,888: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:07.888881401Z [2024-05-10 23:35:07,888: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:07.889056372Z [2024-05-10 23:35:07,888: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:07.889130852Z [2024-05-10 23:35:07,889: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:35:07.889371509Z [2024-05-10 23:35:07,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:35:07.889473266Z [2024-05-10 23:35:07,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:07.981157639Z [2024-05-10 23:35:07,980: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:08.481234069Z [2024-05-10 23:35:08,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67079aae-5e5b-499a-a19a-89666e12ab98] received 2024-05-10T23:35:08.489402712Z [2024-05-10 23:35:08,489: INFO/ForkPoolWorker-16] [67079aae-5e5b-499a-a19a-89666e12ab98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:35:08.565930110Z [2024-05-10 23:35:08,565: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cd44404-6864-4937-bbb0-e3a768915c4d] succeeded in 2.1711055489995488s: None 2024-05-10T23:35:08.820305482Z [2024-05-10 23:35:08,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:35:09.897995052Z [2024-05-10 23:35:09,897: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:35:09.901414397Z [2024-05-10 23:35:09,900: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:35:09.926915081Z [2024-05-10 23:35:09,926: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:35:09.928931804Z [2024-05-10 23:35:09,928: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:35:09.928955321Z [2024-05-10 23:35:09,928: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:35:09.929081297Z [2024-05-10 23:35:09,928: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:35:09.929091861Z [2024-05-10 23:35:09,929: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:35:09.929364943Z [2024-05-10 23:35:09,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:35:09.929379684Z [2024-05-10 23:35:09,929: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:35:10.001487252Z [2024-05-10 23:35:10,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:35:10.578879992Z [2024-05-10 23:35:10,578: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67079aae-5e5b-499a-a19a-89666e12ab98] succeeded in 2.0960512490000838s: None 2024-05-10T23:36:00.348066389Z [2024-05-10 23:36:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e1cd8cd-37b4-4f64-8b0d-4728bfa16308] received 2024-05-10T23:36:00.368961693Z [2024-05-10 23:36:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11425203-4010-4177-bda0-6f888d50a282] received 2024-05-10T23:36:00.378071637Z [2024-05-10 23:36:00,377: INFO/ForkPoolWorker-15] [3e1cd8cd-37b4-4f64-8b0d-4728bfa16308] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:36:00.379458324Z [2024-05-10 23:36:00,379: INFO/ForkPoolWorker-16] [11425203-4010-4177-bda0-6f888d50a282] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:36:00.406857784Z [2024-05-10 23:36:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35a9709b-c67c-4ab2-90a4-c8955c0c2ce7] received 2024-05-10T23:36:00.423620235Z [2024-05-10 23:36:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8460244a-b3d1-4b5c-a947-4bb6f3193787] received 2024-05-10T23:36:00.434589812Z [2024-05-10 23:36:00,434: INFO/ForkPoolWorker-1] [35a9709b-c67c-4ab2-90a4-c8955c0c2ce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:36:00.482784611Z [2024-05-10 23:36:00,482: INFO/ForkPoolWorker-2] [8460244a-b3d1-4b5c-a947-4bb6f3193787] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:36:00.775404282Z [2024-05-10 23:36:00,771: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:36:00.776530637Z [2024-05-10 23:36:00,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:36:01.069535229Z [2024-05-10 23:36:01,059: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:36:01.125738294Z [2024-05-10 23:36:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:36:01.255185771Z [2024-05-10 23:36:01,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:36:01.338256661Z [2024-05-10 23:36:01,337: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:36:01.342419008Z [2024-05-10 23:36:01,341: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:36:01.374056442Z [2024-05-10 23:36:01,373: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:36:01.379066097Z [2024-05-10 23:36:01,378: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:36:01.379448678Z [2024-05-10 23:36:01,379: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:36:01.379645116Z [2024-05-10 23:36:01,379: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:36:01.380156027Z [2024-05-10 23:36:01,379: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:36:01.508717133Z [2024-05-10 23:36:01,508: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:36:02.080728824Z [2024-05-10 23:36:02,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e1cd8cd-37b4-4f64-8b0d-4728bfa16308] succeeded in 1.725747217999924s: None 2024-05-10T23:36:02.285703634Z [2024-05-10 23:36:02,285: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8460244a-b3d1-4b5c-a947-4bb6f3193787] succeeded in 1.8511231700003918s: None 2024-05-10T23:36:02.414806607Z [2024-05-10 23:36:02,414: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:36:02.418592217Z [2024-05-10 23:36:02,418: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:36:02.457238829Z [2024-05-10 23:36:02,456: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:36:02.459721420Z [2024-05-10 23:36:02,459: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:36:02.460203378Z [2024-05-10 23:36:02,459: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:36:02.460697449Z [2024-05-10 23:36:02,460: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:36:02.460980076Z [2024-05-10 23:36:02,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:36:02.461717925Z [2024-05-10 23:36:02,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:36:02.462662849Z [2024-05-10 23:36:02,462: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:36:02.575473534Z [2024-05-10 23:36:02,575: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:36:02.635763977Z [2024-05-10 23:36:02,635: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:36:02.639287849Z [2024-05-10 23:36:02,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:36:02.669646128Z [2024-05-10 23:36:02,669: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:36:02.672181896Z [2024-05-10 23:36:02,671: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:36:02.672427966Z [2024-05-10 23:36:02,672: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:36:02.672823634Z [2024-05-10 23:36:02,672: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:36:02.673065422Z [2024-05-10 23:36:02,672: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:36:02.673703083Z [2024-05-10 23:36:02,673: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:36:02.674044900Z [2024-05-10 23:36:02,673: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:36:02.825964575Z [2024-05-10 23:36:02,825: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:36:04.463685377Z [2024-05-10 23:36:04,462: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11425203-4010-4177-bda0-6f888d50a282] succeeded in 4.0932140040004015s: None 2024-05-10T23:36:06.322676507Z [2024-05-10 23:36:06,321: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[35a9709b-c67c-4ab2-90a4-c8955c0c2ce7] succeeded in 5.913649914000416s: None 2024-05-10T23:37:00.710420287Z [2024-05-10 23:37:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba44a12f-2ed8-4510-a965-ddc307e53304] received 2024-05-10T23:37:00.712029038Z [2024-05-10 23:37:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[417bbd4c-5395-4731-ae4d-b9b706ae43a0] received 2024-05-10T23:37:00.722700833Z [2024-05-10 23:37:00,722: INFO/ForkPoolWorker-16] [417bbd4c-5395-4731-ae4d-b9b706ae43a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:37:00.728943718Z [2024-05-10 23:37:00,728: INFO/ForkPoolWorker-15] [ba44a12f-2ed8-4510-a965-ddc307e53304] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:37:00.740966329Z [2024-05-10 23:37:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[673b5922-8f81-4264-88c6-decbefc72861] received 2024-05-10T23:37:00.748663086Z [2024-05-10 23:37:00,748: INFO/ForkPoolWorker-1] [673b5922-8f81-4264-88c6-decbefc72861] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:37:01.082008352Z [2024-05-10 23:37:01,078: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:37:01.094791754Z [2024-05-10 23:37:01,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:37:01.134041509Z [2024-05-10 23:37:01,124: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:37:01.276651943Z [2024-05-10 23:37:01,276: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:37:01.280627636Z [2024-05-10 23:37:01,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:37:01.304058431Z [2024-05-10 23:37:01,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:37:01.305844401Z [2024-05-10 23:37:01,305: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:37:01.306007624Z [2024-05-10 23:37:01,305: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:37:01.306042896Z [2024-05-10 23:37:01,305: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:37:01.306237341Z [2024-05-10 23:37:01,306: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:37:01.431725485Z [2024-05-10 23:37:01,431: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:37:02.051916471Z [2024-05-10 23:37:02,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba44a12f-2ed8-4510-a965-ddc307e53304] succeeded in 1.337047216999963s: None 2024-05-10T23:37:02.333680951Z [2024-05-10 23:37:02,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:37:02.337097658Z [2024-05-10 23:37:02,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:37:02.350109769Z [2024-05-10 23:37:02,349: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:37:02.353566551Z [2024-05-10 23:37:02,353: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:37:02.363484375Z [2024-05-10 23:37:02,363: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:37:02.365015496Z [2024-05-10 23:37:02,364: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:37:02.365136774Z [2024-05-10 23:37:02,364: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:37:02.365358749Z [2024-05-10 23:37:02,365: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:37:02.365449809Z [2024-05-10 23:37:02,365: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:37:02.365965914Z [2024-05-10 23:37:02,365: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:37:02.365996536Z [2024-05-10 23:37:02,365: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:37:02.387629749Z [2024-05-10 23:37:02,387: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:37:02.389989460Z [2024-05-10 23:37:02,389: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:37:02.390376216Z [2024-05-10 23:37:02,389: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:37:02.390719580Z [2024-05-10 23:37:02,390: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:37:02.390914644Z [2024-05-10 23:37:02,390: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:37:02.391343944Z [2024-05-10 23:37:02,391: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:37:02.391585563Z [2024-05-10 23:37:02,391: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:37:02.454662556Z [2024-05-10 23:37:02,454: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:37:02.482547908Z [2024-05-10 23:37:02,482: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:37:04.704862056Z [2024-05-10 23:37:04,704: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[417bbd4c-5395-4731-ae4d-b9b706ae43a0] succeeded in 3.9886160609994477s: None 2024-05-10T23:37:04.864353963Z [2024-05-10 23:37:04,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[673b5922-8f81-4264-88c6-decbefc72861] succeeded in 4.120895224000378s: None 2024-05-10T23:38:01.144524706Z [2024-05-10 23:38:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0852f56d-ea03-464c-9837-801f063ad0c0] received 2024-05-10T23:38:01.147762004Z [2024-05-10 23:38:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66535848-f10c-4d2b-aa01-4f448c9a5b2e] received 2024-05-10T23:38:01.151222866Z [2024-05-10 23:38:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ae0924a-dfe0-4157-b560-62c280ee74e6] received 2024-05-10T23:38:01.153013567Z [2024-05-10 23:38:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40eee5b8-a485-443b-b1b0-d9b6c44a0ac1] received 2024-05-10T23:38:01.161087342Z [2024-05-10 23:38:01,160: INFO/ForkPoolWorker-1] [8ae0924a-dfe0-4157-b560-62c280ee74e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:38:01.164104465Z [2024-05-10 23:38:01,163: INFO/ForkPoolWorker-15] [0852f56d-ea03-464c-9837-801f063ad0c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:38:01.164797243Z [2024-05-10 23:38:01,164: INFO/ForkPoolWorker-16] [66535848-f10c-4d2b-aa01-4f448c9a5b2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:38:01.179322610Z [2024-05-10 23:38:01,178: INFO/ForkPoolWorker-2] [40eee5b8-a485-443b-b1b0-d9b6c44a0ac1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:38:01.486884251Z [2024-05-10 23:38:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:38:01.501957403Z [2024-05-10 23:38:01,498: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:38:01.600267157Z [2024-05-10 23:38:01,597: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:38:01.603283218Z [2024-05-10 23:38:01,599: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:38:01.764489690Z [2024-05-10 23:38:01,764: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:38:01.768708895Z [2024-05-10 23:38:01,768: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:38:01.816978409Z [2024-05-10 23:38:01,816: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:38:01.820714762Z [2024-05-10 23:38:01,820: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:38:01.821080136Z [2024-05-10 23:38:01,820: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:38:01.821183817Z [2024-05-10 23:38:01,821: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:38:01.821470108Z [2024-05-10 23:38:01,821: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:38:01.846240596Z [2024-05-10 23:38:01,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:38:01.938597470Z [2024-05-10 23:38:01,938: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:38:02.488485222Z [2024-05-10 23:38:02,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0852f56d-ea03-464c-9837-801f063ad0c0] succeeded in 1.3411800129997573s: None 2024-05-10T23:38:02.616155386Z [2024-05-10 23:38:02,615: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ae0924a-dfe0-4157-b560-62c280ee74e6] succeeded in 1.4610950630003572s: None 2024-05-10T23:38:02.806445848Z [2024-05-10 23:38:02,806: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:38:02.809950735Z [2024-05-10 23:38:02,809: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:38:02.818533749Z [2024-05-10 23:38:02,818: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:38:02.821979533Z [2024-05-10 23:38:02,821: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:38:02.841972944Z [2024-05-10 23:38:02,841: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:38:02.843545595Z [2024-05-10 23:38:02,843: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:38:02.843586289Z [2024-05-10 23:38:02,843: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:38:02.843734544Z [2024-05-10 23:38:02,843: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:38:02.843744619Z [2024-05-10 23:38:02,843: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:38:02.844037718Z [2024-05-10 23:38:02,843: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:38:02.844065118Z [2024-05-10 23:38:02,844: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:38:02.862835497Z [2024-05-10 23:38:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:38:02.864014823Z [2024-05-10 23:38:02,863: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:38:02.864033359Z [2024-05-10 23:38:02,863: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:38:02.864169065Z [2024-05-10 23:38:02,864: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:38:02.864195427Z [2024-05-10 23:38:02,864: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:38:02.864452227Z [2024-05-10 23:38:02,864: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:38:02.864463433Z [2024-05-10 23:38:02,864: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:38:02.935806011Z [2024-05-10 23:38:02,935: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:38:02.937511753Z [2024-05-10 23:38:02,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:38:04.712756323Z [2024-05-10 23:38:04,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66535848-f10c-4d2b-aa01-4f448c9a5b2e] succeeded in 3.56257153200022s: None 2024-05-10T23:38:05.297932695Z [2024-05-10 23:38:05,297: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[40eee5b8-a485-443b-b1b0-d9b6c44a0ac1] succeeded in 4.135568613999567s: None 2024-05-10T23:39:00.962079790Z [2024-05-10 23:39:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19f57de0-8ea1-485e-a160-81fef2f81c15] received 2024-05-10T23:39:00.967067524Z [2024-05-10 23:39:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93982fa0-41bc-47da-a551-f36d2edce014] received 2024-05-10T23:39:00.972630331Z [2024-05-10 23:39:00,972: INFO/ForkPoolWorker-15] [19f57de0-8ea1-485e-a160-81fef2f81c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:39:00.974391008Z [2024-05-10 23:39:00,974: INFO/ForkPoolWorker-16] [93982fa0-41bc-47da-a551-f36d2edce014] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:39:00.982907234Z [2024-05-10 23:39:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3b51f14-2dd3-4ca0-a213-762fbc49486d] received 2024-05-10T23:39:00.993701857Z [2024-05-10 23:39:00,993: INFO/ForkPoolWorker-1] [f3b51f14-2dd3-4ca0-a213-762fbc49486d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:39:01.304797116Z [2024-05-10 23:39:01,301: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:39:01.369717929Z [2024-05-10 23:39:01,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:39:01.429012110Z [2024-05-10 23:39:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:39:01.598141609Z [2024-05-10 23:39:01,597: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:39:01.602942297Z [2024-05-10 23:39:01,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:39:01.625767043Z [2024-05-10 23:39:01,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:39:01.627577372Z [2024-05-10 23:39:01,627: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:39:01.627851245Z [2024-05-10 23:39:01,627: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:39:01.628040279Z [2024-05-10 23:39:01,627: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:39:01.628366628Z [2024-05-10 23:39:01,628: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:39:01.713737258Z [2024-05-10 23:39:01,713: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:39:02.280885959Z [2024-05-10 23:39:02,280: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3b51f14-2dd3-4ca0-a213-762fbc49486d] succeeded in 1.295168010999987s: None 2024-05-10T23:39:02.412231836Z [2024-05-10 23:39:02,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:39:02.415528999Z [2024-05-10 23:39:02,415: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:39:02.439952271Z [2024-05-10 23:39:02,439: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:39:02.441551845Z [2024-05-10 23:39:02,441: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:39:02.441683530Z [2024-05-10 23:39:02,441: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:39:02.441954386Z [2024-05-10 23:39:02,441: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:39:02.442075584Z [2024-05-10 23:39:02,441: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:39:02.442826530Z [2024-05-10 23:39:02,442: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:39:02.442953883Z [2024-05-10 23:39:02,442: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:39:02.532969564Z [2024-05-10 23:39:02,532: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:39:02.683265188Z [2024-05-10 23:39:02,682: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:39:02.686724870Z [2024-05-10 23:39:02,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:39:02.709540691Z [2024-05-10 23:39:02,709: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:39:02.711114484Z [2024-05-10 23:39:02,710: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:39:02.711129112Z [2024-05-10 23:39:02,711: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:39:02.711324927Z [2024-05-10 23:39:02,711: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:39:02.711333535Z [2024-05-10 23:39:02,711: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:39:02.711713302Z [2024-05-10 23:39:02,711: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:39:02.711859699Z [2024-05-10 23:39:02,711: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:39:02.824193202Z [2024-05-10 23:39:02,823: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:39:04.298003095Z [2024-05-10 23:39:04,295: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93982fa0-41bc-47da-a551-f36d2edce014] succeeded in 3.327275173999624s: None 2024-05-10T23:39:05.878121568Z [2024-05-10 23:39:05,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19f57de0-8ea1-485e-a160-81fef2f81c15] succeeded in 4.913910020000003s: None 2024-05-10T23:40:01.005609920Z [2024-05-10 23:40:01,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02a69925-3cef-4492-a08f-dacab31ed972] received 2024-05-10T23:40:01.014379119Z [2024-05-10 23:40:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6bc41cf-2716-4f8f-9b9a-042be987954e] received 2024-05-10T23:40:01.021964300Z [2024-05-10 23:40:01,018: INFO/ForkPoolWorker-15] [02a69925-3cef-4492-a08f-dacab31ed972] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:01.030634096Z [2024-05-10 23:40:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab6b74d8-993a-4c0e-83a5-cbc9da977860] received 2024-05-10T23:40:01.056451698Z [2024-05-10 23:40:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdcb6e80-a3ba-4144-b2f3-8fadf7d97025] received 2024-05-10T23:40:01.056479800Z [2024-05-10 23:40:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baef19d7-087c-463d-bff9-33cba50d9e0b] received 2024-05-10T23:40:01.056489475Z [2024-05-10 23:40:01,049: INFO/ForkPoolWorker-1] [ab6b74d8-993a-4c0e-83a5-cbc9da977860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:40:01.084332872Z [2024-05-10 23:40:01,084: INFO/ForkPoolWorker-16] [d6bc41cf-2716-4f8f-9b9a-042be987954e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:40:01.104333539Z [2024-05-10 23:40:01,102: INFO/ForkPoolWorker-3] [baef19d7-087c-463d-bff9-33cba50d9e0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:40:01.113995470Z [2024-05-10 23:40:01,107: INFO/ForkPoolWorker-2] [fdcb6e80-a3ba-4144-b2f3-8fadf7d97025] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:40:01.472906863Z [2024-05-10 23:40:01,469: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:40:01.484372429Z [2024-05-10 23:40:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:40:01.489491796Z [2024-05-10 23:40:01,483: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:40:01.601502284Z [2024-05-10 23:40:01,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:40:01.669736666Z [2024-05-10 23:40:01,664: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:40:01.933367115Z [2024-05-10 23:40:01,932: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-10T23:40:01.940944023Z [2024-05-10 23:40:01,940: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:01.963576842Z [2024-05-10 23:40:01,963: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-10T23:40:01.964972784Z [2024-05-10 23:40:01,964: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:40:01.965083343Z [2024-05-10 23:40:01,964: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:40:01.965162810Z [2024-05-10 23:40:01,965: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-10T23:40:01.965494097Z [2024-05-10 23:40:01,965: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:40:02.063625672Z [2024-05-10 23:40:02,063: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:02.103928390Z [2024-05-10 23:40:02,103: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:02.699583857Z [2024-05-10 23:40:02,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6bc41cf-2716-4f8f-9b9a-042be987954e] succeeded in 1.6791462569999567s: None 2024-05-10T23:40:02.819354362Z [2024-05-10 23:40:02,818: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[baef19d7-087c-463d-bff9-33cba50d9e0b] succeeded in 1.771446969999488s: None 2024-05-10T23:40:03.090135553Z [2024-05-10 23:40:03,089: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:40:03.094880483Z [2024-05-10 23:40:03,093: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:03.095216202Z [2024-05-10 23:40:03,094: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:40:03.098703896Z [2024-05-10 23:40:03,098: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:03.121053830Z [2024-05-10 23:40:03,120: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:40:03.123553139Z [2024-05-10 23:40:03,123: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:03.123880087Z [2024-05-10 23:40:03,123: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:03.124071938Z [2024-05-10 23:40:03,123: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:03.124157524Z [2024-05-10 23:40:03,124: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:40:03.124445976Z [2024-05-10 23:40:03,124: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:40:03.124558557Z [2024-05-10 23:40:03,124: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:03.126920217Z [2024-05-10 23:40:03,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:40:03.133103137Z [2024-05-10 23:40:03,131: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:03.133161309Z [2024-05-10 23:40:03,133: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:03.133262314Z [2024-05-10 23:40:03,133: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:03.133837693Z [2024-05-10 23:40:03,133: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:40:03.134273957Z [2024-05-10 23:40:03,133: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:40:03.134377910Z [2024-05-10 23:40:03,134: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:03.237826195Z [2024-05-10 23:40:03,237: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:03.249628182Z [2024-05-10 23:40:03,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:03.401486319Z [2024-05-10 23:40:03,401: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:40:03.406722037Z [2024-05-10 23:40:03,406: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:03.427217095Z [2024-05-10 23:40:03,426: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:40:03.428757795Z [2024-05-10 23:40:03,428: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:03.428901661Z [2024-05-10 23:40:03,428: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:03.429126598Z [2024-05-10 23:40:03,428: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:03.429262324Z [2024-05-10 23:40:03,429: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:40:03.429650435Z [2024-05-10 23:40:03,429: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:40:03.429796639Z [2024-05-10 23:40:03,429: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:03.559346650Z [2024-05-10 23:40:03,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:03.891374291Z [2024-05-10 23:40:03,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02a69925-3cef-4492-a08f-dacab31ed972] succeeded in 2.8834777660003965s: None 2024-05-10T23:40:04.341857010Z [2024-05-10 23:40:04,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40cf4fc3-26f7-4171-b3b2-22af51472a6d] received 2024-05-10T23:40:04.354370261Z [2024-05-10 23:40:04,353: INFO/ForkPoolWorker-15] [40cf4fc3-26f7-4171-b3b2-22af51472a6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:04.611536886Z [2024-05-10 23:40:04,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:40:05.736365224Z [2024-05-10 23:40:05,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:40:05.740317465Z [2024-05-10 23:40:05,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:05.776574213Z [2024-05-10 23:40:05,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:40:05.778548951Z [2024-05-10 23:40:05,778: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:05.778564007Z [2024-05-10 23:40:05,778: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:05.778695638Z [2024-05-10 23:40:05,778: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:05.780835950Z [2024-05-10 23:40:05,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:40:05.781150729Z [2024-05-10 23:40:05,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:40:05.781161167Z [2024-05-10 23:40:05,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:05.847010866Z [2024-05-10 23:40:05,846: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fdcb6e80-a3ba-4144-b2f3-8fadf7d97025] succeeded in 4.803504639000494s: None 2024-05-10T23:40:05.880435252Z [2024-05-10 23:40:05,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:06.599576928Z [2024-05-10 23:40:06,598: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab6b74d8-993a-4c0e-83a5-cbc9da977860] succeeded in 5.567181297000388s: None 2024-05-10T23:40:06.665173094Z [2024-05-10 23:40:06,664: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40cf4fc3-26f7-4171-b3b2-22af51472a6d] succeeded in 2.3192654739996215s: None 2024-05-10T23:40:07.127965316Z [2024-05-10 23:40:07,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f5cea96-486d-4a87-9929-1145b65c058c] received 2024-05-10T23:40:07.155568670Z [2024-05-10 23:40:07,155: INFO/ForkPoolWorker-15] [7f5cea96-486d-4a87-9929-1145b65c058c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:40:07.441227249Z [2024-05-10 23:40:07,437: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:40:08.548193024Z [2024-05-10 23:40:08,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:40:08.551501914Z [2024-05-10 23:40:08,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:08.581206372Z [2024-05-10 23:40:08,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:40:08.582858466Z [2024-05-10 23:40:08,582: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:08.583042304Z [2024-05-10 23:40:08,582: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:08.583303039Z [2024-05-10 23:40:08,583: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:08.583464557Z [2024-05-10 23:40:08,583: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:40:08.583974614Z [2024-05-10 23:40:08,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:40:08.584239102Z [2024-05-10 23:40:08,583: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:08.679993922Z [2024-05-10 23:40:08,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:09.304139957Z [2024-05-10 23:40:09,303: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f5cea96-486d-4a87-9929-1145b65c058c] succeeded in 2.1735812830002033s: None 2024-05-10T23:40:09.908956528Z [2024-05-10 23:40:09,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4468920b-d3a1-44a7-a635-ec3e4a0b7b52] received 2024-05-10T23:40:09.932263440Z [2024-05-10 23:40:09,931: INFO/ForkPoolWorker-15] [4468920b-d3a1-44a7-a635-ec3e4a0b7b52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:40:10.291699809Z [2024-05-10 23:40:10,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:40:11.432108535Z [2024-05-10 23:40:11,431: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:40:11.435340923Z [2024-05-10 23:40:11,434: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:40:11.458545016Z [2024-05-10 23:40:11,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:40:11.461136042Z [2024-05-10 23:40:11,460: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:40:11.461174834Z [2024-05-10 23:40:11,461: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:40:11.461445252Z [2024-05-10 23:40:11,461: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:40:11.461522293Z [2024-05-10 23:40:11,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:40:11.461853539Z [2024-05-10 23:40:11,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:40:11.462286224Z [2024-05-10 23:40:11,462: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:40:11.586043915Z [2024-05-10 23:40:11,585: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:40:12.175183572Z [2024-05-10 23:40:12,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4468920b-d3a1-44a7-a635-ec3e4a0b7b52] succeeded in 2.259174009000162s: None 2024-05-10T23:41:00.378954253Z [2024-05-10 23:41:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9648d895-5577-4fd6-aed2-4dee18e61b30] received 2024-05-10T23:41:00.394373821Z [2024-05-10 23:41:00,394: INFO/ForkPoolWorker-15] [9648d895-5577-4fd6-aed2-4dee18e61b30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:41:00.529411815Z [2024-05-10 23:41:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e984b9ed-04f6-4245-8986-b9c83ba8b0e6] received 2024-05-10T23:41:00.551566657Z [2024-05-10 23:41:00,551: INFO/ForkPoolWorker-16] [e984b9ed-04f6-4245-8986-b9c83ba8b0e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:41:00.552034918Z [2024-05-10 23:41:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcde91b6-c8e2-42d5-9744-ce66da728663] received 2024-05-10T23:41:00.575767202Z [2024-05-10 23:41:00,575: INFO/ForkPoolWorker-1] [bcde91b6-c8e2-42d5-9744-ce66da728663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:41:00.935998401Z [2024-05-10 23:41:00,932: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:41:00.948248390Z [2024-05-10 23:41:00,944: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:41:01.040065732Z [2024-05-10 23:41:01,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:41:01.368687349Z [2024-05-10 23:41:01,368: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:41:01.380869190Z [2024-05-10 23:41:01,380: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:41:01.424560126Z [2024-05-10 23:41:01,424: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:41:01.434470251Z [2024-05-10 23:41:01,434: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:41:01.434533757Z [2024-05-10 23:41:01,434: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:41:01.434541015Z [2024-05-10 23:41:01,434: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:41:01.434738273Z [2024-05-10 23:41:01,434: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:41:01.623741364Z [2024-05-10 23:41:01,623: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:41:02.481632075Z [2024-05-10 23:41:02,481: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e984b9ed-04f6-4245-8986-b9c83ba8b0e6] succeeded in 1.9468232040007933s: None 2024-05-10T23:41:02.563343920Z [2024-05-10 23:41:02,562: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:41:02.566901731Z [2024-05-10 23:41:02,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:41:02.596490583Z [2024-05-10 23:41:02,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:41:02.599360152Z [2024-05-10 23:41:02,599: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:41:02.599539378Z [2024-05-10 23:41:02,599: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:41:02.599834396Z [2024-05-10 23:41:02,599: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:41:02.600074480Z [2024-05-10 23:41:02,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:41:02.600460177Z [2024-05-10 23:41:02,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:41:02.601059901Z [2024-05-10 23:41:02,600: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:41:02.655669702Z [2024-05-10 23:41:02,655: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:41:02.659092445Z [2024-05-10 23:41:02,658: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:41:02.702060798Z [2024-05-10 23:41:02,700: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:41:02.708017710Z [2024-05-10 23:41:02,707: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:41:02.711275845Z [2024-05-10 23:41:02,710: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:41:02.711295904Z [2024-05-10 23:41:02,710: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:41:02.711300624Z [2024-05-10 23:41:02,710: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:41:02.711304348Z [2024-05-10 23:41:02,710: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:41:02.713995382Z [2024-05-10 23:41:02,713: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:41:02.714011342Z [2024-05-10 23:41:02,713: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:41:02.831969152Z [2024-05-10 23:41:02,831: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:41:05.024598684Z [2024-05-10 23:41:05,024: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bcde91b6-c8e2-42d5-9744-ce66da728663] succeeded in 4.466413963999912s: None 2024-05-10T23:41:05.369694336Z [2024-05-10 23:41:05,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9648d895-5577-4fd6-aed2-4dee18e61b30] succeeded in 4.985314227999879s: None 2024-05-10T23:42:00.603665448Z [2024-05-10 23:42:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f15f19f1-e09e-476b-b565-939e5bba19f4] received 2024-05-10T23:42:00.617728532Z [2024-05-10 23:42:00,617: INFO/ForkPoolWorker-15] [f15f19f1-e09e-476b-b565-939e5bba19f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:42:00.623761099Z [2024-05-10 23:42:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5076c10-2667-4ba7-8e68-f9f5321a5bdc] received 2024-05-10T23:42:00.630200591Z [2024-05-10 23:42:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5a9e832-56ce-4da9-b2ac-3fdf350ef390] received 2024-05-10T23:42:00.632218468Z [2024-05-10 23:42:00,632: INFO/ForkPoolWorker-16] [c5076c10-2667-4ba7-8e68-f9f5321a5bdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:42:00.634311302Z [2024-05-10 23:42:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4501a24-5f6d-482a-8b83-c7554acd0b54] received 2024-05-10T23:42:00.644925931Z [2024-05-10 23:42:00,644: INFO/ForkPoolWorker-2] [c4501a24-5f6d-482a-8b83-c7554acd0b54] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:42:00.646063004Z [2024-05-10 23:42:00,645: INFO/ForkPoolWorker-1] [c5a9e832-56ce-4da9-b2ac-3fdf350ef390] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:42:01.042836882Z [2024-05-10 23:42:01,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:42:01.126015447Z [2024-05-10 23:42:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:42:01.135651267Z [2024-05-10 23:42:01,131: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:42:01.215084953Z [2024-05-10 23:42:01,203: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:42:01.388027394Z [2024-05-10 23:42:01,387: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:42:01.392657675Z [2024-05-10 23:42:01,392: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:42:01.416163952Z [2024-05-10 23:42:01,415: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:42:01.417566017Z [2024-05-10 23:42:01,417: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:42:01.417673011Z [2024-05-10 23:42:01,417: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:42:01.417790231Z [2024-05-10 23:42:01,417: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:42:01.418335518Z [2024-05-10 23:42:01,418: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:42:01.435371943Z [2024-05-10 23:42:01,435: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:42:01.811057396Z [2024-05-10 23:42:01,810: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:42:02.375932894Z [2024-05-10 23:42:02,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f15f19f1-e09e-476b-b565-939e5bba19f4] succeeded in 1.7658587040004932s: None 2024-05-10T23:42:03.226622966Z [2024-05-10 23:42:03,226: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4501a24-5f6d-482a-8b83-c7554acd0b54] succeeded in 2.5883992699991722s: None 2024-05-10T23:42:03.832562897Z [2024-05-10 23:42:03,832: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:42:03.838126690Z [2024-05-10 23:42:03,837: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:42:03.912484674Z [2024-05-10 23:42:03,912: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:42:03.916933657Z [2024-05-10 23:42:03,916: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:42:03.917044069Z [2024-05-10 23:42:03,916: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:42:03.919848960Z [2024-05-10 23:42:03,917: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:42:03.920241610Z [2024-05-10 23:42:03,919: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:42:03.920560768Z [2024-05-10 23:42:03,920: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:42:03.922480635Z [2024-05-10 23:42:03,922: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:42:04.098378998Z [2024-05-10 23:42:04,098: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:42:04.101980336Z [2024-05-10 23:42:04,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:42:04.134407194Z [2024-05-10 23:42:04,134: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:42:04.135978937Z [2024-05-10 23:42:04,135: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:42:04.136023419Z [2024-05-10 23:42:04,135: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:42:04.136156848Z [2024-05-10 23:42:04,135: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:42:04.136222063Z [2024-05-10 23:42:04,136: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:42:04.136571886Z [2024-05-10 23:42:04,136: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:42:04.137126449Z [2024-05-10 23:42:04,136: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:42:04.168397210Z [2024-05-10 23:42:04,168: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:42:04.243196797Z [2024-05-10 23:42:04,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:42:05.965287982Z [2024-05-10 23:42:05,964: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5a9e832-56ce-4da9-b2ac-3fdf350ef390] succeeded in 5.327050068000062s: None 2024-05-10T23:42:06.803891416Z [2024-05-10 23:42:06,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5076c10-2667-4ba7-8e68-f9f5321a5bdc] succeeded in 6.178080857000168s: None 2024-05-10T23:43:01.130199750Z [2024-05-10 23:43:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[610c29d4-8c0e-49cd-90b6-3be047134ffc] received 2024-05-10T23:43:01.130255875Z [2024-05-10 23:43:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e75ad150-9534-4efa-b7fc-f9bd6b20489b] received 2024-05-10T23:43:01.134402512Z [2024-05-10 23:43:01,134: INFO/ForkPoolWorker-15] [610c29d4-8c0e-49cd-90b6-3be047134ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:43:01.154952595Z [2024-05-10 23:43:01,154: INFO/ForkPoolWorker-16] [e75ad150-9534-4efa-b7fc-f9bd6b20489b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:43:01.192760879Z [2024-05-10 23:43:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c83bd01-9d05-4369-8904-5130bcdcaeea] received 2024-05-10T23:43:01.212910875Z [2024-05-10 23:43:01,211: INFO/ForkPoolWorker-1] [8c83bd01-9d05-4369-8904-5130bcdcaeea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:43:01.547612512Z [2024-05-10 23:43:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:43:01.600083296Z [2024-05-10 23:43:01,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:43:01.634719262Z [2024-05-10 23:43:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:43:01.795614309Z [2024-05-10 23:43:01,795: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:43:01.799386188Z [2024-05-10 23:43:01,798: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:43:01.831037394Z [2024-05-10 23:43:01,830: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:43:01.838479616Z [2024-05-10 23:43:01,838: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:43:01.838602003Z [2024-05-10 23:43:01,838: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:43:01.838674387Z [2024-05-10 23:43:01,838: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:43:01.838926444Z [2024-05-10 23:43:01,838: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:43:02.042294286Z [2024-05-10 23:43:02,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:43:03.132306372Z [2024-05-10 23:43:03,131: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c83bd01-9d05-4369-8904-5130bcdcaeea] succeeded in 1.933635317000153s: None 2024-05-10T23:43:03.371416499Z [2024-05-10 23:43:03,371: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:43:03.374799741Z [2024-05-10 23:43:03,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:43:03.409035455Z [2024-05-10 23:43:03,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:43:03.410437250Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:43:03.410482391Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:43:03.410633357Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:43:03.410669239Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:43:03.410932116Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:43:03.410989463Z [2024-05-10 23:43:03,410: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:43:03.497977997Z [2024-05-10 23:43:03,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:43:03.748203299Z [2024-05-10 23:43:03,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:43:03.751732790Z [2024-05-10 23:43:03,751: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:43:03.788939166Z [2024-05-10 23:43:03,788: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:43:03.790905175Z [2024-05-10 23:43:03,790: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:43:03.791087785Z [2024-05-10 23:43:03,790: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:43:03.791374626Z [2024-05-10 23:43:03,791: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:43:03.791526655Z [2024-05-10 23:43:03,791: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:43:03.791983528Z [2024-05-10 23:43:03,791: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:43:03.792093610Z [2024-05-10 23:43:03,791: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:43:03.946329232Z [2024-05-10 23:43:03,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:43:05.081752336Z [2024-05-10 23:43:05,081: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[610c29d4-8c0e-49cd-90b6-3be047134ffc] succeeded in 3.9540317920000234s: None 2024-05-10T23:43:05.759870650Z [2024-05-10 23:43:05,759: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e75ad150-9534-4efa-b7fc-f9bd6b20489b] succeeded in 4.620415835000131s: None 2024-05-10T23:44:00.420553061Z [2024-05-10 23:44:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7680187-aba6-475e-979a-12588ff0020f] received 2024-05-10T23:44:00.424656610Z [2024-05-10 23:44:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfdc6e42-9dba-4209-afa3-ff38ef4c0820] received 2024-05-10T23:44:00.431812546Z [2024-05-10 23:44:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dba8ffe-e66d-4373-90b3-2ffd39955d6a] received 2024-05-10T23:44:00.431834357Z [2024-05-10 23:44:00,431: INFO/ForkPoolWorker-16] [bfdc6e42-9dba-4209-afa3-ff38ef4c0820] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:44:00.437963287Z [2024-05-10 23:44:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b29d4f9-7348-4fb7-a943-311ee6a90a97] received 2024-05-10T23:44:00.439875593Z [2024-05-10 23:44:00,439: INFO/ForkPoolWorker-1] [9dba8ffe-e66d-4373-90b3-2ffd39955d6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:44:00.458551500Z [2024-05-10 23:44:00,458: INFO/ForkPoolWorker-15] [a7680187-aba6-475e-979a-12588ff0020f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:44:00.477030128Z [2024-05-10 23:44:00,476: INFO/ForkPoolWorker-2] [2b29d4f9-7348-4fb7-a943-311ee6a90a97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:44:00.776682120Z [2024-05-10 23:44:00,771: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:44:00.800886313Z [2024-05-10 23:44:00,796: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:44:00.805635102Z [2024-05-10 23:44:00,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:44:00.850978678Z [2024-05-10 23:44:00,847: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:44:01.041730624Z [2024-05-10 23:44:01,041: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:44:01.046224201Z [2024-05-10 23:44:01,045: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:44:01.111470712Z [2024-05-10 23:44:01,111: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:44:01.118873147Z [2024-05-10 23:44:01,118: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:44:01.118961712Z [2024-05-10 23:44:01,118: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:44:01.118968158Z [2024-05-10 23:44:01,118: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:44:01.119151708Z [2024-05-10 23:44:01,119: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:44:01.151079969Z [2024-05-10 23:44:01,150: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:44:01.290897634Z [2024-05-10 23:44:01,290: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:44:01.800512311Z [2024-05-10 23:44:01,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7680187-aba6-475e-979a-12588ff0020f] succeeded in 1.3748964959995646s: None 2024-05-10T23:44:02.009268952Z [2024-05-10 23:44:02,008: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b29d4f9-7348-4fb7-a943-311ee6a90a97] succeeded in 1.5690764930004661s: None 2024-05-10T23:44:02.250168262Z [2024-05-10 23:44:02,249: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:44:02.253793589Z [2024-05-10 23:44:02,253: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:44:02.264497166Z [2024-05-10 23:44:02,264: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:44:02.268149697Z [2024-05-10 23:44:02,267: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:44:02.282797167Z [2024-05-10 23:44:02,282: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:44:02.284125823Z [2024-05-10 23:44:02,283: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:44:02.284153228Z [2024-05-10 23:44:02,284: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:44:02.284275654Z [2024-05-10 23:44:02,284: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:44:02.284281308Z [2024-05-10 23:44:02,284: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:44:02.284536450Z [2024-05-10 23:44:02,284: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:44:02.284541550Z [2024-05-10 23:44:02,284: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:44:02.298887621Z [2024-05-10 23:44:02,298: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:44:02.300896945Z [2024-05-10 23:44:02,300: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:44:02.301073588Z [2024-05-10 23:44:02,300: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:44:02.301285963Z [2024-05-10 23:44:02,301: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:44:02.301412322Z [2024-05-10 23:44:02,301: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:44:02.301992955Z [2024-05-10 23:44:02,301: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:44:02.302064584Z [2024-05-10 23:44:02,301: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:44:02.387278757Z [2024-05-10 23:44:02,387: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:44:02.423343079Z [2024-05-10 23:44:02,422: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:44:04.243950637Z [2024-05-10 23:44:04,243: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9dba8ffe-e66d-4373-90b3-2ffd39955d6a] succeeded in 3.8102793210000527s: None 2024-05-10T23:44:04.532676505Z [2024-05-10 23:44:04,531: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfdc6e42-9dba-4209-afa3-ff38ef4c0820] succeeded in 4.106050757000048s: None 2024-05-10T23:45:00.515248047Z [2024-05-10 23:45:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[520e015d-831b-4231-8dad-279ab9cb6810] received 2024-05-10T23:45:00.526993193Z [2024-05-10 23:45:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[685ba323-8d13-43fc-924b-65afd2b9318b] received 2024-05-10T23:45:00.527660836Z [2024-05-10 23:45:00,527: INFO/ForkPoolWorker-15] [520e015d-831b-4231-8dad-279ab9cb6810] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:00.535022166Z [2024-05-10 23:45:00,534: INFO/ForkPoolWorker-16] [685ba323-8d13-43fc-924b-65afd2b9318b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:45:00.543449902Z [2024-05-10 23:45:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8d6b129-99ea-4315-8f30-44509c8d6c49] received 2024-05-10T23:45:00.545575734Z [2024-05-10 23:45:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[970807a3-7cea-41b4-a51c-e9dc1680fe67] received 2024-05-10T23:45:00.551333572Z [2024-05-10 23:45:00,551: INFO/ForkPoolWorker-2] [970807a3-7cea-41b4-a51c-e9dc1680fe67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:45:00.553468149Z [2024-05-10 23:45:00,553: INFO/ForkPoolWorker-1] [f8d6b129-99ea-4315-8f30-44509c8d6c49] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:45:00.888888509Z [2024-05-10 23:45:00,885: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:45:00.987011014Z [2024-05-10 23:45:00,983: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:45:00.995213693Z [2024-05-10 23:45:00,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:45:01.235062693Z [2024-05-10 23:45:01,227: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:45:01.433467609Z [2024-05-10 23:45:01,433: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:45:01.437595874Z [2024-05-10 23:45:01,437: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:01.461685824Z [2024-05-10 23:45:01,461: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:45:01.471213451Z [2024-05-10 23:45:01,470: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:45:01.471312632Z [2024-05-10 23:45:01,471: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:45:01.471399057Z [2024-05-10 23:45:01,471: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:45:01.472090511Z [2024-05-10 23:45:01,471: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:45:01.604134741Z [2024-05-10 23:45:01,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:02.205504544Z [2024-05-10 23:45:02,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f8d6b129-99ea-4315-8f30-44509c8d6c49] succeeded in 1.6586475789999895s: None 2024-05-10T23:45:02.385606904Z [2024-05-10 23:45:02,383: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:45:02.389231824Z [2024-05-10 23:45:02,388: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:02.417782262Z [2024-05-10 23:45:02,417: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:45:02.419148590Z [2024-05-10 23:45:02,418: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:02.419161183Z [2024-05-10 23:45:02,419: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:02.419344749Z [2024-05-10 23:45:02,419: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:02.419408000Z [2024-05-10 23:45:02,419: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:45:02.419965774Z [2024-05-10 23:45:02,419: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:45:02.420061020Z [2024-05-10 23:45:02,419: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:02.505707636Z [2024-05-10 23:45:02,505: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:02.668399703Z [2024-05-10 23:45:02,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:45:02.674572287Z [2024-05-10 23:45:02,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:02.708674454Z [2024-05-10 23:45:02,708: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:45:02.710228499Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:02.710279980Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:02.710568515Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:02.710610075Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:45:02.710983274Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:45:02.711096778Z [2024-05-10 23:45:02,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:02.759393688Z [2024-05-10 23:45:02,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:45:02.763378286Z [2024-05-10 23:45:02,762: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:02.781331964Z [2024-05-10 23:45:02,781: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:45:02.782654664Z [2024-05-10 23:45:02,782: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:02.782668608Z [2024-05-10 23:45:02,782: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:02.782834993Z [2024-05-10 23:45:02,782: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:02.782892636Z [2024-05-10 23:45:02,782: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:45:02.783241370Z [2024-05-10 23:45:02,783: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:45:02.783251032Z [2024-05-10 23:45:02,783: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:02.795516875Z [2024-05-10 23:45:02,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:02.874553816Z [2024-05-10 23:45:02,874: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:03.457614777Z [2024-05-10 23:45:03,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[520e015d-831b-4231-8dad-279ab9cb6810] succeeded in 2.9366899349997766s: None 2024-05-10T23:45:03.578315197Z [2024-05-10 23:45:03,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[babef933-513d-4e0e-bcea-8e0625238582] received 2024-05-10T23:45:03.585309959Z [2024-05-10 23:45:03,585: INFO/ForkPoolWorker-15] [babef933-513d-4e0e-bcea-8e0625238582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:03.887649153Z [2024-05-10 23:45:03,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:45:04.353371150Z [2024-05-10 23:45:04,350: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[970807a3-7cea-41b4-a51c-e9dc1680fe67] succeeded in 3.804077163000329s: None 2024-05-10T23:45:04.956519928Z [2024-05-10 23:45:04,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:45:04.959967932Z [2024-05-10 23:45:04,959: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:04.983119200Z [2024-05-10 23:45:04,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:45:04.984831029Z [2024-05-10 23:45:04,984: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:04.985063365Z [2024-05-10 23:45:04,984: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:04.985362424Z [2024-05-10 23:45:04,985: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:04.985564094Z [2024-05-10 23:45:04,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:45:04.986035802Z [2024-05-10 23:45:04,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:45:04.986317215Z [2024-05-10 23:45:04,986: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:05.070706943Z [2024-05-10 23:45:05,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:05.319845283Z [2024-05-10 23:45:05,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[685ba323-8d13-43fc-924b-65afd2b9318b] succeeded in 4.7914431799999875s: None 2024-05-10T23:45:05.633498604Z [2024-05-10 23:45:05,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[babef933-513d-4e0e-bcea-8e0625238582] succeeded in 2.053832223000427s: None 2024-05-10T23:45:06.021820632Z [2024-05-10 23:45:06,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c33a3f8-0c44-4fd2-9859-64b74a49371a] received 2024-05-10T23:45:06.039301635Z [2024-05-10 23:45:06,039: INFO/ForkPoolWorker-15] [4c33a3f8-0c44-4fd2-9859-64b74a49371a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:45:06.328653733Z [2024-05-10 23:45:06,325: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:45:07.496719141Z [2024-05-10 23:45:07,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:45:07.499932952Z [2024-05-10 23:45:07,499: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:07.518827738Z [2024-05-10 23:45:07,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:45:07.520079727Z [2024-05-10 23:45:07,519: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:07.520100976Z [2024-05-10 23:45:07,520: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:07.520263982Z [2024-05-10 23:45:07,520: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:07.520323782Z [2024-05-10 23:45:07,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:45:07.521085294Z [2024-05-10 23:45:07,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:45:07.521099016Z [2024-05-10 23:45:07,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:07.626211062Z [2024-05-10 23:45:07,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:08.227055489Z [2024-05-10 23:45:08,226: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c33a3f8-0c44-4fd2-9859-64b74a49371a] succeeded in 2.1974221880000187s: None 2024-05-10T23:45:08.317598337Z [2024-05-10 23:45:08,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d2ad5a5-038f-4b8a-a02c-b90eee82a371] received 2024-05-10T23:45:08.325196150Z [2024-05-10 23:45:08,324: INFO/ForkPoolWorker-15] [5d2ad5a5-038f-4b8a-a02c-b90eee82a371] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:45:08.622909698Z [2024-05-10 23:45:08,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:45:09.758696580Z [2024-05-10 23:45:09,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:45:09.762527019Z [2024-05-10 23:45:09,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:45:09.787948703Z [2024-05-10 23:45:09,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:45:09.789977505Z [2024-05-10 23:45:09,789: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:45:09.789987711Z [2024-05-10 23:45:09,789: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:45:09.790133796Z [2024-05-10 23:45:09,789: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:45:09.790185720Z [2024-05-10 23:45:09,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:45:09.790507355Z [2024-05-10 23:45:09,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:45:09.790552121Z [2024-05-10 23:45:09,790: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:45:09.891844729Z [2024-05-10 23:45:09,891: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:45:10.573118053Z [2024-05-10 23:45:10,572: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d2ad5a5-038f-4b8a-a02c-b90eee82a371] succeeded in 2.2529843300007997s: None 2024-05-10T23:46:01.215704508Z [2024-05-10 23:46:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[210eedf8-b283-4be7-9aa7-8f5eabb2e897] received 2024-05-10T23:46:01.217471583Z [2024-05-10 23:46:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7eec0ee-7416-4110-89cb-5c75127ef67d] received 2024-05-10T23:46:01.222022081Z [2024-05-10 23:46:01,221: INFO/ForkPoolWorker-15] [210eedf8-b283-4be7-9aa7-8f5eabb2e897] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:46:01.222805112Z [2024-05-10 23:46:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01e40832-1aa8-4150-b777-855b1732569c] received 2024-05-10T23:46:01.225921325Z [2024-05-10 23:46:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c52627e5-3cdc-4b37-ad9d-0c452e0782c3] received 2024-05-10T23:46:01.226248265Z [2024-05-10 23:46:01,226: INFO/ForkPoolWorker-16] [f7eec0ee-7416-4110-89cb-5c75127ef67d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:46:01.230746177Z [2024-05-10 23:46:01,230: INFO/ForkPoolWorker-1] [01e40832-1aa8-4150-b777-855b1732569c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:46:01.235876897Z [2024-05-10 23:46:01,235: INFO/ForkPoolWorker-2] [c52627e5-3cdc-4b37-ad9d-0c452e0782c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:46:01.568265866Z [2024-05-10 23:46:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:46:01.570702930Z [2024-05-10 23:46:01,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:46:01.601751179Z [2024-05-10 23:46:01,595: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:46:01.606466697Z [2024-05-10 23:46:01,602: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:46:01.813277120Z [2024-05-10 23:46:01,810: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:46:01.970234100Z [2024-05-10 23:46:01,969: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:46:01.978681429Z [2024-05-10 23:46:01,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:46:02.054914790Z [2024-05-10 23:46:02,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:46:02.057769155Z [2024-05-10 23:46:02,057: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:46:02.057792670Z [2024-05-10 23:46:02,057: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:46:02.057925502Z [2024-05-10 23:46:02,057: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:46:02.058215988Z [2024-05-10 23:46:02,058: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:46:02.205821118Z [2024-05-10 23:46:02,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:46:02.510309661Z [2024-05-10 23:46:02,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[210eedf8-b283-4be7-9aa7-8f5eabb2e897] succeeded in 1.293107708000207s: None 2024-05-10T23:46:02.876078154Z [2024-05-10 23:46:02,875: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01e40832-1aa8-4150-b777-855b1732569c] succeeded in 1.651677415999984s: None 2024-05-10T23:46:02.910933420Z [2024-05-10 23:46:02,910: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:46:02.914903863Z [2024-05-10 23:46:02,914: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:46:02.971114967Z [2024-05-10 23:46:02,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:46:02.972589399Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:46:02.972607090Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:46:02.972729107Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:46:02.972764790Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:46:02.972941577Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:46:02.972951514Z [2024-05-10 23:46:02,972: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:46:03.078423646Z [2024-05-10 23:46:03,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:46:03.132038453Z [2024-05-10 23:46:03,131: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:46:03.135444077Z [2024-05-10 23:46:03,135: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:46:03.160162965Z [2024-05-10 23:46:03,159: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:46:03.162195322Z [2024-05-10 23:46:03,161: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:46:03.162672603Z [2024-05-10 23:46:03,162: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:46:03.162950038Z [2024-05-10 23:46:03,162: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:46:03.163121025Z [2024-05-10 23:46:03,162: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:46:03.163443190Z [2024-05-10 23:46:03,163: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:46:03.164104729Z [2024-05-10 23:46:03,163: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:46:03.284175749Z [2024-05-10 23:46:03,283: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:46:04.972705132Z [2024-05-10 23:46:04,972: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c52627e5-3cdc-4b37-ad9d-0c452e0782c3] succeeded in 3.7442985349998708s: None 2024-05-10T23:46:05.198512838Z [2024-05-10 23:46:05,197: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7eec0ee-7416-4110-89cb-5c75127ef67d] succeeded in 3.976282743000411s: None 2024-05-10T23:47:01.353456290Z [2024-05-10 23:47:01,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f720aea-ca2c-4c78-8aa5-44feda45d82f] received 2024-05-10T23:47:01.362459996Z [2024-05-10 23:47:01,362: INFO/ForkPoolWorker-15] [9f720aea-ca2c-4c78-8aa5-44feda45d82f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:47:01.366642309Z [2024-05-10 23:47:01,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[536d57c1-6bf6-4537-8afe-adc5f9850728] received 2024-05-10T23:47:01.374291662Z [2024-05-10 23:47:01,374: INFO/ForkPoolWorker-16] [536d57c1-6bf6-4537-8afe-adc5f9850728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:47:01.378713223Z [2024-05-10 23:47:01,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c1213dd-e0a4-46b1-82f0-3136a1f1e518] received 2024-05-10T23:47:01.386299175Z [2024-05-10 23:47:01,386: INFO/ForkPoolWorker-1] [2c1213dd-e0a4-46b1-82f0-3136a1f1e518] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:47:01.675057526Z [2024-05-10 23:47:01,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:47:01.866804771Z [2024-05-10 23:47:01,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:47:01.890469733Z [2024-05-10 23:47:01,879: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:47:02.110057172Z [2024-05-10 23:47:02,109: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:47:02.114129327Z [2024-05-10 23:47:02,113: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:47:02.153542263Z [2024-05-10 23:47:02,153: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:47:02.157383483Z [2024-05-10 23:47:02,156: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:47:02.157402459Z [2024-05-10 23:47:02,157: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:47:02.157407187Z [2024-05-10 23:47:02,157: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:47:02.157520099Z [2024-05-10 23:47:02,157: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:47:02.277216014Z [2024-05-10 23:47:02,276: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:47:03.031030992Z [2024-05-10 23:47:03,030: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c1213dd-e0a4-46b1-82f0-3136a1f1e518] succeeded in 1.6506500810000944s: None 2024-05-10T23:47:03.190371349Z [2024-05-10 23:47:03,189: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:47:03.194524047Z [2024-05-10 23:47:03,194: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:47:03.231660608Z [2024-05-10 23:47:03,231: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:47:03.234958181Z [2024-05-10 23:47:03,234: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:47:03.235050648Z [2024-05-10 23:47:03,234: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:47:03.235192208Z [2024-05-10 23:47:03,235: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:47:03.235240819Z [2024-05-10 23:47:03,235: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:47:03.235543707Z [2024-05-10 23:47:03,235: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:47:03.235645432Z [2024-05-10 23:47:03,235: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:47:03.368533606Z [2024-05-10 23:47:03,368: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:47:03.432206054Z [2024-05-10 23:47:03,431: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:47:03.434863585Z [2024-05-10 23:47:03,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:47:03.448692081Z [2024-05-10 23:47:03,448: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:47:03.450124833Z [2024-05-10 23:47:03,449: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:47:03.450140986Z [2024-05-10 23:47:03,450: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:47:03.450288850Z [2024-05-10 23:47:03,450: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:47:03.450299682Z [2024-05-10 23:47:03,450: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:47:03.450601004Z [2024-05-10 23:47:03,450: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:47:03.450608835Z [2024-05-10 23:47:03,450: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:47:03.599238366Z [2024-05-10 23:47:03,598: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:47:05.416018022Z [2024-05-10 23:47:05,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[536d57c1-6bf6-4537-8afe-adc5f9850728] succeeded in 4.047495481000624s: None 2024-05-10T23:47:05.730009665Z [2024-05-10 23:47:05,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f720aea-ca2c-4c78-8aa5-44feda45d82f] succeeded in 4.3749115350001375s: None 2024-05-10T23:48:00.302234302Z [2024-05-10 23:48:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a86f54fd-af9f-424a-a6ec-733326a67893] received 2024-05-10T23:48:00.328226826Z [2024-05-10 23:48:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9356a8c3-8dca-400a-ada6-4800c0300d85] received 2024-05-10T23:48:00.337234705Z [2024-05-10 23:48:00,336: INFO/ForkPoolWorker-15] [a86f54fd-af9f-424a-a6ec-733326a67893] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:48:00.360917503Z [2024-05-10 23:48:00,360: INFO/ForkPoolWorker-16] [9356a8c3-8dca-400a-ada6-4800c0300d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:48:00.405521062Z [2024-05-10 23:48:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89a7f0fc-913c-4cf7-aa19-c4eefd9c5066] received 2024-05-10T23:48:00.409922891Z [2024-05-10 23:48:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6faed34e-e9f1-424c-ac32-86f186a52b2b] received 2024-05-10T23:48:00.420468763Z [2024-05-10 23:48:00,418: INFO/ForkPoolWorker-2] [6faed34e-e9f1-424c-ac32-86f186a52b2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:48:00.421202210Z [2024-05-10 23:48:00,420: INFO/ForkPoolWorker-1] [89a7f0fc-913c-4cf7-aa19-c4eefd9c5066] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:48:01.227653100Z [2024-05-10 23:48:01,204: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:48:01.294379536Z [2024-05-10 23:48:01,290: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:48:01.319997446Z [2024-05-10 23:48:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:48:01.467544949Z [2024-05-10 23:48:01,467: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:48:01.472016207Z [2024-05-10 23:48:01,471: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:48:01.499834971Z [2024-05-10 23:48:01,499: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:48:01.520706713Z [2024-05-10 23:48:01,519: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:48:01.521326222Z [2024-05-10 23:48:01,520: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:48:01.521491513Z [2024-05-10 23:48:01,521: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:48:01.521755252Z [2024-05-10 23:48:01,521: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:48:01.668303600Z [2024-05-10 23:48:01,668: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:48:01.726684005Z [2024-05-10 23:48:01,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:48:02.108896314Z [2024-05-10 23:48:02,108: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:48:02.370035433Z [2024-05-10 23:48:02,368: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6faed34e-e9f1-424c-ac32-86f186a52b2b] succeeded in 1.9565027010003178s: None 2024-05-10T23:48:02.643693446Z [2024-05-10 23:48:02,643: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:48:02.647594430Z [2024-05-10 23:48:02,647: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:48:02.682778325Z [2024-05-10 23:48:02,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:48:02.686485848Z [2024-05-10 23:48:02,686: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:48:02.686878339Z [2024-05-10 23:48:02,686: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:48:02.688455467Z [2024-05-10 23:48:02,688: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:48:02.688666729Z [2024-05-10 23:48:02,688: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:48:02.689028791Z [2024-05-10 23:48:02,688: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:48:02.689336906Z [2024-05-10 23:48:02,689: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:48:02.793093859Z [2024-05-10 23:48:02,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a86f54fd-af9f-424a-a6ec-733326a67893] succeeded in 2.481023336000362s: None 2024-05-10T23:48:02.801512674Z [2024-05-10 23:48:02,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:48:03.049365435Z [2024-05-10 23:48:03,049: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:48:03.052755370Z [2024-05-10 23:48:03,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:48:03.084372575Z [2024-05-10 23:48:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:48:03.086652890Z [2024-05-10 23:48:03,086: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:48:03.086753987Z [2024-05-10 23:48:03,086: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:48:03.086963728Z [2024-05-10 23:48:03,086: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:48:03.087104161Z [2024-05-10 23:48:03,086: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:48:03.087372952Z [2024-05-10 23:48:03,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:48:03.087496574Z [2024-05-10 23:48:03,087: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:48:03.191524279Z [2024-05-10 23:48:03,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:48:04.569779318Z [2024-05-10 23:48:04,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9356a8c3-8dca-400a-ada6-4800c0300d85] succeeded in 4.23843303600006s: None 2024-05-10T23:48:04.629147434Z [2024-05-10 23:48:04,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89a7f0fc-913c-4cf7-aa19-c4eefd9c5066] succeeded in 4.216445938999641s: None 2024-05-10T23:49:01.290729803Z [2024-05-10 23:49:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30656816-4240-4fee-8173-4dbc944ffffb] received 2024-05-10T23:49:01.302313203Z [2024-05-10 23:49:01,301: INFO/ForkPoolWorker-15] [30656816-4240-4fee-8173-4dbc944ffffb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:49:01.307757889Z [2024-05-10 23:49:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21fc9f1f-8a4e-43ad-8c11-06301e614235] received 2024-05-10T23:49:01.316489041Z [2024-05-10 23:49:01,316: INFO/ForkPoolWorker-16] [21fc9f1f-8a4e-43ad-8c11-06301e614235] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:49:01.330553973Z [2024-05-10 23:49:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[680c3b1e-9626-4162-8a7e-ebe994a85a21] received 2024-05-10T23:49:01.341841189Z [2024-05-10 23:49:01,341: INFO/ForkPoolWorker-1] [680c3b1e-9626-4162-8a7e-ebe994a85a21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:49:01.655988964Z [2024-05-10 23:49:01,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:49:01.665077938Z [2024-05-10 23:49:01,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:49:01.739472136Z [2024-05-10 23:49:01,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:49:01.825405987Z [2024-05-10 23:49:01,825: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:49:01.829684856Z [2024-05-10 23:49:01,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:49:01.868964128Z [2024-05-10 23:49:01,868: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:49:01.871744394Z [2024-05-10 23:49:01,871: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:49:01.872276700Z [2024-05-10 23:49:01,871: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:49:01.872646885Z [2024-05-10 23:49:01,872: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:49:01.873294213Z [2024-05-10 23:49:01,873: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:49:01.986720390Z [2024-05-10 23:49:01,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:49:02.551825775Z [2024-05-10 23:49:02,551: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30656816-4240-4fee-8173-4dbc944ffffb] succeeded in 1.2573730310004976s: None 2024-05-10T23:49:02.924881394Z [2024-05-10 23:49:02,924: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:49:02.928260561Z [2024-05-10 23:49:02,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:49:02.954503498Z [2024-05-10 23:49:02,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:49:02.956288149Z [2024-05-10 23:49:02,956: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:49:02.956494420Z [2024-05-10 23:49:02,956: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:49:02.956735010Z [2024-05-10 23:49:02,956: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:49:02.956891945Z [2024-05-10 23:49:02,956: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:49:02.957254577Z [2024-05-10 23:49:02,957: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:49:02.957449366Z [2024-05-10 23:49:02,957: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:49:02.999489882Z [2024-05-10 23:49:02,999: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:49:03.002836012Z [2024-05-10 23:49:03,002: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:49:03.021412402Z [2024-05-10 23:49:03,021: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:49:03.022798833Z [2024-05-10 23:49:03,022: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:49:03.022831110Z [2024-05-10 23:49:03,022: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:49:03.023070550Z [2024-05-10 23:49:03,022: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:49:03.023225147Z [2024-05-10 23:49:03,023: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:49:03.023556856Z [2024-05-10 23:49:03,023: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:49:03.023615950Z [2024-05-10 23:49:03,023: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:49:03.040601874Z [2024-05-10 23:49:03,040: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:49:03.112772216Z [2024-05-10 23:49:03,112: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:49:05.182530513Z [2024-05-10 23:49:05,181: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21fc9f1f-8a4e-43ad-8c11-06301e614235] succeeded in 3.872558942000069s: None 2024-05-10T23:49:05.516211858Z [2024-05-10 23:49:05,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[680c3b1e-9626-4162-8a7e-ebe994a85a21] succeeded in 4.183166579000499s: None 2024-05-10T23:50:00.854597367Z [2024-05-10 23:50:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22f1a573-b650-4011-8455-231c84c8e147] received 2024-05-10T23:50:00.857365855Z [2024-05-10 23:50:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b5e1b59-a21a-43c0-b41c-8c6624a99932] received 2024-05-10T23:50:00.863540421Z [2024-05-10 23:50:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd69a0a5-a0ca-47d6-b6e6-00a4e71727ce] received 2024-05-10T23:50:00.866902005Z [2024-05-10 23:50:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1eec20c7-a549-416f-94cd-5d203a92de52] received 2024-05-10T23:50:00.868402513Z [2024-05-10 23:50:00,868: INFO/ForkPoolWorker-16] [0b5e1b59-a21a-43c0-b41c-8c6624a99932] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:00.868964618Z [2024-05-10 23:50:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3851691f-277b-4a4f-aea7-5cbfcbbc36fd] received 2024-05-10T23:50:00.871913462Z [2024-05-10 23:50:00,871: INFO/ForkPoolWorker-15] [22f1a573-b650-4011-8455-231c84c8e147] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:50:00.878558683Z [2024-05-10 23:50:00,878: INFO/ForkPoolWorker-2] [1eec20c7-a549-416f-94cd-5d203a92de52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:50:00.883394192Z [2024-05-10 23:50:00,883: INFO/ForkPoolWorker-1] [fd69a0a5-a0ca-47d6-b6e6-00a4e71727ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:50:00.894929961Z [2024-05-10 23:50:00,894: INFO/ForkPoolWorker-3] [3851691f-277b-4a4f-aea7-5cbfcbbc36fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:50:01.272345253Z [2024-05-10 23:50:01,267: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:50:01.344418357Z [2024-05-10 23:50:01,340: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:50:01.377116585Z [2024-05-10 23:50:01,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:50:01.474580845Z [2024-05-10 23:50:01,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:50:01.539286834Z [2024-05-10 23:50:01,538: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:50:01.544926174Z [2024-05-10 23:50:01,544: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:01.589489508Z [2024-05-10 23:50:01,588: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:50:01.591997064Z [2024-05-10 23:50:01,591: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:50:01.592146936Z [2024-05-10 23:50:01,588: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:50:01.592431550Z [2024-05-10 23:50:01,592: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:50:01.592577767Z [2024-05-10 23:50:01,592: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:50:01.592835724Z [2024-05-10 23:50:01,592: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:50:01.685001669Z [2024-05-10 23:50:01,684: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:01.994350916Z [2024-05-10 23:50:01,994: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:02.454947641Z [2024-05-10 23:50:02,454: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1eec20c7-a549-416f-94cd-5d203a92de52] succeeded in 1.5869766629994047s: None 2024-05-10T23:50:02.699525026Z [2024-05-10 23:50:02,699: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3851691f-277b-4a4f-aea7-5cbfcbbc36fd] succeeded in 1.8283336689992211s: None 2024-05-10T23:50:02.877658504Z [2024-05-10 23:50:02,877: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:50:02.881632921Z [2024-05-10 23:50:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:02.903055717Z [2024-05-10 23:50:02,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:50:02.905434940Z [2024-05-10 23:50:02,905: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:02.905448302Z [2024-05-10 23:50:02,905: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:02.905769783Z [2024-05-10 23:50:02,905: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:02.906069799Z [2024-05-10 23:50:02,905: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:50:02.906574579Z [2024-05-10 23:50:02,906: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:50:02.906863908Z [2024-05-10 23:50:02,906: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:03.000359977Z [2024-05-10 23:50:03,000: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:03.036017700Z [2024-05-10 23:50:03,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:50:03.039980147Z [2024-05-10 23:50:03,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:03.069402709Z [2024-05-10 23:50:03,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:50:03.071606500Z [2024-05-10 23:50:03,071: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:03.071901654Z [2024-05-10 23:50:03,071: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:03.072284865Z [2024-05-10 23:50:03,071: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:03.072988117Z [2024-05-10 23:50:03,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:50:03.074030708Z [2024-05-10 23:50:03,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:50:03.074260000Z [2024-05-10 23:50:03,074: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:03.133096841Z [2024-05-10 23:50:03,132: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:50:03.137301742Z [2024-05-10 23:50:03,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:03.159175861Z [2024-05-10 23:50:03,158: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:50:03.163500045Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:03.163567604Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:03.163701595Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:03.163772011Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:50:03.164026900Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:50:03.164065866Z [2024-05-10 23:50:03,163: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:03.176410228Z [2024-05-10 23:50:03,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:03.261997189Z [2024-05-10 23:50:03,261: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:04.028681099Z [2024-05-10 23:50:04,028: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b5e1b59-a21a-43c0-b41c-8c6624a99932] succeeded in 3.1694534409998596s: None 2024-05-10T23:50:04.523786906Z [2024-05-10 23:50:04,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd69a0a5-a0ca-47d6-b6e6-00a4e71727ce] succeeded in 3.658621900000071s: None 2024-05-10T23:50:04.769811994Z [2024-05-10 23:50:04,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59e80a5f-6521-4860-ba73-22e069c6cf1b] received 2024-05-10T23:50:04.791394743Z [2024-05-10 23:50:04,791: INFO/ForkPoolWorker-16] [59e80a5f-6521-4860-ba73-22e069c6cf1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:05.128494584Z [2024-05-10 23:50:05,124: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:50:05.201811876Z [2024-05-10 23:50:05,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22f1a573-b650-4011-8455-231c84c8e147] succeeded in 4.344226766000247s: None 2024-05-10T23:50:06.285921574Z [2024-05-10 23:50:06,285: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:50:06.289467968Z [2024-05-10 23:50:06,288: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:06.317245868Z [2024-05-10 23:50:06,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:50:06.319174591Z [2024-05-10 23:50:06,318: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:06.319395690Z [2024-05-10 23:50:06,319: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:06.319677591Z [2024-05-10 23:50:06,319: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:06.319863217Z [2024-05-10 23:50:06,319: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:50:06.320263409Z [2024-05-10 23:50:06,320: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:50:06.320739615Z [2024-05-10 23:50:06,320: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:06.410006924Z [2024-05-10 23:50:06,409: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:07.101501202Z [2024-05-10 23:50:07,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59e80a5f-6521-4860-ba73-22e069c6cf1b] succeeded in 2.329322370999762s: None 2024-05-10T23:50:07.615065596Z [2024-05-10 23:50:07,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[622cce72-40d8-4fe7-81ae-b5d40172199d] received 2024-05-10T23:50:07.639120987Z [2024-05-10 23:50:07,638: INFO/ForkPoolWorker-15] [622cce72-40d8-4fe7-81ae-b5d40172199d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:50:08.006202140Z [2024-05-10 23:50:07,999: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:50:09.151897331Z [2024-05-10 23:50:09,151: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:50:09.155753501Z [2024-05-10 23:50:09,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:09.182127176Z [2024-05-10 23:50:09,181: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:50:09.186313661Z [2024-05-10 23:50:09,185: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:09.186332017Z [2024-05-10 23:50:09,185: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:09.186335811Z [2024-05-10 23:50:09,185: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:09.186339669Z [2024-05-10 23:50:09,185: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:50:09.186342564Z [2024-05-10 23:50:09,185: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:50:09.186345379Z [2024-05-10 23:50:09,186: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:09.266840040Z [2024-05-10 23:50:09,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:09.844582723Z [2024-05-10 23:50:09,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[622cce72-40d8-4fe7-81ae-b5d40172199d] succeeded in 2.225180337999518s: None 2024-05-10T23:50:09.906346694Z [2024-05-10 23:50:09,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f0c99f-5a26-463e-a23a-cedaf0ae78a9] received 2024-05-10T23:50:09.913592832Z [2024-05-10 23:50:09,913: INFO/ForkPoolWorker-15] [b1f0c99f-5a26-463e-a23a-cedaf0ae78a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:50:10.207257324Z [2024-05-10 23:50:10,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:50:11.371042609Z [2024-05-10 23:50:11,370: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:50:11.375090067Z [2024-05-10 23:50:11,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:50:11.396918155Z [2024-05-10 23:50:11,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:50:11.398420935Z [2024-05-10 23:50:11,398: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:50:11.398555618Z [2024-05-10 23:50:11,398: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:50:11.398741895Z [2024-05-10 23:50:11,398: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:50:11.398845086Z [2024-05-10 23:50:11,398: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:50:11.399262197Z [2024-05-10 23:50:11,399: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:50:11.399355123Z [2024-05-10 23:50:11,399: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:50:11.490205430Z [2024-05-10 23:50:11,489: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:50:12.047792256Z [2024-05-10 23:50:12,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1f0c99f-5a26-463e-a23a-cedaf0ae78a9] succeeded in 2.1386222490000364s: None 2024-05-10T23:51:00.638258933Z [2024-05-10 23:51:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[984a4986-7bfe-45d2-a94a-248aba2f35d7] received 2024-05-10T23:51:00.640977111Z [2024-05-10 23:51:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[322978c9-c0ff-444a-b28e-3ef233e1fc1d] received 2024-05-10T23:51:00.647308277Z [2024-05-10 23:51:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53d2f616-6dfb-4899-920f-df9d9a61fd9b] received 2024-05-10T23:51:00.649396460Z [2024-05-10 23:51:00,649: INFO/ForkPoolWorker-15] [984a4986-7bfe-45d2-a94a-248aba2f35d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:51:00.651448667Z [2024-05-10 23:51:00,650: INFO/ForkPoolWorker-16] [322978c9-c0ff-444a-b28e-3ef233e1fc1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:51:00.660657342Z [2024-05-10 23:51:00,660: INFO/ForkPoolWorker-1] [53d2f616-6dfb-4899-920f-df9d9a61fd9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:51:00.969078674Z [2024-05-10 23:51:00,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:51:00.988756854Z [2024-05-10 23:51:00,985: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:51:00.999629443Z [2024-05-10 23:51:00,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:51:01.244061300Z [2024-05-10 23:51:01,243: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:51:01.248175300Z [2024-05-10 23:51:01,247: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:51:01.279841349Z [2024-05-10 23:51:01,279: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:51:01.281141411Z [2024-05-10 23:51:01,280: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:51:01.281278398Z [2024-05-10 23:51:01,280: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:51:01.281333206Z [2024-05-10 23:51:01,281: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:51:01.281465763Z [2024-05-10 23:51:01,281: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:51:01.445288833Z [2024-05-10 23:51:01,444: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:51:02.219759547Z [2024-05-10 23:51:02,219: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[322978c9-c0ff-444a-b28e-3ef233e1fc1d] succeeded in 1.5770627720003176s: None 2024-05-10T23:51:02.463770599Z [2024-05-10 23:51:02,463: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:51:02.467186957Z [2024-05-10 23:51:02,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:51:02.493180226Z [2024-05-10 23:51:02,492: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:51:02.496164763Z [2024-05-10 23:51:02,495: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:51:02.496902144Z [2024-05-10 23:51:02,496: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:51:02.496912870Z [2024-05-10 23:51:02,496: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:51:02.496917392Z [2024-05-10 23:51:02,496: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:51:02.497519693Z [2024-05-10 23:51:02,496: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:51:02.497764440Z [2024-05-10 23:51:02,497: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:51:02.602404564Z [2024-05-10 23:51:02,601: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:51:02.877685330Z [2024-05-10 23:51:02,877: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:51:02.881426539Z [2024-05-10 23:51:02,880: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:51:02.911743855Z [2024-05-10 23:51:02,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:51:02.913740761Z [2024-05-10 23:51:02,913: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:51:02.913815235Z [2024-05-10 23:51:02,913: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:51:02.914026677Z [2024-05-10 23:51:02,913: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:51:02.914035432Z [2024-05-10 23:51:02,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:51:02.914339973Z [2024-05-10 23:51:02,914: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:51:02.914354652Z [2024-05-10 23:51:02,914: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:51:03.035392407Z [2024-05-10 23:51:03,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:51:04.754107675Z [2024-05-10 23:51:04,753: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53d2f616-6dfb-4899-920f-df9d9a61fd9b] succeeded in 4.104127995999988s: None 2024-05-10T23:51:04.884221458Z [2024-05-10 23:51:04,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[984a4986-7bfe-45d2-a94a-248aba2f35d7] succeeded in 4.24157389300035s: None 2024-05-10T23:52:00.596574812Z [2024-05-10 23:52:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[508fadc5-363f-4798-8d3c-6255bc6acc45] received 2024-05-10T23:52:00.599388257Z [2024-05-10 23:52:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3613e0d9-53d8-4e3c-913a-20891cfb8e26] received 2024-05-10T23:52:00.603758946Z [2024-05-10 23:52:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed879429-809b-4d55-8aa1-67ee126cff11] received 2024-05-10T23:52:00.610602168Z [2024-05-10 23:52:00,609: INFO/ForkPoolWorker-16] [3613e0d9-53d8-4e3c-913a-20891cfb8e26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:52:00.615801427Z [2024-05-10 23:52:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567199b3-442b-4dc9-8a74-fca91fc04534] received 2024-05-10T23:52:00.616645272Z [2024-05-10 23:52:00,616: INFO/ForkPoolWorker-15] [508fadc5-363f-4798-8d3c-6255bc6acc45] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:52:00.618078211Z [2024-05-10 23:52:00,617: INFO/ForkPoolWorker-1] [ed879429-809b-4d55-8aa1-67ee126cff11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:52:00.625688726Z [2024-05-10 23:52:00,625: INFO/ForkPoolWorker-2] [567199b3-442b-4dc9-8a74-fca91fc04534] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:52:00.903097451Z [2024-05-10 23:52:00,899: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:52:00.937605486Z [2024-05-10 23:52:00,934: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:52:00.945839533Z [2024-05-10 23:52:00,942: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:52:01.120989739Z [2024-05-10 23:52:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:52:01.184984835Z [2024-05-10 23:52:01,181: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:52:01.200586404Z [2024-05-10 23:52:01,199: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:52:01.236116380Z [2024-05-10 23:52:01,235: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:52:01.237075927Z [2024-05-10 23:52:01,236: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:52:01.237107266Z [2024-05-10 23:52:01,236: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:52:01.237182001Z [2024-05-10 23:52:01,237: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:52:01.237360228Z [2024-05-10 23:52:01,237: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:52:01.325534293Z [2024-05-10 23:52:01,325: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:52:01.380070966Z [2024-05-10 23:52:01,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:52:01.886965922Z [2024-05-10 23:52:01,886: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[567199b3-442b-4dc9-8a74-fca91fc04534] succeeded in 1.269810745000541s: None 2024-05-10T23:52:01.916489613Z [2024-05-10 23:52:01,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[508fadc5-363f-4798-8d3c-6255bc6acc45] succeeded in 1.3151497959997869s: None 2024-05-10T23:52:02.346033210Z [2024-05-10 23:52:02,345: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:52:02.350196806Z [2024-05-10 23:52:02,349: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:52:02.372526737Z [2024-05-10 23:52:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:52:02.374093081Z [2024-05-10 23:52:02,373: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:52:02.374319343Z [2024-05-10 23:52:02,374: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:52:02.374593194Z [2024-05-10 23:52:02,374: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:52:02.374797076Z [2024-05-10 23:52:02,374: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:52:02.375031768Z [2024-05-10 23:52:02,374: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:52:02.375315397Z [2024-05-10 23:52:02,375: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:52:02.375511436Z [2024-05-10 23:52:02,375: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:52:02.378260126Z [2024-05-10 23:52:02,377: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:52:02.395202075Z [2024-05-10 23:52:02,394: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:52:02.396387713Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:52:02.396400113Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:52:02.396563397Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:52:02.396632132Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:52:02.396936584Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:52:02.396946953Z [2024-05-10 23:52:02,396: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:52:02.486594292Z [2024-05-10 23:52:02,486: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:52:02.495849267Z [2024-05-10 23:52:02,495: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:52:04.015019220Z [2024-05-10 23:52:04,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed879429-809b-4d55-8aa1-67ee126cff11] succeeded in 3.409185945999525s: None 2024-05-10T23:52:04.251275835Z [2024-05-10 23:52:04,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3613e0d9-53d8-4e3c-913a-20891cfb8e26] succeeded in 3.6480337590001s: None 2024-05-10T23:53:00.252685827Z [2024-05-10 23:53:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11156ed9-86fb-4398-9896-aa2cfc21e94f] received 2024-05-10T23:53:00.262035399Z [2024-05-10 23:53:00,261: INFO/ForkPoolWorker-15] [11156ed9-86fb-4398-9896-aa2cfc21e94f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:53:00.269183987Z [2024-05-10 23:53:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e24cc0c-d542-4841-a88a-844aef623e2a] received 2024-05-10T23:53:00.273251947Z [2024-05-10 23:53:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29a66907-34be-401f-8770-9dac21144543] received 2024-05-10T23:53:00.307139955Z [2024-05-10 23:53:00,297: INFO/ForkPoolWorker-16] [9e24cc0c-d542-4841-a88a-844aef623e2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:53:00.310030270Z [2024-05-10 23:53:00,308: INFO/ForkPoolWorker-1] [29a66907-34be-401f-8770-9dac21144543] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:53:00.714666236Z [2024-05-10 23:53:00,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:53:00.798420559Z [2024-05-10 23:53:00,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:53:00.820473246Z [2024-05-10 23:53:00,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:53:00.893160335Z [2024-05-10 23:53:00,892: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:53:00.897079928Z [2024-05-10 23:53:00,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:53:00.920565387Z [2024-05-10 23:53:00,920: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:53:00.921697405Z [2024-05-10 23:53:00,921: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:53:00.921784151Z [2024-05-10 23:53:00,921: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:53:00.921821469Z [2024-05-10 23:53:00,921: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:53:00.922195582Z [2024-05-10 23:53:00,922: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:53:01.069883447Z [2024-05-10 23:53:01,068: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:53:01.755750957Z [2024-05-10 23:53:01,755: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e24cc0c-d542-4841-a88a-844aef623e2a] succeeded in 1.4849990829998205s: None 2024-05-10T23:53:02.097477754Z [2024-05-10 23:53:02,096: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:53:02.101276138Z [2024-05-10 23:53:02,100: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:53:02.118762899Z [2024-05-10 23:53:02,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:53:02.120384761Z [2024-05-10 23:53:02,120: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:53:02.120515580Z [2024-05-10 23:53:02,120: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:53:02.120708001Z [2024-05-10 23:53:02,120: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:53:02.120881810Z [2024-05-10 23:53:02,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:53:02.121589636Z [2024-05-10 23:53:02,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:53:02.122146450Z [2024-05-10 23:53:02,122: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:53:02.266218849Z [2024-05-10 23:53:02,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:53:02.419456849Z [2024-05-10 23:53:02,419: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:53:02.422827919Z [2024-05-10 23:53:02,422: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:53:02.450101814Z [2024-05-10 23:53:02,449: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:53:02.451850026Z [2024-05-10 23:53:02,451: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:53:02.451868316Z [2024-05-10 23:53:02,451: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:53:02.452019341Z [2024-05-10 23:53:02,451: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:53:02.452063253Z [2024-05-10 23:53:02,451: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:53:02.452322062Z [2024-05-10 23:53:02,452: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:53:02.452369129Z [2024-05-10 23:53:02,452: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:53:02.540710527Z [2024-05-10 23:53:02,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:53:03.783007245Z [2024-05-10 23:53:03,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11156ed9-86fb-4398-9896-aa2cfc21e94f] succeeded in 3.5271075000000565s: None 2024-05-10T23:53:04.323633642Z [2024-05-10 23:53:04,323: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29a66907-34be-401f-8770-9dac21144543] succeeded in 4.035760562000178s: None 2024-05-10T23:54:01.171902754Z [2024-05-10 23:54:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45f4c3ea-f805-41e2-9709-262e6b48d332] received 2024-05-10T23:54:01.173677183Z [2024-05-10 23:54:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0c132ca-c933-4172-88c6-02e830e7c101] received 2024-05-10T23:54:01.182754086Z [2024-05-10 23:54:01,181: INFO/ForkPoolWorker-15] [45f4c3ea-f805-41e2-9709-262e6b48d332] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:54:01.192396679Z [2024-05-10 23:54:01,192: INFO/ForkPoolWorker-16] [a0c132ca-c933-4172-88c6-02e830e7c101] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:54:01.199217773Z [2024-05-10 23:54:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46bd6c46-fd4c-491d-ae44-8b885e83da5e] received 2024-05-10T23:54:01.207172304Z [2024-05-10 23:54:01,206: INFO/ForkPoolWorker-1] [46bd6c46-fd4c-491d-ae44-8b885e83da5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:54:01.215363797Z [2024-05-10 23:54:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c905c64-f35a-4022-8ec9-9b049c04e449] received 2024-05-10T23:54:01.226668495Z [2024-05-10 23:54:01,226: INFO/ForkPoolWorker-2] [4c905c64-f35a-4022-8ec9-9b049c04e449] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:54:01.554220529Z [2024-05-10 23:54:01,550: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:54:01.559988039Z [2024-05-10 23:54:01,556: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:54:01.581144702Z [2024-05-10 23:54:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:54:01.672770464Z [2024-05-10 23:54:01,668: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:54:01.767897331Z [2024-05-10 23:54:01,767: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-10T23:54:01.773165030Z [2024-05-10 23:54:01,772: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:54:01.834887841Z [2024-05-10 23:54:01,834: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:54:01.854532741Z [2024-05-10 23:54:01,854: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:54:01.854784581Z [2024-05-10 23:54:01,854: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:54:01.854972189Z [2024-05-10 23:54:01,854: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-10T23:54:01.856639499Z [2024-05-10 23:54:01,856: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:54:01.862197974Z [2024-05-10 23:54:01,861: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:54:01.991574842Z [2024-05-10 23:54:01,991: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:54:02.581260986Z [2024-05-10 23:54:02,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45f4c3ea-f805-41e2-9709-262e6b48d332] succeeded in 1.4061587480000526s: None 2024-05-10T23:54:02.794134372Z [2024-05-10 23:54:02,793: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c905c64-f35a-4022-8ec9-9b049c04e449] succeeded in 1.5768318720001844s: None 2024-05-10T23:54:03.080459381Z [2024-05-10 23:54:03,079: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:54:03.083825267Z [2024-05-10 23:54:03,083: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:54:03.114181219Z [2024-05-10 23:54:03,113: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:54:03.115457102Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:54:03.115498649Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:54:03.115683379Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:54:03.115732220Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:54:03.115924683Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:54:03.115995469Z [2024-05-10 23:54:03,115: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:54:03.226402261Z [2024-05-10 23:54:03,226: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:54:03.242566446Z [2024-05-10 23:54:03,242: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:54:03.246240982Z [2024-05-10 23:54:03,245: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:54:03.274124997Z [2024-05-10 23:54:03,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:54:03.279095204Z [2024-05-10 23:54:03,278: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:54:03.279319813Z [2024-05-10 23:54:03,279: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:54:03.279617656Z [2024-05-10 23:54:03,279: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:54:03.279913190Z [2024-05-10 23:54:03,279: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:54:03.280401256Z [2024-05-10 23:54:03,280: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:54:03.280613905Z [2024-05-10 23:54:03,280: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:54:03.399653133Z [2024-05-10 23:54:03,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:54:05.073408127Z [2024-05-10 23:54:05,073: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46bd6c46-fd4c-491d-ae44-8b885e83da5e] succeeded in 3.8726209890000973s: None 2024-05-10T23:54:05.140049756Z [2024-05-10 23:54:05,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0c132ca-c933-4172-88c6-02e830e7c101] succeeded in 3.9607615089998944s: None 2024-05-10T23:55:00.761261528Z [2024-05-10 23:55:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9eeb45d-dd06-4c6f-9fb9-fe46b4478cf0] received 2024-05-10T23:55:00.765159371Z [2024-05-10 23:55:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1051e20-094d-4231-b293-e1032f93f368] received 2024-05-10T23:55:00.774566257Z [2024-05-10 23:55:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0cd19b2-31c6-4c64-a7f2-d2dbe412b6ea] received 2024-05-10T23:55:00.777398484Z [2024-05-10 23:55:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a66c2aa-98ad-4207-86fc-58c09251fa18] received 2024-05-10T23:55:00.778017679Z [2024-05-10 23:55:00,777: INFO/ForkPoolWorker-16] [a1051e20-094d-4231-b293-e1032f93f368] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:55:00.780606382Z [2024-05-10 23:55:00,780: INFO/ForkPoolWorker-1] [f0cd19b2-31c6-4c64-a7f2-d2dbe412b6ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:00.781616605Z [2024-05-10 23:55:00,781: INFO/ForkPoolWorker-15] [c9eeb45d-dd06-4c6f-9fb9-fe46b4478cf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:55:00.783812859Z [2024-05-10 23:55:00,783: INFO/ForkPoolWorker-2] [4a66c2aa-98ad-4207-86fc-58c09251fa18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:55:01.139688603Z [2024-05-10 23:55:01,135: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:55:01.145333303Z [2024-05-10 23:55:01,141: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:55:01.156338577Z [2024-05-10 23:55:01,149: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:55:01.318126697Z [2024-05-10 23:55:01,313: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:55:01.484096143Z [2024-05-10 23:55:01,483: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:55:01.488345099Z [2024-05-10 23:55:01,487: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:01.528621846Z [2024-05-10 23:55:01,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:55:01.529922839Z [2024-05-10 23:55:01,529: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:55:01.530055898Z [2024-05-10 23:55:01,529: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:55:01.530140967Z [2024-05-10 23:55:01,530: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:55:01.530473860Z [2024-05-10 23:55:01,530: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:55:01.632126487Z [2024-05-10 23:55:01,631: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:02.290831993Z [2024-05-10 23:55:02,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1051e20-094d-4231-b293-e1032f93f368] succeeded in 1.5215100509994954s: None 2024-05-10T23:55:02.451375617Z [2024-05-10 23:55:02,451: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:55:02.457771730Z [2024-05-10 23:55:02,457: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:02.487443226Z [2024-05-10 23:55:02,487: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:55:02.488670485Z [2024-05-10 23:55:02,488: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:02.488686728Z [2024-05-10 23:55:02,488: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:02.488804506Z [2024-05-10 23:55:02,488: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:02.488813758Z [2024-05-10 23:55:02,488: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:55:02.489059694Z [2024-05-10 23:55:02,488: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:55:02.489097830Z [2024-05-10 23:55:02,489: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:02.553082210Z [2024-05-10 23:55:02,552: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:55:02.556564736Z [2024-05-10 23:55:02,556: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:02.562957680Z [2024-05-10 23:55:02,562: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:02.575017071Z [2024-05-10 23:55:02,574: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:55:02.578913008Z [2024-05-10 23:55:02,578: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:55:02.579066169Z [2024-05-10 23:55:02,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:02.581623593Z [2024-05-10 23:55:02,581: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:02.581777289Z [2024-05-10 23:55:02,581: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:02.582332371Z [2024-05-10 23:55:02,582: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:02.582451579Z [2024-05-10 23:55:02,582: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:55:02.582899160Z [2024-05-10 23:55:02,582: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:55:02.583081300Z [2024-05-10 23:55:02,582: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:02.602483273Z [2024-05-10 23:55:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:55:02.603713050Z [2024-05-10 23:55:02,603: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:02.603835491Z [2024-05-10 23:55:02,603: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:02.603980569Z [2024-05-10 23:55:02,603: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:02.604058026Z [2024-05-10 23:55:02,603: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:55:02.604374584Z [2024-05-10 23:55:02,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:55:02.604474426Z [2024-05-10 23:55:02,604: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:02.664225558Z [2024-05-10 23:55:02,663: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:02.713976533Z [2024-05-10 23:55:02,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:03.196482367Z [2024-05-10 23:55:03,195: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0cd19b2-31c6-4c64-a7f2-d2dbe412b6ea] succeeded in 2.4206742139995185s: None 2024-05-10T23:55:03.587197390Z [2024-05-10 23:55:03,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00ba7e17-1a79-46e9-80e8-a772a1e71de3] received 2024-05-10T23:55:03.599962100Z [2024-05-10 23:55:03,599: INFO/ForkPoolWorker-16] [00ba7e17-1a79-46e9-80e8-a772a1e71de3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:03.873483445Z [2024-05-10 23:55:03,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:55:04.266594053Z [2024-05-10 23:55:04,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9eeb45d-dd06-4c6f-9fb9-fe46b4478cf0] succeeded in 3.4993108689996006s: None 2024-05-10T23:55:04.619984395Z [2024-05-10 23:55:04,619: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4a66c2aa-98ad-4207-86fc-58c09251fa18] succeeded in 3.841131082999709s: None 2024-05-10T23:55:05.002054166Z [2024-05-10 23:55:05,001: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:55:05.005487267Z [2024-05-10 23:55:05,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:05.026575424Z [2024-05-10 23:55:05,026: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:55:05.027712985Z [2024-05-10 23:55:05,027: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:05.027725949Z [2024-05-10 23:55:05,027: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:05.027913721Z [2024-05-10 23:55:05,027: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:05.027969000Z [2024-05-10 23:55:05,027: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:55:05.028251590Z [2024-05-10 23:55:05,028: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:55:05.028259223Z [2024-05-10 23:55:05,028: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:05.126533894Z [2024-05-10 23:55:05,126: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:05.813516402Z [2024-05-10 23:55:05,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00ba7e17-1a79-46e9-80e8-a772a1e71de3] succeeded in 2.221210210999743s: None 2024-05-10T23:55:05.876583373Z [2024-05-10 23:55:05,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6843c5ff-33f5-4cc8-b61c-3e3198a7738a] received 2024-05-10T23:55:05.882255156Z [2024-05-10 23:55:05,881: INFO/ForkPoolWorker-15] [6843c5ff-33f5-4cc8-b61c-3e3198a7738a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-10T23:55:06.155934066Z [2024-05-10 23:55:06,152: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:55:07.284632723Z [2024-05-10 23:55:07,284: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:55:07.288443546Z [2024-05-10 23:55:07,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:07.307579823Z [2024-05-10 23:55:07,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:55:07.308987442Z [2024-05-10 23:55:07,308: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:07.309137276Z [2024-05-10 23:55:07,308: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:07.309307705Z [2024-05-10 23:55:07,309: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:07.309421034Z [2024-05-10 23:55:07,309: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:55:07.309719159Z [2024-05-10 23:55:07,309: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:55:07.309875263Z [2024-05-10 23:55:07,309: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:07.408007995Z [2024-05-10 23:55:07,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:07.953617324Z [2024-05-10 23:55:07,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6843c5ff-33f5-4cc8-b61c-3e3198a7738a] succeeded in 2.0753905569999915s: None 2024-05-10T23:55:08.326678051Z [2024-05-10 23:55:08,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[228e3e93-80a4-4845-a4a8-810bb65faa53] received 2024-05-10T23:55:08.338433501Z [2024-05-10 23:55:08,338: INFO/ForkPoolWorker-15] [228e3e93-80a4-4845-a4a8-810bb65faa53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-10T23:55:08.612927331Z [2024-05-10 23:55:08,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-10T23:55:09.662079960Z [2024-05-10 23:55:09,661: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:55:09.665577816Z [2024-05-10 23:55:09,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:55:09.682703269Z [2024-05-10 23:55:09,682: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:55:09.683870192Z [2024-05-10 23:55:09,683: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:55:09.684006376Z [2024-05-10 23:55:09,683: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:55:09.684195633Z [2024-05-10 23:55:09,684: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:55:09.684307822Z [2024-05-10 23:55:09,684: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:55:09.684661846Z [2024-05-10 23:55:09,684: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-10T23:55:09.684828598Z [2024-05-10 23:55:09,684: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:55:09.772292634Z [2024-05-10 23:55:09,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:55:10.291467942Z [2024-05-10 23:55:10,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[228e3e93-80a4-4845-a4a8-810bb65faa53] succeeded in 1.9610978079999768s: None 2024-05-10T23:56:00.998977445Z [2024-05-10 23:56:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b48407f-ae84-4b9c-8f67-62068c1b8a64] received 2024-05-10T23:56:01.002398339Z [2024-05-10 23:56:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2a0d30d-510e-41aa-8613-f533b243a297] received 2024-05-10T23:56:01.009846103Z [2024-05-10 23:56:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47c29578-34a7-44c0-a974-a28fc07f5d1f] received 2024-05-10T23:56:01.015677793Z [2024-05-10 23:56:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d252c7f8-6a08-4263-b1df-0d5508823564] received 2024-05-10T23:56:01.034096687Z [2024-05-10 23:56:01,028: INFO/ForkPoolWorker-16] [d2a0d30d-510e-41aa-8613-f533b243a297] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:56:01.037685473Z [2024-05-10 23:56:01,034: INFO/ForkPoolWorker-15] [7b48407f-ae84-4b9c-8f67-62068c1b8a64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:56:01.040221453Z [2024-05-10 23:56:01,032: INFO/ForkPoolWorker-1] [47c29578-34a7-44c0-a974-a28fc07f5d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:56:01.043080905Z [2024-05-10 23:56:01,042: INFO/ForkPoolWorker-2] [d252c7f8-6a08-4263-b1df-0d5508823564] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:56:01.500582433Z [2024-05-10 23:56:01,496: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:56:01.661144218Z [2024-05-10 23:56:01,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:56:01.995245154Z [2024-05-10 23:56:01,972: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:56:02.012034108Z [2024-05-10 23:56:02,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:56:02.015471423Z [2024-05-10 23:56:02,015: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:56:02.039549031Z [2024-05-10 23:56:02,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:56:02.105800138Z [2024-05-10 23:56:02,105: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:56:02.107681564Z [2024-05-10 23:56:02,107: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:56:02.107955008Z [2024-05-10 23:56:02,107: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:56:02.108163802Z [2024-05-10 23:56:02,107: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:56:02.108457147Z [2024-05-10 23:56:02,108: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:56:02.231360369Z [2024-05-10 23:56:02,231: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:56:02.394433649Z [2024-05-10 23:56:02,394: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:56:03.009216059Z [2024-05-10 23:56:03,008: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2a0d30d-510e-41aa-8613-f533b243a297] succeeded in 2.003844206999929s: None 2024-05-10T23:56:03.074560728Z [2024-05-10 23:56:03,074: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[47c29578-34a7-44c0-a974-a28fc07f5d1f] succeeded in 2.061038877000101s: None 2024-05-10T23:56:03.177969551Z [2024-05-10 23:56:03,177: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:56:03.181378993Z [2024-05-10 23:56:03,180: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:56:03.211440068Z [2024-05-10 23:56:03,211: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:56:03.213727849Z [2024-05-10 23:56:03,213: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:56:03.213827291Z [2024-05-10 23:56:03,213: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:56:03.214093298Z [2024-05-10 23:56:03,213: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:56:03.214207840Z [2024-05-10 23:56:03,214: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:56:03.214515128Z [2024-05-10 23:56:03,214: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:56:03.214629214Z [2024-05-10 23:56:03,214: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:56:03.302638205Z [2024-05-10 23:56:03,302: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:56:03.441454752Z [2024-05-10 23:56:03,441: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:56:03.445050875Z [2024-05-10 23:56:03,444: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:56:03.473787840Z [2024-05-10 23:56:03,473: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:56:03.483471518Z [2024-05-10 23:56:03,482: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:56:03.483495036Z [2024-05-10 23:56:03,482: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:56:03.483499591Z [2024-05-10 23:56:03,482: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:56:03.483504046Z [2024-05-10 23:56:03,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:56:03.483507624Z [2024-05-10 23:56:03,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:56:03.483510953Z [2024-05-10 23:56:03,483: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:56:03.625546729Z [2024-05-10 23:56:03,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:56:05.042233432Z [2024-05-10 23:56:05,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b48407f-ae84-4b9c-8f67-62068c1b8a64] succeeded in 4.030602362000536s: None 2024-05-10T23:56:05.049449832Z [2024-05-10 23:56:05,048: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d252c7f8-6a08-4263-b1df-0d5508823564] succeeded in 4.0271177730001s: None 2024-05-10T23:57:00.231523497Z [2024-05-10 23:57:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70c58f24-727f-4d70-be52-2800e8776ed8] received 2024-05-10T23:57:00.234313954Z [2024-05-10 23:57:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b13e6625-1b51-48ab-a0b8-55fbf8f065cc] received 2024-05-10T23:57:00.242842450Z [2024-05-10 23:57:00,242: INFO/ForkPoolWorker-16] [b13e6625-1b51-48ab-a0b8-55fbf8f065cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:57:00.246236819Z [2024-05-10 23:57:00,245: INFO/ForkPoolWorker-15] [70c58f24-727f-4d70-be52-2800e8776ed8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:57:00.250763647Z [2024-05-10 23:57:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d164d05-3658-42a6-af61-4d5214cbb82c] received 2024-05-10T23:57:00.261713049Z [2024-05-10 23:57:00,261: INFO/ForkPoolWorker-1] [6d164d05-3658-42a6-af61-4d5214cbb82c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:57:00.621952700Z [2024-05-10 23:57:00,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:57:00.622463673Z [2024-05-10 23:57:00,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:57:00.666672522Z [2024-05-10 23:57:00,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:57:00.857329884Z [2024-05-10 23:57:00,856: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-10T23:57:00.861488361Z [2024-05-10 23:57:00,860: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:57:00.886023275Z [2024-05-10 23:57:00,885: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:57:00.889006491Z [2024-05-10 23:57:00,888: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:57:00.889092645Z [2024-05-10 23:57:00,888: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:57:00.889101024Z [2024-05-10 23:57:00,888: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-10T23:57:00.889291889Z [2024-05-10 23:57:00,889: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:57:00.985711545Z [2024-05-10 23:57:00,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:57:01.755931152Z [2024-05-10 23:57:01,755: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b13e6625-1b51-48ab-a0b8-55fbf8f065cc] succeeded in 1.519655512999634s: None 2024-05-10T23:57:01.990901203Z [2024-05-10 23:57:01,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:57:01.994148503Z [2024-05-10 23:57:01,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:57:02.051371294Z [2024-05-10 23:57:02,051: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:57:02.053084155Z [2024-05-10 23:57:02,052: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:57:02.053190829Z [2024-05-10 23:57:02,053: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:57:02.053297246Z [2024-05-10 23:57:02,053: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:57:02.053343837Z [2024-05-10 23:57:02,053: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:57:02.053631787Z [2024-05-10 23:57:02,053: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:57:02.053700320Z [2024-05-10 23:57:02,053: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:57:02.112315054Z [2024-05-10 23:57:02,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-10T23:57:02.116321818Z [2024-05-10 23:57:02,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:57:02.139657262Z [2024-05-10 23:57:02,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:57:02.142094485Z [2024-05-10 23:57:02,141: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:57:02.142233292Z [2024-05-10 23:57:02,142: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:57:02.142428298Z [2024-05-10 23:57:02,142: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:57:02.142535462Z [2024-05-10 23:57:02,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-10T23:57:02.142868661Z [2024-05-10 23:57:02,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:57:02.142993712Z [2024-05-10 23:57:02,142: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:57:02.170878534Z [2024-05-10 23:57:02,170: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:57:02.252083498Z [2024-05-10 23:57:02,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:57:04.097522620Z [2024-05-10 23:57:04,096: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d164d05-3658-42a6-af61-4d5214cbb82c] succeeded in 3.844116457000382s: None 2024-05-10T23:57:04.844531722Z [2024-05-10 23:57:04,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70c58f24-727f-4d70-be52-2800e8776ed8] succeeded in 4.607807563000279s: None 2024-05-10T23:58:01.191541169Z [2024-05-10 23:58:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13f1ff51-a8e9-4558-ad96-4203b93381ac] received 2024-05-10T23:58:01.193312209Z [2024-05-10 23:58:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43916e80-12f2-47db-8e39-77e4f40b0668] received 2024-05-10T23:58:01.200713408Z [2024-05-10 23:58:01,200: INFO/ForkPoolWorker-15] [13f1ff51-a8e9-4558-ad96-4203b93381ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-10T23:58:01.200733562Z [2024-05-10 23:58:01,200: INFO/ForkPoolWorker-16] [43916e80-12f2-47db-8e39-77e4f40b0668] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:58:01.207711981Z [2024-05-10 23:58:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebd1786e-b175-40b3-985c-726a86a3a70d] received 2024-05-10T23:58:01.209109055Z [2024-05-10 23:58:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc966809-c811-4ad5-b010-739d963331d0] received 2024-05-10T23:58:01.219053153Z [2024-05-10 23:58:01,218: INFO/ForkPoolWorker-2] [bc966809-c811-4ad5-b010-739d963331d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:58:01.220615952Z [2024-05-10 23:58:01,220: INFO/ForkPoolWorker-1] [ebd1786e-b175-40b3-985c-726a86a3a70d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:58:01.489585933Z [2024-05-10 23:58:01,486: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:58:01.519277628Z [2024-05-10 23:58:01,515: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:58:01.565398569Z [2024-05-10 23:58:01,562: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:58:01.613051183Z [2024-05-10 23:58:01,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-10T23:58:01.743676163Z [2024-05-10 23:58:01,743: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-10T23:58:01.748150752Z [2024-05-10 23:58:01,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:58:01.802468151Z [2024-05-10 23:58:01,802: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:58:01.807270099Z [2024-05-10 23:58:01,806: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:58:01.808759052Z [2024-05-10 23:58:01,807: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:58:01.809621293Z [2024-05-10 23:58:01,808: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-10T23:58:01.820561292Z [2024-05-10 23:58:01,820: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:58:01.932762761Z [2024-05-10 23:58:01,932: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:58:02.022005628Z [2024-05-10 23:58:02,021: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:58:02.541540155Z [2024-05-10 23:58:02,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13f1ff51-a8e9-4558-ad96-4203b93381ac] succeeded in 1.3467401010002504s: None 2024-05-10T23:58:02.567898802Z [2024-05-10 23:58:02,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ebd1786e-b175-40b3-985c-726a86a3a70d] succeeded in 1.3541643890002888s: None 2024-05-10T23:58:02.836319303Z [2024-05-10 23:58:02,835: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:58:02.839900734Z [2024-05-10 23:58:02,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:58:02.865410336Z [2024-05-10 23:58:02,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:58:02.867090262Z [2024-05-10 23:58:02,866: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:58:02.867226653Z [2024-05-10 23:58:02,867: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:58:02.867407846Z [2024-05-10 23:58:02,867: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:58:02.867538939Z [2024-05-10 23:58:02,867: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:58:02.867998448Z [2024-05-10 23:58:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:58:02.868131628Z [2024-05-10 23:58:02,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:58:02.930019960Z [2024-05-10 23:58:02,929: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-10T23:58:02.933433008Z [2024-05-10 23:58:02,932: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:58:02.950508983Z [2024-05-10 23:58:02,950: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-10T23:58:02.951780402Z [2024-05-10 23:58:02,951: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:58:02.951941524Z [2024-05-10 23:58:02,951: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:58:02.952159273Z [2024-05-10 23:58:02,951: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:58:02.954447302Z [2024-05-10 23:58:02,954: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-10T23:58:02.954910004Z [2024-05-10 23:58:02,954: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:58:02.955045853Z [2024-05-10 23:58:02,954: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:58:02.962682310Z [2024-05-10 23:58:02,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:58:03.056462063Z [2024-05-10 23:58:03,056: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:58:04.794601934Z [2024-05-10 23:58:04,794: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bc966809-c811-4ad5-b010-739d963331d0] succeeded in 3.583486360000279s: None 2024-05-10T23:58:05.410913703Z [2024-05-10 23:58:05,410: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43916e80-12f2-47db-8e39-77e4f40b0668] succeeded in 4.215985933000411s: None 2024-05-10T23:59:00.995312762Z [2024-05-10 23:59:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5253321b-9b2f-4a74-afa4-319c0833ddcd] received 2024-05-10T23:59:01.007451786Z [2024-05-10 23:59:01,007: INFO/ForkPoolWorker-15] [5253321b-9b2f-4a74-afa4-319c0833ddcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-10T23:59:01.022997248Z [2024-05-10 23:59:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24d41cb2-a6f9-49fc-9726-f148fd7d6779] received 2024-05-10T23:59:01.023015523Z [2024-05-10 23:59:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3af2a528-1910-45e2-b1d1-dd4dd725bf8e] received 2024-05-10T23:59:01.046830397Z [2024-05-10 23:59:01,034: INFO/ForkPoolWorker-1] [3af2a528-1910-45e2-b1d1-dd4dd725bf8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-10T23:59:01.046852507Z [2024-05-10 23:59:01,042: INFO/ForkPoolWorker-16] [24d41cb2-a6f9-49fc-9726-f148fd7d6779] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-10T23:59:01.391271080Z [2024-05-10 23:59:01,388: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-10T23:59:01.480418802Z [2024-05-10 23:59:01,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-10T23:59:01.497687012Z [2024-05-10 23:59:01,494: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-10T23:59:01.647883323Z [2024-05-10 23:59:01,647: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-10T23:59:01.651832216Z [2024-05-10 23:59:01,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:59:01.674768413Z [2024-05-10 23:59:01,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-10T23:59:01.678674969Z [2024-05-10 23:59:01,678: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-10T23:59:01.678711876Z [2024-05-10 23:59:01,678: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-10T23:59:01.678807055Z [2024-05-10 23:59:01,678: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-10T23:59:01.679070703Z [2024-05-10 23:59:01,678: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-10T23:59:01.835434272Z [2024-05-10 23:59:01,835: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:59:02.413766151Z [2024-05-10 23:59:02,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5253321b-9b2f-4a74-afa4-319c0833ddcd] succeeded in 1.4121293959997274s: None 2024-05-10T23:59:02.726454278Z [2024-05-10 23:59:02,725: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-10T23:59:02.729819210Z [2024-05-10 23:59:02,729: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:59:02.770042246Z [2024-05-10 23:59:02,769: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-10T23:59:02.771926968Z [2024-05-10 23:59:02,771: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:59:02.772084476Z [2024-05-10 23:59:02,771: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:59:02.772303503Z [2024-05-10 23:59:02,772: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:59:02.772424507Z [2024-05-10 23:59:02,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-10T23:59:02.772784023Z [2024-05-10 23:59:02,772: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-10T23:59:02.772938843Z [2024-05-10 23:59:02,772: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:59:02.883816986Z [2024-05-10 23:59:02,883: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:59:02.917122697Z [2024-05-10 23:59:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-10T23:59:02.921593162Z [2024-05-10 23:59:02,921: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-10T23:59:02.958968320Z [2024-05-10 23:59:02,958: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-10T23:59:02.963778284Z [2024-05-10 23:59:02,963: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-10T23:59:02.963792796Z [2024-05-10 23:59:02,963: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-10T23:59:02.964024149Z [2024-05-10 23:59:02,963: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-10T23:59:02.964287414Z [2024-05-10 23:59:02,964: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-10T23:59:02.964894065Z [2024-05-10 23:59:02,964: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-10T23:59:02.965151386Z [2024-05-10 23:59:02,964: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-10T23:59:03.057840041Z [2024-05-10 23:59:03,057: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-10T23:59:04.808016209Z [2024-05-10 23:59:04,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24d41cb2-a6f9-49fc-9726-f148fd7d6779] succeeded in 3.7878283250001914s: None 2024-05-10T23:59:06.020664425Z [2024-05-10 23:59:06,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3af2a528-1910-45e2-b1d1-dd4dd725bf8e] succeeded in 4.996714373000032s: None 2024-05-11T00:00:00.930396920Z [2024-05-11 00:00:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab1bd833-123a-4f15-9871-eb57c3a30098] received 2024-05-11T00:00:00.932210964Z [2024-05-11 00:00:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8c2452a-6f9b-41c2-b2ed-3023089e1397] received 2024-05-11T00:00:00.933921911Z [2024-05-11 00:00:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea8c505c-cf65-4566-ba6c-43c8ae7e6477] received 2024-05-11T00:00:00.939115124Z [2024-05-11 00:00:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f84c3b27-1829-47f5-be60-0e920f2d0a29] received 2024-05-11T00:00:00.948357865Z [2024-05-11 00:00:00,948: INFO/ForkPoolWorker-15] [ab1bd833-123a-4f15-9871-eb57c3a30098] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:00:00.948495523Z [2024-05-11 00:00:00,948: INFO/ForkPoolWorker-2] [f84c3b27-1829-47f5-be60-0e920f2d0a29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:00:00.949568521Z [2024-05-11 00:00:00,949: INFO/ForkPoolWorker-16] [d8c2452a-6f9b-41c2-b2ed-3023089e1397] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-10T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:00:00.950218949Z [2024-05-11 00:00:00,949: INFO/ForkPoolWorker-1] [ea8c505c-cf65-4566-ba6c-43c8ae7e6477] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:00.957528688Z [2024-05-11 00:00:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a3dfb26-7ce1-4e9b-be10-a2d879683bf8] received 2024-05-11T00:00:00.969262975Z [2024-05-11 00:00:00,968: INFO/ForkPoolWorker-3] [5a3dfb26-7ce1-4e9b-be10-a2d879683bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-10T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:00:01.379195611Z [2024-05-11 00:00:01,375: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:00:01.457960034Z [2024-05-11 00:00:01,450: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:00:01.583418628Z [2024-05-11 00:00:01,580: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:00:01.740874223Z [2024-05-11 00:00:01,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:00:01.835469945Z [2024-05-11 00:00:01,835: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:01.868829608Z [2024-05-11 00:00:01,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:00:02.103305377Z [2024-05-11 00:00:02,102: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:00:02.107271260Z [2024-05-11 00:00:02,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:02.175280678Z [2024-05-11 00:00:02,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:00:02.182956050Z [2024-05-11 00:00:02,182: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:00:02.183038676Z [2024-05-11 00:00:02,182: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:00:02.183094307Z [2024-05-11 00:00:02,182: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:00:02.183353432Z [2024-05-11 00:00:02,183: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:00:02.312525812Z [2024-05-11 00:00:02,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:02.513107073Z [2024-05-11 00:00:02,512: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5a3dfb26-7ce1-4e9b-be10-a2d879683bf8] succeeded in 1.5527528200000233s: None 2024-05-11T00:00:02.879200372Z [2024-05-11 00:00:02,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab1bd833-123a-4f15-9871-eb57c3a30098] succeeded in 1.9458268500002305s: None 2024-05-11T00:00:03.024198292Z [2024-05-11 00:00:03,023: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:00:03.027653742Z [2024-05-11 00:00:03,027: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:03.058687122Z [2024-05-11 00:00:03,058: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:00:03.060084657Z [2024-05-11 00:00:03,059: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:03.060118710Z [2024-05-11 00:00:03,060: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:03.060289132Z [2024-05-11 00:00:03,060: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:03.060309398Z [2024-05-11 00:00:03,060: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:00:03.060511848Z [2024-05-11 00:00:03,060: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:00:03.060536824Z [2024-05-11 00:00:03,060: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:03.098031071Z [2024-05-11 00:00:03,097: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:00:03.101541296Z [2024-05-11 00:00:03,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:03.139510139Z [2024-05-11 00:00:03,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:00:03.140731185Z [2024-05-11 00:00:03,140: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:03.140746934Z [2024-05-11 00:00:03,140: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:03.140809716Z [2024-05-11 00:00:03,140: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:03.140848733Z [2024-05-11 00:00:03,140: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:00:03.141119839Z [2024-05-11 00:00:03,140: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:00:03.141124792Z [2024-05-11 00:00:03,141: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:03.166515612Z [2024-05-11 00:00:03,166: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:03.233052817Z [2024-05-11 00:00:03,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:03.629622164Z [2024-05-11 00:00:03,629: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:00:03.635485025Z [2024-05-11 00:00:03,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:03.675594719Z [2024-05-11 00:00:03,675: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:00:03.678445050Z [2024-05-11 00:00:03,678: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:03.678718249Z [2024-05-11 00:00:03,678: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:03.679043892Z [2024-05-11 00:00:03,678: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:03.679239429Z [2024-05-11 00:00:03,679: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:00:03.679718523Z [2024-05-11 00:00:03,679: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:00:03.680484208Z [2024-05-11 00:00:03,679: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:03.759012782Z [2024-05-11 00:00:03,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:04.356818589Z [2024-05-11 00:00:04,356: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea8c505c-cf65-4566-ba6c-43c8ae7e6477] succeeded in 3.415045130999715s: None 2024-05-11T00:00:04.660533311Z [2024-05-11 00:00:04,660: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f84c3b27-1829-47f5-be60-0e920f2d0a29] succeeded in 3.7200489619999644s: None 2024-05-11T00:00:05.003050329Z [2024-05-11 00:00:05,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8c2452a-6f9b-41c2-b2ed-3023089e1397] succeeded in 4.0674528010004s: None 2024-05-11T00:00:05.313719994Z [2024-05-11 00:00:05,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[792512d5-8bb1-4ca8-8dcd-44be5c744e9d] received 2024-05-11T00:00:05.320866241Z [2024-05-11 00:00:05,320: INFO/ForkPoolWorker-15] [792512d5-8bb1-4ca8-8dcd-44be5c744e9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:05.605282667Z [2024-05-11 00:00:05,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:00:06.878012495Z [2024-05-11 00:00:06,873: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:00:06.878051914Z [2024-05-11 00:00:06,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:06.936275584Z [2024-05-11 00:00:06,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:00:06.937453873Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:06.937520932Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:06.937574838Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:06.937612356Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:00:06.937816585Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:00:06.937856339Z [2024-05-11 00:00:06,937: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:07.027110229Z [2024-05-11 00:00:07,026: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:07.675381404Z [2024-05-11 00:00:07,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27c8e830-1e30-48e9-9317-991fbc827bce] received 2024-05-11T00:00:07.681297870Z [2024-05-11 00:00:07,681: INFO/ForkPoolWorker-16] [27c8e830-1e30-48e9-9317-991fbc827bce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:00:07.713824042Z [2024-05-11 00:00:07,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[792512d5-8bb1-4ca8-8dcd-44be5c744e9d] succeeded in 2.3980350440006077s: None 2024-05-11T00:00:08.081407337Z [2024-05-11 00:00:08,078: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:00:09.216072091Z [2024-05-11 00:00:09,215: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:00:09.219446714Z [2024-05-11 00:00:09,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:09.235550650Z [2024-05-11 00:00:09,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:00:09.236786457Z [2024-05-11 00:00:09,236: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:09.236993880Z [2024-05-11 00:00:09,236: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:09.237104415Z [2024-05-11 00:00:09,236: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:09.237182030Z [2024-05-11 00:00:09,237: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:00:09.237622914Z [2024-05-11 00:00:09,237: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:00:09.237673974Z [2024-05-11 00:00:09,237: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:09.310415382Z [2024-05-11 00:00:09,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:09.938470509Z [2024-05-11 00:00:09,938: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27c8e830-1e30-48e9-9317-991fbc827bce] succeeded in 2.261387096999897s: None 2024-05-11T00:00:10.164849297Z [2024-05-11 00:00:10,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee9e9478-22d9-415b-a067-1a83dcd967af] received 2024-05-11T00:00:10.175779453Z [2024-05-11 00:00:10,175: INFO/ForkPoolWorker-15] [ee9e9478-22d9-415b-a067-1a83dcd967af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-10T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:00:10.459944069Z [2024-05-11 00:00:10,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:00:11.683408834Z [2024-05-11 00:00:11,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:00:11.686881476Z [2024-05-11 00:00:11,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:00:11.703737499Z [2024-05-11 00:00:11,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:00:11.705029008Z [2024-05-11 00:00:11,704: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:00:11.705107691Z [2024-05-11 00:00:11,704: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:00:11.705303628Z [2024-05-11 00:00:11,705: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:00:11.705378246Z [2024-05-11 00:00:11,705: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:00:11.705640164Z [2024-05-11 00:00:11,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:00:11.705751456Z [2024-05-11 00:00:11,705: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:00:11.798157015Z [2024-05-11 00:00:11,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:00:12.382017968Z [2024-05-11 00:00:12,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee9e9478-22d9-415b-a067-1a83dcd967af] succeeded in 2.2151687409996157s: None 2024-05-11T00:01:01.250907803Z [2024-05-11 00:01:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc636205-e84f-4b8d-b05e-c4f0edb26045] received 2024-05-11T00:01:01.253561801Z [2024-05-11 00:01:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d63dd11-6353-40fb-9dcb-4d0d3084c772] received 2024-05-11T00:01:01.256319784Z [2024-05-11 00:01:01,256: INFO/ForkPoolWorker-15] [bc636205-e84f-4b8d-b05e-c4f0edb26045] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:01:01.257903311Z [2024-05-11 00:01:01,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2850b2e7-9bca-4808-b936-7462292e7563] received 2024-05-11T00:01:01.263986208Z [2024-05-11 00:01:01,263: INFO/ForkPoolWorker-1] [2850b2e7-9bca-4808-b936-7462292e7563] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:01:01.272138306Z [2024-05-11 00:01:01,271: INFO/ForkPoolWorker-16] [7d63dd11-6353-40fb-9dcb-4d0d3084c772] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:01:01.551161923Z [2024-05-11 00:01:01,547: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:01:01.569999886Z [2024-05-11 00:01:01,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:01:01.597723506Z [2024-05-11 00:01:01,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:01:01.771199179Z [2024-05-11 00:01:01,770: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:01:01.776018865Z [2024-05-11 00:01:01,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:01:01.804547254Z [2024-05-11 00:01:01,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:01:01.807252228Z [2024-05-11 00:01:01,806: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:01:01.807442693Z [2024-05-11 00:01:01,807: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:01:01.807569766Z [2024-05-11 00:01:01,807: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:01:01.808308047Z [2024-05-11 00:01:01,807: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:01:01.922640776Z [2024-05-11 00:01:01,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:01:02.614775750Z [2024-05-11 00:01:02,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc636205-e84f-4b8d-b05e-c4f0edb26045] succeeded in 1.3620189060002303s: None 2024-05-11T00:01:02.828356889Z [2024-05-11 00:01:02,827: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:01:02.832723888Z [2024-05-11 00:01:02,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:01:02.887634690Z [2024-05-11 00:01:02,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:01:02.888990859Z [2024-05-11 00:01:02,888: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:01:02.889107936Z [2024-05-11 00:01:02,888: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:01:02.889284739Z [2024-05-11 00:01:02,889: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:01:02.890237764Z [2024-05-11 00:01:02,889: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:01:02.890551951Z [2024-05-11 00:01:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:01:02.890630300Z [2024-05-11 00:01:02,890: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:01:02.917260642Z [2024-05-11 00:01:02,916: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:01:02.920957322Z [2024-05-11 00:01:02,920: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:01:02.951168394Z [2024-05-11 00:01:02,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:01:02.953677966Z [2024-05-11 00:01:02,953: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:01:02.953694268Z [2024-05-11 00:01:02,953: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:01:02.953985792Z [2024-05-11 00:01:02,953: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:01:02.954190941Z [2024-05-11 00:01:02,953: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:01:02.954561957Z [2024-05-11 00:01:02,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:01:02.954619076Z [2024-05-11 00:01:02,954: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:01:02.986562022Z [2024-05-11 00:01:02,986: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:01:03.074863360Z [2024-05-11 00:01:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:01:06.083897258Z [2024-05-11 00:01:06,083: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2850b2e7-9bca-4808-b936-7462292e7563] succeeded in 4.824517322999782s: None 2024-05-11T00:01:06.435289669Z [2024-05-11 00:01:06,434: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d63dd11-6353-40fb-9dcb-4d0d3084c772] succeeded in 5.179703676000827s: None 2024-05-11T00:02:00.321204868Z [2024-05-11 00:02:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02e89f58-e7cb-453e-98b2-8d51d65ab58c] received 2024-05-11T00:02:00.325592140Z [2024-05-11 00:02:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be5961de-2705-4db0-a43d-6c5d2affabef] received 2024-05-11T00:02:00.338044921Z [2024-05-11 00:02:00,334: INFO/ForkPoolWorker-15] [02e89f58-e7cb-453e-98b2-8d51d65ab58c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:02:00.338070074Z [2024-05-11 00:02:00,337: INFO/ForkPoolWorker-16] [be5961de-2705-4db0-a43d-6c5d2affabef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:02:00.348468961Z [2024-05-11 00:02:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[111d7928-5a43-416d-a47b-5dd68dbafc43] received 2024-05-11T00:02:00.356999888Z [2024-05-11 00:02:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62b8c174-8d40-42c3-90cc-019fe6d18cf1] received 2024-05-11T00:02:00.369985805Z [2024-05-11 00:02:00,369: INFO/ForkPoolWorker-1] [111d7928-5a43-416d-a47b-5dd68dbafc43] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:02:00.373160867Z [2024-05-11 00:02:00,372: INFO/ForkPoolWorker-2] [62b8c174-8d40-42c3-90cc-019fe6d18cf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:02:00.647620993Z [2024-05-11 00:02:00,644: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:02:00.658210559Z [2024-05-11 00:02:00,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:02:00.694920180Z [2024-05-11 00:02:00,691: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:02:00.711732935Z [2024-05-11 00:02:00,708: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:02:00.817899036Z [2024-05-11 00:02:00,817: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:02:00.822025316Z [2024-05-11 00:02:00,821: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:02:00.855228630Z [2024-05-11 00:02:00,853: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:02:00.857605605Z [2024-05-11 00:02:00,857: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:02:00.858197841Z [2024-05-11 00:02:00,857: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:02:00.860074835Z [2024-05-11 00:02:00,859: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:02:00.860409649Z [2024-05-11 00:02:00,860: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:02:01.010488483Z [2024-05-11 00:02:01,010: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:02:01.258205837Z [2024-05-11 00:02:01,254: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:02:01.707668693Z [2024-05-11 00:02:01,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[111d7928-5a43-416d-a47b-5dd68dbafc43] succeeded in 1.3560390009997718s: None 2024-05-11T00:02:01.942337859Z [2024-05-11 00:02:01,941: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62b8c174-8d40-42c3-90cc-019fe6d18cf1] succeeded in 1.5835320420001153s: None 2024-05-11T00:02:02.199341576Z [2024-05-11 00:02:02,198: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:02:02.202819405Z [2024-05-11 00:02:02,202: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:02:02.212621529Z [2024-05-11 00:02:02,212: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:02:02.216329023Z [2024-05-11 00:02:02,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:02:02.221459102Z [2024-05-11 00:02:02,221: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:02:02.224106746Z [2024-05-11 00:02:02,223: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:02:02.224311238Z [2024-05-11 00:02:02,224: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:02:02.224526329Z [2024-05-11 00:02:02,224: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:02:02.224610166Z [2024-05-11 00:02:02,224: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:02:02.225192580Z [2024-05-11 00:02:02,225: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:02:02.225259153Z [2024-05-11 00:02:02,225: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:02:02.244001910Z [2024-05-11 00:02:02,243: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:02:02.245554019Z [2024-05-11 00:02:02,245: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:02:02.245580534Z [2024-05-11 00:02:02,245: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:02:02.245815157Z [2024-05-11 00:02:02,245: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:02:02.245897953Z [2024-05-11 00:02:02,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:02:02.246331555Z [2024-05-11 00:02:02,246: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:02:02.246349326Z [2024-05-11 00:02:02,246: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:02:02.304527223Z [2024-05-11 00:02:02,304: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:02:02.337752110Z [2024-05-11 00:02:02,337: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:02:03.806971008Z [2024-05-11 00:02:03,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02e89f58-e7cb-453e-98b2-8d51d65ab58c] succeeded in 3.4867653580004117s: None 2024-05-11T00:02:04.219953150Z [2024-05-11 00:02:04,219: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be5961de-2705-4db0-a43d-6c5d2affabef] succeeded in 3.894438354999693s: None 2024-05-11T00:03:00.603326573Z [2024-05-11 00:03:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8601ac2c-e52f-48ca-bac9-9055a2bbef91] received 2024-05-11T00:03:00.605964531Z [2024-05-11 00:03:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dc4c5de-881c-4ac6-beec-459e22cbf121] received 2024-05-11T00:03:00.608122565Z [2024-05-11 00:03:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efa4b79c-def8-4bf7-8f3a-d5c27aa48017] received 2024-05-11T00:03:00.622719784Z [2024-05-11 00:03:00,622: INFO/ForkPoolWorker-15] [8601ac2c-e52f-48ca-bac9-9055a2bbef91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:03:00.623145833Z [2024-05-11 00:03:00,622: INFO/ForkPoolWorker-16] [9dc4c5de-881c-4ac6-beec-459e22cbf121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:03:00.623380148Z [2024-05-11 00:03:00,622: INFO/ForkPoolWorker-1] [efa4b79c-def8-4bf7-8f3a-d5c27aa48017] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:03:00.932021793Z [2024-05-11 00:03:00,928: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:03:00.943354476Z [2024-05-11 00:03:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:03:00.981496072Z [2024-05-11 00:03:00,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:03:01.230681454Z [2024-05-11 00:03:01,230: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:03:01.235215257Z [2024-05-11 00:03:01,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:03:01.299623077Z [2024-05-11 00:03:01,299: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:03:01.301764569Z [2024-05-11 00:03:01,301: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:03:01.302332042Z [2024-05-11 00:03:01,301: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:03:01.302709002Z [2024-05-11 00:03:01,302: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:03:01.303305287Z [2024-05-11 00:03:01,303: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:03:01.404971134Z [2024-05-11 00:03:01,404: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:03:02.095732104Z [2024-05-11 00:03:02,095: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[efa4b79c-def8-4bf7-8f3a-d5c27aa48017] succeeded in 1.4851965449997806s: None 2024-05-11T00:03:02.558191635Z [2024-05-11 00:03:02,557: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:03:02.561685525Z [2024-05-11 00:03:02,561: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:03:02.587455975Z [2024-05-11 00:03:02,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:03:02.588754071Z [2024-05-11 00:03:02,588: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:03:02.588795498Z [2024-05-11 00:03:02,588: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:03:02.588935570Z [2024-05-11 00:03:02,588: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:03:02.588965948Z [2024-05-11 00:03:02,588: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:03:02.589206690Z [2024-05-11 00:03:02,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:03:02.589340974Z [2024-05-11 00:03:02,589: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:03:02.696708238Z [2024-05-11 00:03:02,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:03:02.699945323Z [2024-05-11 00:03:02,699: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:03:02.703581444Z [2024-05-11 00:03:02,703: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:03:02.725402334Z [2024-05-11 00:03:02,725: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:03:02.726993633Z [2024-05-11 00:03:02,726: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:03:02.727130275Z [2024-05-11 00:03:02,726: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:03:02.727322839Z [2024-05-11 00:03:02,727: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:03:02.727462982Z [2024-05-11 00:03:02,727: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:03:02.727801733Z [2024-05-11 00:03:02,727: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:03:02.727958421Z [2024-05-11 00:03:02,727: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:03:02.822462235Z [2024-05-11 00:03:02,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:03:04.273455260Z [2024-05-11 00:03:04,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8601ac2c-e52f-48ca-bac9-9055a2bbef91] succeeded in 3.667151776000537s: None 2024-05-11T00:03:04.966081529Z [2024-05-11 00:03:04,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dc4c5de-881c-4ac6-beec-459e22cbf121] succeeded in 4.357954045999577s: None 2024-05-11T00:04:00.271290825Z [2024-05-11 00:04:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4211da2-34d4-40de-93bd-01754142e90d] received 2024-05-11T00:04:00.273248441Z [2024-05-11 00:04:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac58e42a-ade9-44de-962c-6225a7cd11d9] received 2024-05-11T00:04:00.297313063Z [2024-05-11 00:04:00,293: INFO/ForkPoolWorker-16] [ac58e42a-ade9-44de-962c-6225a7cd11d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:04:00.307106081Z [2024-05-11 00:04:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03289c89-bebc-485f-93ab-3db5f7c3bb3b] received 2024-05-11T00:04:00.308027911Z [2024-05-11 00:04:00,307: INFO/ForkPoolWorker-15] [a4211da2-34d4-40de-93bd-01754142e90d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:04:00.318300888Z [2024-05-11 00:04:00,317: INFO/ForkPoolWorker-1] [03289c89-bebc-485f-93ab-3db5f7c3bb3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:04:00.331677655Z [2024-05-11 00:04:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6fc1911-038f-4402-ad94-147eb3e4b3ea] received 2024-05-11T00:04:00.346056419Z [2024-05-11 00:04:00,342: INFO/ForkPoolWorker-2] [c6fc1911-038f-4402-ad94-147eb3e4b3ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:04:00.671476624Z [2024-05-11 00:04:00,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:04:00.707959308Z [2024-05-11 00:04:00,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:04:00.729369385Z [2024-05-11 00:04:00,726: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:04:00.766672171Z [2024-05-11 00:04:00,763: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:04:00.921232266Z [2024-05-11 00:04:00,920: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:04:00.933143445Z [2024-05-11 00:04:00,932: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:04:00.936940677Z [2024-05-11 00:04:00,936: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:04:00.966007639Z [2024-05-11 00:04:00,965: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:04:00.967575478Z [2024-05-11 00:04:00,967: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:04:00.967812337Z [2024-05-11 00:04:00,967: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:04:00.967924987Z [2024-05-11 00:04:00,967: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:04:00.968133905Z [2024-05-11 00:04:00,968: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:04:01.120376593Z [2024-05-11 00:04:01,120: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:04:01.519557359Z [2024-05-11 00:04:01,519: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03289c89-bebc-485f-93ab-3db5f7c3bb3b] succeeded in 1.2110687499998676s: None 2024-05-11T00:04:01.719372042Z [2024-05-11 00:04:01,718: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c6fc1911-038f-4402-ad94-147eb3e4b3ea] succeeded in 1.3863719900000433s: None 2024-05-11T00:04:02.152621226Z [2024-05-11 00:04:02,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:04:02.156420648Z [2024-05-11 00:04:02,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:04:02.170066943Z [2024-05-11 00:04:02,169: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:04:02.173747891Z [2024-05-11 00:04:02,173: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:04:02.180962167Z [2024-05-11 00:04:02,180: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:04:02.183416065Z [2024-05-11 00:04:02,183: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:04:02.183555638Z [2024-05-11 00:04:02,183: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:04:02.183748853Z [2024-05-11 00:04:02,183: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:04:02.183868853Z [2024-05-11 00:04:02,183: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:04:02.184186201Z [2024-05-11 00:04:02,184: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:04:02.184308437Z [2024-05-11 00:04:02,184: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:04:02.198091430Z [2024-05-11 00:04:02,195: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:04:02.200194512Z [2024-05-11 00:04:02,199: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:04:02.200347714Z [2024-05-11 00:04:02,200: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:04:02.200614121Z [2024-05-11 00:04:02,200: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:04:02.200825638Z [2024-05-11 00:04:02,200: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:04:02.201936150Z [2024-05-11 00:04:02,201: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:04:02.202131823Z [2024-05-11 00:04:02,201: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:04:02.256927896Z [2024-05-11 00:04:02,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:04:02.303789560Z [2024-05-11 00:04:02,303: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:04:03.888323425Z [2024-05-11 00:04:03,887: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4211da2-34d4-40de-93bd-01754142e90d] succeeded in 3.6135467029998836s: None 2024-05-11T00:04:04.461241382Z [2024-05-11 00:04:04,460: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac58e42a-ade9-44de-962c-6225a7cd11d9] succeeded in 4.1803307390000555s: None 2024-05-11T00:05:01.151821317Z [2024-05-11 00:05:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75c3f760-580f-47b6-bc15-fceebefaaf03] received 2024-05-11T00:05:01.160272979Z [2024-05-11 00:05:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[882b4237-7ae1-44c5-8991-a96f14a72e66] received 2024-05-11T00:05:01.161931841Z [2024-05-11 00:05:01,161: INFO/ForkPoolWorker-15] [75c3f760-580f-47b6-bc15-fceebefaaf03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:01.167022380Z [2024-05-11 00:05:01,166: INFO/ForkPoolWorker-16] [882b4237-7ae1-44c5-8991-a96f14a72e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:05:01.171238149Z [2024-05-11 00:05:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db0e7515-9f87-4962-b14a-34cde01ac3bb] received 2024-05-11T00:05:01.178155902Z [2024-05-11 00:05:01,177: INFO/ForkPoolWorker-1] [db0e7515-9f87-4962-b14a-34cde01ac3bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:05:01.186437525Z [2024-05-11 00:05:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09105df1-fc84-40dd-8061-846b4cf45f4e] received 2024-05-11T00:05:01.202317645Z [2024-05-11 00:05:01,201: INFO/ForkPoolWorker-2] [09105df1-fc84-40dd-8061-846b4cf45f4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:05:01.479936269Z [2024-05-11 00:05:01,476: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:05:01.491712258Z [2024-05-11 00:05:01,488: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:05:01.548006929Z [2024-05-11 00:05:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:05:01.560588735Z [2024-05-11 00:05:01,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:05:01.728859382Z [2024-05-11 00:05:01,728: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:05:01.732608539Z [2024-05-11 00:05:01,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:01.759670945Z [2024-05-11 00:05:01,759: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:05:01.762520295Z [2024-05-11 00:05:01,762: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:05:01.762764349Z [2024-05-11 00:05:01,762: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:05:01.762990285Z [2024-05-11 00:05:01,762: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:05:01.763345057Z [2024-05-11 00:05:01,763: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:05:01.870138311Z [2024-05-11 00:05:01,869: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:02.417885734Z [2024-05-11 00:05:02,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[882b4237-7ae1-44c5-8991-a96f14a72e66] succeeded in 1.2554020830002628s: None 2024-05-11T00:05:02.739241781Z [2024-05-11 00:05:02,738: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:05:02.743350328Z [2024-05-11 00:05:02,742: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:02.779140557Z [2024-05-11 00:05:02,778: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:05:02.786804075Z [2024-05-11 00:05:02,786: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:02.786826635Z [2024-05-11 00:05:02,786: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:02.786863514Z [2024-05-11 00:05:02,786: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:02.786871398Z [2024-05-11 00:05:02,786: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:05:02.788880539Z [2024-05-11 00:05:02,788: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:05:02.788898174Z [2024-05-11 00:05:02,788: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:02.803386232Z [2024-05-11 00:05:02,802: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:05:02.806846754Z [2024-05-11 00:05:02,806: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:02.844573550Z [2024-05-11 00:05:02,844: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:05:02.845969531Z [2024-05-11 00:05:02,845: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:02.847699644Z [2024-05-11 00:05:02,845: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:02.848012455Z [2024-05-11 00:05:02,847: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:02.848129892Z [2024-05-11 00:05:02,847: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:05:02.848421553Z [2024-05-11 00:05:02,848: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:05:02.848510007Z [2024-05-11 00:05:02,848: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:02.877047845Z [2024-05-11 00:05:02,876: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:05:02.880660379Z [2024-05-11 00:05:02,880: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:02.883534955Z [2024-05-11 00:05:02,883: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:02.904675497Z [2024-05-11 00:05:02,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:05:02.906472001Z [2024-05-11 00:05:02,906: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:02.906611389Z [2024-05-11 00:05:02,906: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:02.906845004Z [2024-05-11 00:05:02,906: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:02.906989944Z [2024-05-11 00:05:02,906: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:05:02.907443946Z [2024-05-11 00:05:02,907: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:05:02.907593628Z [2024-05-11 00:05:02,907: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:02.962585590Z [2024-05-11 00:05:02,962: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:03.035887608Z [2024-05-11 00:05:03,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:03.703740151Z [2024-05-11 00:05:03,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75c3f760-580f-47b6-bc15-fceebefaaf03] succeeded in 2.5498574339999323s: None 2024-05-11T00:05:03.913045543Z [2024-05-11 00:05:03,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f0e1e6-6839-49fa-8f54-0900103c7b5f] received 2024-05-11T00:05:03.918885120Z [2024-05-11 00:05:03,918: INFO/ForkPoolWorker-15] [b1f0e1e6-6839-49fa-8f54-0900103c7b5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:04.197908540Z [2024-05-11 00:05:04,194: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:05:04.427039313Z [2024-05-11 00:05:04,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db0e7515-9f87-4962-b14a-34cde01ac3bb] succeeded in 3.2536303580000094s: None 2024-05-11T00:05:04.931028119Z [2024-05-11 00:05:04,930: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[09105df1-fc84-40dd-8061-846b4cf45f4e] succeeded in 3.736504884999704s: None 2024-05-11T00:05:05.376972929Z [2024-05-11 00:05:05,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:05:05.380408308Z [2024-05-11 00:05:05,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:05.400376286Z [2024-05-11 00:05:05,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:05:05.401608538Z [2024-05-11 00:05:05,401: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:05.401731615Z [2024-05-11 00:05:05,401: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:05.401985260Z [2024-05-11 00:05:05,401: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:05.402111765Z [2024-05-11 00:05:05,401: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:05:05.402436932Z [2024-05-11 00:05:05,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:05:05.402558940Z [2024-05-11 00:05:05,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:05.476443457Z [2024-05-11 00:05:05,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:06.112778336Z [2024-05-11 00:05:06,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1f0e1e6-6839-49fa-8f54-0900103c7b5f] succeeded in 2.1978780950003056s: None 2024-05-11T00:05:06.401605979Z [2024-05-11 00:05:06,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8853c805-0ba7-4eee-a85f-cde7e085ae1b] received 2024-05-11T00:05:06.415532979Z [2024-05-11 00:05:06,415: INFO/ForkPoolWorker-15] [8853c805-0ba7-4eee-a85f-cde7e085ae1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:05:06.738628947Z [2024-05-11 00:05:06,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:05:07.870157161Z [2024-05-11 00:05:07,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:05:07.873554272Z [2024-05-11 00:05:07,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:07.897709858Z [2024-05-11 00:05:07,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:05:07.899562566Z [2024-05-11 00:05:07,899: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:07.899649774Z [2024-05-11 00:05:07,899: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:07.899927601Z [2024-05-11 00:05:07,899: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:07.900051830Z [2024-05-11 00:05:07,899: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:05:07.900489493Z [2024-05-11 00:05:07,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:05:07.900626303Z [2024-05-11 00:05:07,900: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:07.986805421Z [2024-05-11 00:05:07,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:08.550082198Z [2024-05-11 00:05:08,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8853c805-0ba7-4eee-a85f-cde7e085ae1b] succeeded in 2.1454862079999657s: None 2024-05-11T00:05:08.902230595Z [2024-05-11 00:05:08,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c16602c-8f40-4186-a1a6-60481d779b64] received 2024-05-11T00:05:08.909675944Z [2024-05-11 00:05:08,909: INFO/ForkPoolWorker-15] [3c16602c-8f40-4186-a1a6-60481d779b64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:05:09.204148586Z [2024-05-11 00:05:09,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:05:10.434646570Z [2024-05-11 00:05:10,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:05:10.438273679Z [2024-05-11 00:05:10,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:05:10.458775957Z [2024-05-11 00:05:10,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:05:10.460460657Z [2024-05-11 00:05:10,459: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:05:10.460473688Z [2024-05-11 00:05:10,460: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:05:10.460478573Z [2024-05-11 00:05:10,460: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:05:10.460483442Z [2024-05-11 00:05:10,460: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:05:10.460754095Z [2024-05-11 00:05:10,460: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:05:10.461362718Z [2024-05-11 00:05:10,461: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:05:10.539531279Z [2024-05-11 00:05:10,539: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:05:11.237836584Z [2024-05-11 00:05:11,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c16602c-8f40-4186-a1a6-60481d779b64] succeeded in 2.3333178780003436s: None 2024-05-11T00:06:00.450847643Z [2024-05-11 00:06:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5add289a-4b19-48cf-ac9e-771881ca497a] received 2024-05-11T00:06:00.458359990Z [2024-05-11 00:06:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d2c7c9b-e0b4-4b7b-ba66-8681ee1a2900] received 2024-05-11T00:06:00.461371731Z [2024-05-11 00:06:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7100813-8067-4df2-a997-599df59e92ab] received 2024-05-11T00:06:00.462868223Z [2024-05-11 00:06:00,462: INFO/ForkPoolWorker-15] [5add289a-4b19-48cf-ac9e-771881ca497a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:06:00.466450746Z [2024-05-11 00:06:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5141c3a-1e39-4137-821b-eed69be8d113] received 2024-05-11T00:06:00.468335903Z [2024-05-11 00:06:00,468: INFO/ForkPoolWorker-16] [3d2c7c9b-e0b4-4b7b-ba66-8681ee1a2900] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:06:00.473605143Z [2024-05-11 00:06:00,473: INFO/ForkPoolWorker-1] [c7100813-8067-4df2-a997-599df59e92ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:06:00.479462116Z [2024-05-11 00:06:00,479: INFO/ForkPoolWorker-2] [d5141c3a-1e39-4137-821b-eed69be8d113] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:06:00.735559618Z [2024-05-11 00:06:00,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:06:00.749470730Z [2024-05-11 00:06:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:06:00.901023654Z [2024-05-11 00:06:00,897: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:06:00.953974287Z [2024-05-11 00:06:00,950: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:06:01.017998065Z [2024-05-11 00:06:01,017: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:06:01.142328809Z [2024-05-11 00:06:01,141: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:06:01.146430691Z [2024-05-11 00:06:01,145: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:06:01.227147480Z [2024-05-11 00:06:01,226: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:06:01.228659779Z [2024-05-11 00:06:01,228: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:06:01.228988293Z [2024-05-11 00:06:01,228: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:06:01.229143052Z [2024-05-11 00:06:01,228: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:06:01.229429937Z [2024-05-11 00:06:01,229: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:06:01.351999878Z [2024-05-11 00:06:01,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:06:01.612256905Z [2024-05-11 00:06:01,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5add289a-4b19-48cf-ac9e-771881ca497a] succeeded in 1.1591306929994971s: None 2024-05-11T00:06:01.938723141Z [2024-05-11 00:06:01,938: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5141c3a-1e39-4137-821b-eed69be8d113] succeeded in 1.4702947570003744s: None 2024-05-11T00:06:02.036423711Z [2024-05-11 00:06:02,036: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:06:02.039816664Z [2024-05-11 00:06:02,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:06:02.059496573Z [2024-05-11 00:06:02,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:06:02.060624268Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:06:02.060634771Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:06:02.060756086Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:06:02.060770861Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:06:02.060990193Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:06:02.061005638Z [2024-05-11 00:06:02,060: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:06:02.160025520Z [2024-05-11 00:06:02,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:06:02.295510122Z [2024-05-11 00:06:02,295: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:06:02.298841875Z [2024-05-11 00:06:02,298: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:06:02.322869261Z [2024-05-11 00:06:02,322: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:06:02.324378948Z [2024-05-11 00:06:02,324: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:06:02.324487967Z [2024-05-11 00:06:02,324: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:06:02.324661472Z [2024-05-11 00:06:02,324: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:06:02.324795678Z [2024-05-11 00:06:02,324: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:06:02.325146113Z [2024-05-11 00:06:02,324: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:06:02.325276180Z [2024-05-11 00:06:02,325: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:06:02.414626235Z [2024-05-11 00:06:02,414: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:06:04.142751739Z [2024-05-11 00:06:04,142: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7100813-8067-4df2-a997-599df59e92ab] succeeded in 3.6783825069996965s: None 2024-05-11T00:06:04.144218660Z [2024-05-11 00:06:04,143: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d2c7c9b-e0b4-4b7b-ba66-8681ee1a2900] succeeded in 3.6842894390001675s: None 2024-05-11T00:07:00.499366105Z [2024-05-11 00:07:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e231f820-12be-4a09-8e96-8b2cc8feb921] received 2024-05-11T00:07:00.503765839Z [2024-05-11 00:07:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[036b04c6-e21e-4522-ac9a-5ed0d8a4c495] received 2024-05-11T00:07:00.514101425Z [2024-05-11 00:07:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76ca2a60-9eb4-44bd-bce7-f933cc414eb8] received 2024-05-11T00:07:00.518681155Z [2024-05-11 00:07:00,518: INFO/ForkPoolWorker-15] [e231f820-12be-4a09-8e96-8b2cc8feb921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:07:00.519436224Z [2024-05-11 00:07:00,519: INFO/ForkPoolWorker-16] [036b04c6-e21e-4522-ac9a-5ed0d8a4c495] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:07:00.522074413Z [2024-05-11 00:07:00,521: INFO/ForkPoolWorker-1] [76ca2a60-9eb4-44bd-bce7-f933cc414eb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:07:00.827796587Z [2024-05-11 00:07:00,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:07:00.847348134Z [2024-05-11 00:07:00,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:07:00.897510976Z [2024-05-11 00:07:00,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:07:01.024697028Z [2024-05-11 00:07:01,024: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:07:01.041628501Z [2024-05-11 00:07:01,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:07:01.075598974Z [2024-05-11 00:07:01,065: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:07:01.075627885Z [2024-05-11 00:07:01,066: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:07:01.075632223Z [2024-05-11 00:07:01,066: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:07:01.075635963Z [2024-05-11 00:07:01,066: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:07:01.075639028Z [2024-05-11 00:07:01,067: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:07:01.295965557Z [2024-05-11 00:07:01,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:07:01.962919944Z [2024-05-11 00:07:01,962: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[036b04c6-e21e-4522-ac9a-5ed0d8a4c495] succeeded in 1.4562752890005868s: None 2024-05-11T00:07:02.129656486Z [2024-05-11 00:07:02,129: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:07:02.132778650Z [2024-05-11 00:07:02,132: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:07:02.160598971Z [2024-05-11 00:07:02,160: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:07:02.162184536Z [2024-05-11 00:07:02,161: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:07:02.162202554Z [2024-05-11 00:07:02,162: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:07:02.162354505Z [2024-05-11 00:07:02,162: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:07:02.162400596Z [2024-05-11 00:07:02,162: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:07:02.162645852Z [2024-05-11 00:07:02,162: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:07:02.162690572Z [2024-05-11 00:07:02,162: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:07:02.234826344Z [2024-05-11 00:07:02,234: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:07:02.415158019Z [2024-05-11 00:07:02,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:07:02.418509635Z [2024-05-11 00:07:02,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:07:02.441120241Z [2024-05-11 00:07:02,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:07:02.442340823Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:07:02.442354866Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:07:02.442487071Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:07:02.442533474Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:07:02.442734888Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:07:02.442771306Z [2024-05-11 00:07:02,442: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:07:02.561192127Z [2024-05-11 00:07:02,560: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:07:04.013273400Z [2024-05-11 00:07:04,012: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76ca2a60-9eb4-44bd-bce7-f933cc414eb8] succeeded in 3.497650197999974s: None 2024-05-11T00:07:05.099715365Z [2024-05-11 00:07:05,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e231f820-12be-4a09-8e96-8b2cc8feb921] succeeded in 4.594462964999366s: None 2024-05-11T00:08:00.609849987Z [2024-05-11 00:08:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3a70cdf-bb77-4e2f-8f96-915a7513dbd3] received 2024-05-11T00:08:00.612964274Z [2024-05-11 00:08:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa1d6d04-5a3f-43a6-b7c4-efd61788b8da] received 2024-05-11T00:08:00.619531540Z [2024-05-11 00:08:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04cea3ba-33a6-4390-a4c7-fee03599e899] received 2024-05-11T00:08:00.623654141Z [2024-05-11 00:08:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df67b4f3-50f6-40c1-b250-e62cd9146b85] received 2024-05-11T00:08:00.625737221Z [2024-05-11 00:08:00,625: INFO/ForkPoolWorker-15] [d3a70cdf-bb77-4e2f-8f96-915a7513dbd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:08:00.626462250Z [2024-05-11 00:08:00,626: INFO/ForkPoolWorker-16] [fa1d6d04-5a3f-43a6-b7c4-efd61788b8da] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:08:00.632261347Z [2024-05-11 00:08:00,632: INFO/ForkPoolWorker-2] [df67b4f3-50f6-40c1-b250-e62cd9146b85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:08:00.632921396Z [2024-05-11 00:08:00,632: INFO/ForkPoolWorker-1] [04cea3ba-33a6-4390-a4c7-fee03599e899] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:08:00.920511474Z [2024-05-11 00:08:00,916: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:08:00.955803589Z [2024-05-11 00:08:00,952: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:08:00.956544929Z [2024-05-11 00:08:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:08:00.987380809Z [2024-05-11 00:08:00,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:08:01.185397168Z [2024-05-11 00:08:01,184: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:08:01.198896396Z [2024-05-11 00:08:01,198: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:08:01.247535634Z [2024-05-11 00:08:01,247: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:08:01.250683542Z [2024-05-11 00:08:01,250: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:08:01.250856389Z [2024-05-11 00:08:01,250: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:08:01.250984297Z [2024-05-11 00:08:01,250: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:08:01.251227000Z [2024-05-11 00:08:01,251: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:08:01.348714230Z [2024-05-11 00:08:01,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:08:01.380112719Z [2024-05-11 00:08:01,379: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:08:01.977930961Z [2024-05-11 00:08:01,977: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa1d6d04-5a3f-43a6-b7c4-efd61788b8da] succeeded in 1.360060963000251s: None 2024-05-11T00:08:02.086110240Z [2024-05-11 00:08:02,085: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df67b4f3-50f6-40c1-b250-e62cd9146b85] succeeded in 1.460006391999741s: None 2024-05-11T00:08:02.310377619Z [2024-05-11 00:08:02,309: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:08:02.313759283Z [2024-05-11 00:08:02,313: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:08:02.338326671Z [2024-05-11 00:08:02,338: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:08:02.339831897Z [2024-05-11 00:08:02,339: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:08:02.339867465Z [2024-05-11 00:08:02,339: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:08:02.340046883Z [2024-05-11 00:08:02,339: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:08:02.340340452Z [2024-05-11 00:08:02,339: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:08:02.340585686Z [2024-05-11 00:08:02,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:08:02.340612036Z [2024-05-11 00:08:02,340: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:08:02.411624140Z [2024-05-11 00:08:02,411: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:08:02.415090160Z [2024-05-11 00:08:02,414: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:08:02.439401576Z [2024-05-11 00:08:02,439: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:08:02.440521541Z [2024-05-11 00:08:02,440: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:08:02.442021742Z [2024-05-11 00:08:02,441: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:08:02.442156682Z [2024-05-11 00:08:02,441: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:08:02.442361657Z [2024-05-11 00:08:02,442: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:08:02.442428500Z [2024-05-11 00:08:02,442: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:08:02.442778734Z [2024-05-11 00:08:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:08:02.443267220Z [2024-05-11 00:08:02,442: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:08:02.536684765Z [2024-05-11 00:08:02,536: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:08:03.981253474Z [2024-05-11 00:08:03,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3a70cdf-bb77-4e2f-8f96-915a7513dbd3] succeeded in 3.366192864000368s: None 2024-05-11T00:08:04.656303162Z [2024-05-11 00:08:04,655: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04cea3ba-33a6-4390-a4c7-fee03599e899] succeeded in 4.031608894999408s: None 2024-05-11T00:09:00.515122638Z [2024-05-11 00:09:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1461b163-fcd9-460c-84e5-f5760f1254b9] received 2024-05-11T00:09:00.519741572Z [2024-05-11 00:09:00,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f2b35ce-459c-446a-9f72-b62a1750339c] received 2024-05-11T00:09:00.522654669Z [2024-05-11 00:09:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fd67944-19e3-41c1-8bd4-f50c01f3de9f] received 2024-05-11T00:09:00.541357875Z [2024-05-11 00:09:00,538: INFO/ForkPoolWorker-1] [4fd67944-19e3-41c1-8bd4-f50c01f3de9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:09:00.541394088Z [2024-05-11 00:09:00,540: INFO/ForkPoolWorker-16] [1f2b35ce-459c-446a-9f72-b62a1750339c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:09:00.544893523Z [2024-05-11 00:09:00,544: INFO/ForkPoolWorker-15] [1461b163-fcd9-460c-84e5-f5760f1254b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:09:00.877940682Z [2024-05-11 00:09:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:09:00.899820915Z [2024-05-11 00:09:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:09:00.918496679Z [2024-05-11 00:09:00,915: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:09:01.149413768Z [2024-05-11 00:09:01,149: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:09:01.153099754Z [2024-05-11 00:09:01,152: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:09:01.212997780Z [2024-05-11 00:09:01,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:09:01.214312972Z [2024-05-11 00:09:01,214: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:09:01.214482742Z [2024-05-11 00:09:01,214: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:09:01.214604332Z [2024-05-11 00:09:01,214: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:09:01.214848271Z [2024-05-11 00:09:01,214: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:09:01.297669525Z [2024-05-11 00:09:01,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:09:01.975563141Z [2024-05-11 00:09:01,975: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4fd67944-19e3-41c1-8bd4-f50c01f3de9f] succeeded in 1.4509295620000557s: None 2024-05-11T00:09:02.181563383Z [2024-05-11 00:09:02,181: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:09:02.184982783Z [2024-05-11 00:09:02,184: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:09:02.209254989Z [2024-05-11 00:09:02,209: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:09:02.210962159Z [2024-05-11 00:09:02,210: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:09:02.211545647Z [2024-05-11 00:09:02,211: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:09:02.211768581Z [2024-05-11 00:09:02,211: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:09:02.211984855Z [2024-05-11 00:09:02,211: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:09:02.212338086Z [2024-05-11 00:09:02,212: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:09:02.212524741Z [2024-05-11 00:09:02,212: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:09:02.290848989Z [2024-05-11 00:09:02,290: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:09:02.295147268Z [2024-05-11 00:09:02,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:09:02.327578034Z [2024-05-11 00:09:02,327: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:09:02.337677217Z [2024-05-11 00:09:02,337: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:09:02.339933384Z [2024-05-11 00:09:02,339: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:09:02.340085972Z [2024-05-11 00:09:02,339: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:09:02.340269715Z [2024-05-11 00:09:02,340: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:09:02.340344040Z [2024-05-11 00:09:02,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:09:02.340636978Z [2024-05-11 00:09:02,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:09:02.340695644Z [2024-05-11 00:09:02,340: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:09:02.426470150Z [2024-05-11 00:09:02,426: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:09:03.894553171Z [2024-05-11 00:09:03,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1461b163-fcd9-460c-84e5-f5760f1254b9] succeeded in 3.369970413000374s: None 2024-05-11T00:09:04.148091485Z [2024-05-11 00:09:04,147: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f2b35ce-459c-446a-9f72-b62a1750339c] succeeded in 3.6207646599996224s: None 2024-05-11T00:10:01.323852197Z [2024-05-11 00:10:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[674e469b-ab67-4c8d-a5e7-90a3e3e1c0af] received 2024-05-11T00:10:01.329250340Z [2024-05-11 00:10:01,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e2cdd6f-e9bd-4a8f-86cb-36d8d89e1b24] received 2024-05-11T00:10:01.329769354Z [2024-05-11 00:10:01,329: INFO/ForkPoolWorker-15] [674e469b-ab67-4c8d-a5e7-90a3e3e1c0af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:10:01.333439876Z [2024-05-11 00:10:01,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9354ca51-7eca-4d69-9cac-9667fa28bd34] received 2024-05-11T00:10:01.338379984Z [2024-05-11 00:10:01,338: INFO/ForkPoolWorker-16] [3e2cdd6f-e9bd-4a8f-86cb-36d8d89e1b24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:10:01.339958398Z [2024-05-11 00:10:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e726d705-c4cb-4921-b77d-f15775c4d056] received 2024-05-11T00:10:01.341402088Z [2024-05-11 00:10:01,341: INFO/ForkPoolWorker-1] [9354ca51-7eca-4d69-9cac-9667fa28bd34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:10:01.347122734Z [2024-05-11 00:10:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0461c240-0184-4117-9893-59ac407940b1] received 2024-05-11T00:10:01.348835083Z [2024-05-11 00:10:01,348: INFO/ForkPoolWorker-2] [e726d705-c4cb-4921-b77d-f15775c4d056] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:01.362161951Z [2024-05-11 00:10:01,361: INFO/ForkPoolWorker-3] [0461c240-0184-4117-9893-59ac407940b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:10:01.687838245Z [2024-05-11 00:10:01,684: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:10:01.717222309Z [2024-05-11 00:10:01,713: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:10:01.791877425Z [2024-05-11 00:10:01,785: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:10:01.858643197Z [2024-05-11 00:10:01,858: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:10:01.863125577Z [2024-05-11 00:10:01,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:01.894812627Z [2024-05-11 00:10:01,894: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:10:01.897029928Z [2024-05-11 00:10:01,896: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:10:01.897168291Z [2024-05-11 00:10:01,896: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:10:01.897356756Z [2024-05-11 00:10:01,897: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:10:01.897785862Z [2024-05-11 00:10:01,897: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:10:01.983546639Z [2024-05-11 00:10:01,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:02.075004385Z [2024-05-11 00:10:02,074: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:02.099132791Z [2024-05-11 00:10:02,090: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:10:02.133538493Z [2024-05-11 00:10:02,123: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:10:02.682866813Z [2024-05-11 00:10:02,682: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0461c240-0184-4117-9893-59ac407940b1] succeeded in 1.3313747319998583s: None 2024-05-11T00:10:02.729450433Z [2024-05-11 00:10:02,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[674e469b-ab67-4c8d-a5e7-90a3e3e1c0af] succeeded in 1.4040797309999107s: None 2024-05-11T00:10:03.095226692Z [2024-05-11 00:10:03,094: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:10:03.098593123Z [2024-05-11 00:10:03,098: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:03.118926351Z [2024-05-11 00:10:03,118: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:10:03.123108028Z [2024-05-11 00:10:03,122: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:03.123214917Z [2024-05-11 00:10:03,123: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:03.123527955Z [2024-05-11 00:10:03,123: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:03.123711335Z [2024-05-11 00:10:03,123: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:10:03.124215654Z [2024-05-11 00:10:03,124: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:10:03.124458872Z [2024-05-11 00:10:03,124: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:03.247203771Z [2024-05-11 00:10:03,246: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:03.425887644Z [2024-05-11 00:10:03,425: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:10:03.429181771Z [2024-05-11 00:10:03,428: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:03.458935892Z [2024-05-11 00:10:03,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:10:03.460574608Z [2024-05-11 00:10:03,460: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:03.460596276Z [2024-05-11 00:10:03,460: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:03.460842942Z [2024-05-11 00:10:03,460: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:03.460978236Z [2024-05-11 00:10:03,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:10:03.461397516Z [2024-05-11 00:10:03,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:10:03.462065748Z [2024-05-11 00:10:03,461: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:03.559758475Z [2024-05-11 00:10:03,559: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:03.639499303Z [2024-05-11 00:10:03,639: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:10:03.642801459Z [2024-05-11 00:10:03,642: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:03.670728671Z [2024-05-11 00:10:03,670: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:10:03.672015126Z [2024-05-11 00:10:03,671: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:03.672188296Z [2024-05-11 00:10:03,671: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:03.672511683Z [2024-05-11 00:10:03,672: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:03.672691676Z [2024-05-11 00:10:03,672: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:10:03.673089054Z [2024-05-11 00:10:03,672: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:10:03.673285422Z [2024-05-11 00:10:03,673: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:03.760380353Z [2024-05-11 00:10:03,760: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:03.909496109Z [2024-05-11 00:10:03,909: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e726d705-c4cb-4921-b77d-f15775c4d056] succeeded in 2.567502171000342s: None 2024-05-11T00:10:03.942146673Z [2024-05-11 00:10:03,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed0c360f-b152-4fb8-9853-9ed18a76d69c] received 2024-05-11T00:10:03.951622138Z [2024-05-11 00:10:03,951: INFO/ForkPoolWorker-15] [ed0c360f-b152-4fb8-9853-9ed18a76d69c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:04.305392342Z [2024-05-11 00:10:04,302: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:10:05.387211794Z [2024-05-11 00:10:05,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9354ca51-7eca-4d69-9cac-9667fa28bd34] succeeded in 4.051926637999713s: None 2024-05-11T00:10:05.509892749Z [2024-05-11 00:10:05,509: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:10:05.513593521Z [2024-05-11 00:10:05,513: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:05.536169277Z [2024-05-11 00:10:05,535: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:10:05.537698227Z [2024-05-11 00:10:05,537: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:05.537936189Z [2024-05-11 00:10:05,537: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:05.538189518Z [2024-05-11 00:10:05,538: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:05.538370513Z [2024-05-11 00:10:05,538: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:10:05.538847951Z [2024-05-11 00:10:05,538: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:10:05.539029628Z [2024-05-11 00:10:05,538: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:05.615365096Z [2024-05-11 00:10:05,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:05.771199899Z [2024-05-11 00:10:05,770: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e2cdd6f-e9bd-4a8f-86cb-36d8d89e1b24] succeeded in 4.439370700999461s: None 2024-05-11T00:10:06.261221482Z [2024-05-11 00:10:06,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed0c360f-b152-4fb8-9853-9ed18a76d69c] succeeded in 2.3171494770003846s: None 2024-05-11T00:10:06.452818320Z [2024-05-11 00:10:06,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b169ff1-049f-4c17-9a16-05d038554651] received 2024-05-11T00:10:06.463555620Z [2024-05-11 00:10:06,463: INFO/ForkPoolWorker-15] [9b169ff1-049f-4c17-9a16-05d038554651] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:10:06.737997986Z [2024-05-11 00:10:06,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:10:07.824065414Z [2024-05-11 00:10:07,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:10:07.827355156Z [2024-05-11 00:10:07,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:07.847307029Z [2024-05-11 00:10:07,847: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:10:07.848693545Z [2024-05-11 00:10:07,848: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:07.848710546Z [2024-05-11 00:10:07,848: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:07.848936884Z [2024-05-11 00:10:07,848: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:07.848963965Z [2024-05-11 00:10:07,848: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:10:07.849343375Z [2024-05-11 00:10:07,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:10:07.849360817Z [2024-05-11 00:10:07,849: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:07.967366726Z [2024-05-11 00:10:07,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:08.706961367Z [2024-05-11 00:10:08,706: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b169ff1-049f-4c17-9a16-05d038554651] succeeded in 2.250840576999508s: None 2024-05-11T00:10:09.259268499Z [2024-05-11 00:10:09,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18e6adeb-ab3b-4393-be30-e4c7e8e42b2b] received 2024-05-11T00:10:09.272415744Z [2024-05-11 00:10:09,271: INFO/ForkPoolWorker-15] [18e6adeb-ab3b-4393-be30-e4c7e8e42b2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:10:09.568832197Z [2024-05-11 00:10:09,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:10:10.649098109Z [2024-05-11 00:10:10,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:10:10.652217362Z [2024-05-11 00:10:10,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:10:10.680139241Z [2024-05-11 00:10:10,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:10:10.681816866Z [2024-05-11 00:10:10,681: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:10:10.681940306Z [2024-05-11 00:10:10,681: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:10:10.682748742Z [2024-05-11 00:10:10,681: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:10:10.682836084Z [2024-05-11 00:10:10,682: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:10:10.683724922Z [2024-05-11 00:10:10,683: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:10:10.683742910Z [2024-05-11 00:10:10,683: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:10:10.775278060Z [2024-05-11 00:10:10,774: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:10:11.518700711Z [2024-05-11 00:10:11,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18e6adeb-ab3b-4393-be30-e4c7e8e42b2b] succeeded in 2.255719875000068s: None 2024-05-11T00:11:01.192318690Z [2024-05-11 00:11:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdd582df-2149-42b1-be1f-baf500ad9269] received 2024-05-11T00:11:01.194542358Z [2024-05-11 00:11:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c71e8e19-2021-408c-8ab5-c010faa61c7a] received 2024-05-11T00:11:01.204364629Z [2024-05-11 00:11:01,203: INFO/ForkPoolWorker-15] [fdd582df-2149-42b1-be1f-baf500ad9269] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:11:01.205291149Z [2024-05-11 00:11:01,205: INFO/ForkPoolWorker-16] [c71e8e19-2021-408c-8ab5-c010faa61c7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:11:01.216497082Z [2024-05-11 00:11:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e195e3d-c299-4494-a3ef-ef78793b6126] received 2024-05-11T00:11:01.226403609Z [2024-05-11 00:11:01,226: INFO/ForkPoolWorker-1] [4e195e3d-c299-4494-a3ef-ef78793b6126] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:11:01.507924341Z [2024-05-11 00:11:01,504: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:11:01.511614829Z [2024-05-11 00:11:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:11:01.512736908Z [2024-05-11 00:11:01,508: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:11:01.678921677Z [2024-05-11 00:11:01,678: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:11:01.683081353Z [2024-05-11 00:11:01,682: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:11:01.713686078Z [2024-05-11 00:11:01,713: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:11:01.715071470Z [2024-05-11 00:11:01,714: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:11:01.715246198Z [2024-05-11 00:11:01,714: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:11:01.715340687Z [2024-05-11 00:11:01,715: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:11:01.715629449Z [2024-05-11 00:11:01,715: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:11:01.807339932Z [2024-05-11 00:11:01,806: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:11:02.432434122Z [2024-05-11 00:11:02,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e195e3d-c299-4494-a3ef-ef78793b6126] succeeded in 1.2140830669995921s: None 2024-05-11T00:11:02.669101277Z [2024-05-11 00:11:02,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:11:02.671583092Z [2024-05-11 00:11:02,671: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:11:02.698585622Z [2024-05-11 00:11:02,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:11:02.701112453Z [2024-05-11 00:11:02,700: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:11:02.701170872Z [2024-05-11 00:11:02,700: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:11:02.701508517Z [2024-05-11 00:11:02,701: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:11:02.701642476Z [2024-05-11 00:11:02,701: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:11:02.702087596Z [2024-05-11 00:11:02,701: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:11:02.702148841Z [2024-05-11 00:11:02,702: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:11:02.772693135Z [2024-05-11 00:11:02,772: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:11:02.776161689Z [2024-05-11 00:11:02,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:11:02.794719878Z [2024-05-11 00:11:02,794: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:11:02.800402689Z [2024-05-11 00:11:02,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:11:02.801768207Z [2024-05-11 00:11:02,801: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:11:02.801788800Z [2024-05-11 00:11:02,801: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:11:02.802022574Z [2024-05-11 00:11:02,801: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:11:02.802039431Z [2024-05-11 00:11:02,801: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:11:02.802281176Z [2024-05-11 00:11:02,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:11:02.802292996Z [2024-05-11 00:11:02,802: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:11:02.906287958Z [2024-05-11 00:11:02,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:11:04.969725646Z [2024-05-11 00:11:04,969: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdd582df-2149-42b1-be1f-baf500ad9269] succeeded in 3.7741307579999557s: None 2024-05-11T00:11:05.300572687Z [2024-05-11 00:11:05,299: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c71e8e19-2021-408c-8ab5-c010faa61c7a] succeeded in 4.102705254999819s: None 2024-05-11T00:12:01.212285423Z [2024-05-11 00:12:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dc8ed35-124a-4300-bf78-e33b7585d64b] received 2024-05-11T00:12:01.216030451Z [2024-05-11 00:12:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f546321-03a8-4a9a-b624-1fe1db4df618] received 2024-05-11T00:12:01.223041217Z [2024-05-11 00:12:01,222: INFO/ForkPoolWorker-15] [7dc8ed35-124a-4300-bf78-e33b7585d64b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:12:01.225952666Z [2024-05-11 00:12:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99c6f845-15ef-45d3-a0ee-46a15914bcbe] received 2024-05-11T00:12:01.228049705Z [2024-05-11 00:12:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7cfb610-9887-4b8f-bb4a-e351411565b3] received 2024-05-11T00:12:01.232016592Z [2024-05-11 00:12:01,230: INFO/ForkPoolWorker-16] [0f546321-03a8-4a9a-b624-1fe1db4df618] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:12:01.232977831Z [2024-05-11 00:12:01,232: INFO/ForkPoolWorker-1] [99c6f845-15ef-45d3-a0ee-46a15914bcbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:12:01.247940706Z [2024-05-11 00:12:01,247: INFO/ForkPoolWorker-2] [b7cfb610-9887-4b8f-bb4a-e351411565b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:12:01.515436613Z [2024-05-11 00:12:01,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:12:01.541106983Z [2024-05-11 00:12:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:12:01.603714025Z [2024-05-11 00:12:01,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:12:01.615406211Z [2024-05-11 00:12:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:12:01.854053763Z [2024-05-11 00:12:01,853: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:12:01.858346789Z [2024-05-11 00:12:01,857: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:12:01.864500764Z [2024-05-11 00:12:01,864: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:12:01.887190230Z [2024-05-11 00:12:01,886: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:12:01.888637552Z [2024-05-11 00:12:01,888: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:12:01.888763858Z [2024-05-11 00:12:01,888: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:12:01.888828011Z [2024-05-11 00:12:01,888: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:12:01.889053329Z [2024-05-11 00:12:01,888: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:12:01.992535268Z [2024-05-11 00:12:01,992: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:12:02.449852792Z [2024-05-11 00:12:02,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dc8ed35-124a-4300-bf78-e33b7585d64b] succeeded in 1.235414005000166s: None 2024-05-11T00:12:02.621301591Z [2024-05-11 00:12:02,620: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7cfb610-9887-4b8f-bb4a-e351411565b3] succeeded in 1.3914542599995912s: None 2024-05-11T00:12:02.892530472Z [2024-05-11 00:12:02,892: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:12:02.894126739Z [2024-05-11 00:12:02,893: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:12:02.896062049Z [2024-05-11 00:12:02,895: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:12:02.897266702Z [2024-05-11 00:12:02,896: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:12:02.914319933Z [2024-05-11 00:12:02,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:12:02.914333808Z [2024-05-11 00:12:02,914: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:12:02.915488244Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:12:02.915521489Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:12:02.915629079Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:12:02.915635370Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:12:02.915687004Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:12:02.915692798Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:12:02.915939781Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:12:02.915949761Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:12:02.916286450Z [2024-05-11 00:12:02,915: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:12:02.916394991Z [2024-05-11 00:12:02,916: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:12:02.916734537Z [2024-05-11 00:12:02,916: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:12:02.916798867Z [2024-05-11 00:12:02,916: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:12:02.997550185Z [2024-05-11 00:12:02,997: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:12:03.010297539Z [2024-05-11 00:12:03,009: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:12:04.722864199Z [2024-05-11 00:12:04,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99c6f845-15ef-45d3-a0ee-46a15914bcbe] succeeded in 3.495473506000053s: None 2024-05-11T00:12:05.489846186Z [2024-05-11 00:12:05,489: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f546321-03a8-4a9a-b624-1fe1db4df618] succeeded in 4.268955231999826s: None 2024-05-11T00:13:01.061979156Z [2024-05-11 00:13:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c7963d1-7b39-4a40-ac78-9c338309752d] received 2024-05-11T00:13:01.066439215Z [2024-05-11 00:13:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e748032-a2ae-4907-9080-ebedd628e72f] received 2024-05-11T00:13:01.074138933Z [2024-05-11 00:13:01,072: INFO/ForkPoolWorker-15] [8c7963d1-7b39-4a40-ac78-9c338309752d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:13:01.077559332Z [2024-05-11 00:13:01,075: INFO/ForkPoolWorker-16] [7e748032-a2ae-4907-9080-ebedd628e72f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:13:01.077573102Z [2024-05-11 00:13:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d6afa3c-ce8d-4332-a284-4dd65439ca21] received 2024-05-11T00:13:01.086540217Z [2024-05-11 00:13:01,083: INFO/ForkPoolWorker-1] [4d6afa3c-ce8d-4332-a284-4dd65439ca21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:13:01.378839424Z [2024-05-11 00:13:01,375: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:13:01.463733659Z [2024-05-11 00:13:01,460: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:13:01.520126674Z [2024-05-11 00:13:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:13:01.636138726Z [2024-05-11 00:13:01,635: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:13:01.640498694Z [2024-05-11 00:13:01,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:13:01.668304933Z [2024-05-11 00:13:01,668: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:13:01.670417064Z [2024-05-11 00:13:01,670: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:13:01.670727260Z [2024-05-11 00:13:01,670: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:13:01.670940297Z [2024-05-11 00:13:01,670: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:13:01.671277270Z [2024-05-11 00:13:01,671: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:13:01.797252260Z [2024-05-11 00:13:01,796: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:13:02.395032243Z [2024-05-11 00:13:02,394: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d6afa3c-ce8d-4332-a284-4dd65439ca21] succeeded in 1.316094613000132s: None 2024-05-11T00:13:02.510604599Z [2024-05-11 00:13:02,510: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:13:02.514092897Z [2024-05-11 00:13:02,513: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:13:02.543851617Z [2024-05-11 00:13:02,543: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:13:02.546107871Z [2024-05-11 00:13:02,545: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:13:02.546141418Z [2024-05-11 00:13:02,546: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:13:02.546271449Z [2024-05-11 00:13:02,546: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:13:02.546307332Z [2024-05-11 00:13:02,546: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:13:02.546591500Z [2024-05-11 00:13:02,546: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:13:02.546600241Z [2024-05-11 00:13:02,546: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:13:02.643561027Z [2024-05-11 00:13:02,643: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:13:02.686592236Z [2024-05-11 00:13:02,686: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:13:02.690060109Z [2024-05-11 00:13:02,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:13:02.716960639Z [2024-05-11 00:13:02,716: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:13:02.718430951Z [2024-05-11 00:13:02,718: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:13:02.718598649Z [2024-05-11 00:13:02,718: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:13:02.718826948Z [2024-05-11 00:13:02,718: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:13:02.718986657Z [2024-05-11 00:13:02,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:13:02.719309525Z [2024-05-11 00:13:02,719: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:13:02.719456613Z [2024-05-11 00:13:02,719: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:13:02.798286895Z [2024-05-11 00:13:02,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:13:04.673957666Z [2024-05-11 00:13:04,671: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e748032-a2ae-4907-9080-ebedd628e72f] succeeded in 3.604855567999948s: None 2024-05-11T00:13:05.121051546Z [2024-05-11 00:13:05,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c7963d1-7b39-4a40-ac78-9c338309752d] succeeded in 4.054241327999989s: None 2024-05-11T00:14:00.888342107Z [2024-05-11 00:14:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04a049f9-9a04-4eb7-8a6a-49f6b15f8239] received 2024-05-11T00:14:00.890397907Z [2024-05-11 00:14:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6481b351-62ab-4d7c-8954-9a73a20173a1] received 2024-05-11T00:14:00.897852272Z [2024-05-11 00:14:00,897: INFO/ForkPoolWorker-15] [04a049f9-9a04-4eb7-8a6a-49f6b15f8239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:14:00.900149719Z [2024-05-11 00:14:00,899: INFO/ForkPoolWorker-16] [6481b351-62ab-4d7c-8954-9a73a20173a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:14:00.908876058Z [2024-05-11 00:14:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[023bdee8-0592-4962-83fd-acec8b2703ce] received 2024-05-11T00:14:00.913218508Z [2024-05-11 00:14:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42fcba1c-15a0-4f54-b1ee-d016920a10d7] received 2024-05-11T00:14:00.915586352Z [2024-05-11 00:14:00,915: INFO/ForkPoolWorker-1] [023bdee8-0592-4962-83fd-acec8b2703ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:14:00.922874065Z [2024-05-11 00:14:00,922: INFO/ForkPoolWorker-2] [42fcba1c-15a0-4f54-b1ee-d016920a10d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:14:01.298270841Z [2024-05-11 00:14:01,295: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:14:01.321426546Z [2024-05-11 00:14:01,317: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:14:01.373870951Z [2024-05-11 00:14:01,370: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:14:01.434363577Z [2024-05-11 00:14:01,431: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:14:01.468577816Z [2024-05-11 00:14:01,468: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:14:01.472414153Z [2024-05-11 00:14:01,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:14:01.516428894Z [2024-05-11 00:14:01,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:14:01.517393630Z [2024-05-11 00:14:01,517: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:14:01.517552484Z [2024-05-11 00:14:01,517: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:14:01.517650920Z [2024-05-11 00:14:01,517: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:14:01.517927357Z [2024-05-11 00:14:01,517: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:14:01.655034322Z [2024-05-11 00:14:01,654: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:14:01.737063164Z [2024-05-11 00:14:01,735: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:14:02.339483596Z [2024-05-11 00:14:02,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6481b351-62ab-4d7c-8954-9a73a20173a1] succeeded in 1.447792556999957s: None 2024-05-11T00:14:02.398938879Z [2024-05-11 00:14:02,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[023bdee8-0592-4962-83fd-acec8b2703ce] succeeded in 1.4885591709999062s: None 2024-05-11T00:14:02.718246406Z [2024-05-11 00:14:02,717: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:14:02.723079002Z [2024-05-11 00:14:02,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:14:02.742664083Z [2024-05-11 00:14:02,742: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:14:02.743821243Z [2024-05-11 00:14:02,743: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:14:02.743835897Z [2024-05-11 00:14:02,743: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:14:02.743977797Z [2024-05-11 00:14:02,743: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:14:02.743997116Z [2024-05-11 00:14:02,743: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:14:02.744464149Z [2024-05-11 00:14:02,744: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:14:02.744482000Z [2024-05-11 00:14:02,744: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:14:02.826024692Z [2024-05-11 00:14:02,825: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:14:02.854097349Z [2024-05-11 00:14:02,853: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:14:02.857536002Z [2024-05-11 00:14:02,857: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:14:02.874382416Z [2024-05-11 00:14:02,874: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:14:02.887467519Z [2024-05-11 00:14:02,887: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:14:02.887602244Z [2024-05-11 00:14:02,887: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:14:02.887806937Z [2024-05-11 00:14:02,887: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:14:02.887944721Z [2024-05-11 00:14:02,887: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:14:02.888382565Z [2024-05-11 00:14:02,888: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:14:02.888881821Z [2024-05-11 00:14:02,888: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:14:02.972358499Z [2024-05-11 00:14:02,972: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:14:04.685766774Z [2024-05-11 00:14:04,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04a049f9-9a04-4eb7-8a6a-49f6b15f8239] succeeded in 3.794132690999504s: None 2024-05-11T00:14:05.551340394Z [2024-05-11 00:14:05,550: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[42fcba1c-15a0-4f54-b1ee-d016920a10d7] succeeded in 4.635461941999893s: None 2024-05-11T00:15:00.926508311Z [2024-05-11 00:15:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11fc0261-84a2-4dd2-b5b1-4068ac4608a6] received 2024-05-11T00:15:00.932656054Z [2024-05-11 00:15:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567a1c9d-b13b-4993-9af9-eb3a94ff88e4] received 2024-05-11T00:15:00.941930676Z [2024-05-11 00:15:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f22b4cbf-9246-41bf-8f1d-140664a39bb4] received 2024-05-11T00:15:00.946636100Z [2024-05-11 00:15:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63300e19-924c-42fd-9a00-4c172b87d366] received 2024-05-11T00:15:00.946811737Z [2024-05-11 00:15:00,946: INFO/ForkPoolWorker-15] [11fc0261-84a2-4dd2-b5b1-4068ac4608a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:00.950486952Z [2024-05-11 00:15:00,950: INFO/ForkPoolWorker-16] [567a1c9d-b13b-4993-9af9-eb3a94ff88e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:15:00.951382452Z [2024-05-11 00:15:00,951: INFO/ForkPoolWorker-1] [f22b4cbf-9246-41bf-8f1d-140664a39bb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:15:00.956805115Z [2024-05-11 00:15:00,956: INFO/ForkPoolWorker-2] [63300e19-924c-42fd-9a00-4c172b87d366] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:15:01.449127012Z [2024-05-11 00:15:01,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:15:01.518168285Z [2024-05-11 00:15:01,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:15:01.567782294Z [2024-05-11 00:15:01,561: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:15:01.600287222Z [2024-05-11 00:15:01,592: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:15:01.751383953Z [2024-05-11 00:15:01,750: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:15:01.756145652Z [2024-05-11 00:15:01,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:01.789781615Z [2024-05-11 00:15:01,789: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:15:01.791273420Z [2024-05-11 00:15:01,790: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:15:01.791395194Z [2024-05-11 00:15:01,791: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:15:01.791494276Z [2024-05-11 00:15:01,791: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:15:01.791691110Z [2024-05-11 00:15:01,791: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:15:01.903698977Z [2024-05-11 00:15:01,903: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:02.703230135Z [2024-05-11 00:15:02,702: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f22b4cbf-9246-41bf-8f1d-140664a39bb4] succeeded in 1.7588559810001243s: None 2024-05-11T00:15:02.819000127Z [2024-05-11 00:15:02,818: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:15:02.822592724Z [2024-05-11 00:15:02,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:02.846852351Z [2024-05-11 00:15:02,846: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:15:02.848081424Z [2024-05-11 00:15:02,847: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:02.848117055Z [2024-05-11 00:15:02,847: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:02.848158593Z [2024-05-11 00:15:02,848: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:02.848202080Z [2024-05-11 00:15:02,848: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:15:02.848502896Z [2024-05-11 00:15:02,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:15:02.848573592Z [2024-05-11 00:15:02,848: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:02.937029915Z [2024-05-11 00:15:02,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:02.985318261Z [2024-05-11 00:15:02,984: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:15:02.989104132Z [2024-05-11 00:15:02,988: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:03.017953101Z [2024-05-11 00:15:03,017: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:15:03.020061042Z [2024-05-11 00:15:03,019: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:03.020111222Z [2024-05-11 00:15:03,020: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:03.020295044Z [2024-05-11 00:15:03,020: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:03.020373421Z [2024-05-11 00:15:03,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:15:03.020709377Z [2024-05-11 00:15:03,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:15:03.021287331Z [2024-05-11 00:15:03,021: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:03.112636295Z [2024-05-11 00:15:03,112: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:15:03.116301437Z [2024-05-11 00:15:03,115: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:03.140967323Z [2024-05-11 00:15:03,140: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:15:03.142401739Z [2024-05-11 00:15:03,142: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:03.142588203Z [2024-05-11 00:15:03,142: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:03.142808656Z [2024-05-11 00:15:03,142: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:03.142943696Z [2024-05-11 00:15:03,142: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:15:03.143343323Z [2024-05-11 00:15:03,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:03.143395632Z [2024-05-11 00:15:03,143: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:15:03.143565915Z [2024-05-11 00:15:03,143: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:03.235969817Z [2024-05-11 00:15:03,235: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:03.901059130Z [2024-05-11 00:15:03,900: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11fc0261-84a2-4dd2-b5b1-4068ac4608a6] succeeded in 2.9697363340001175s: None 2024-05-11T00:15:04.792963906Z [2024-05-11 00:15:04,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48d90c25-dbf5-489e-8c2c-21e85d6aec0d] received 2024-05-11T00:15:04.803522120Z [2024-05-11 00:15:04,803: INFO/ForkPoolWorker-15] [48d90c25-dbf5-489e-8c2c-21e85d6aec0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:04.886118594Z [2024-05-11 00:15:04,885: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[567a1c9d-b13b-4993-9af9-eb3a94ff88e4] succeeded in 3.949083771000005s: None 2024-05-11T00:15:05.101647981Z [2024-05-11 00:15:05,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:15:05.495361490Z [2024-05-11 00:15:05,494: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[63300e19-924c-42fd-9a00-4c172b87d366] succeeded in 4.546144066000124s: None 2024-05-11T00:15:06.291421597Z [2024-05-11 00:15:06,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:15:06.294710792Z [2024-05-11 00:15:06,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:06.316832132Z [2024-05-11 00:15:06,316: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:15:06.320755911Z [2024-05-11 00:15:06,320: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:06.320985116Z [2024-05-11 00:15:06,320: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:06.321226925Z [2024-05-11 00:15:06,321: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:06.321388051Z [2024-05-11 00:15:06,321: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:15:06.321726092Z [2024-05-11 00:15:06,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:15:06.321913808Z [2024-05-11 00:15:06,321: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:06.405568384Z [2024-05-11 00:15:06,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:07.157508498Z [2024-05-11 00:15:07,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48d90c25-dbf5-489e-8c2c-21e85d6aec0d] succeeded in 2.3631846309999673s: None 2024-05-11T00:15:07.447810219Z [2024-05-11 00:15:07,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[824b89b8-ede8-444d-a8ad-c8d0179b389b] received 2024-05-11T00:15:07.470968007Z [2024-05-11 00:15:07,470: INFO/ForkPoolWorker-15] [824b89b8-ede8-444d-a8ad-c8d0179b389b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:15:07.810016221Z [2024-05-11 00:15:07,805: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:15:09.107640885Z [2024-05-11 00:15:09,107: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:15:09.111794736Z [2024-05-11 00:15:09,111: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:09.138471136Z [2024-05-11 00:15:09,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:15:09.140495925Z [2024-05-11 00:15:09,140: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:09.140731919Z [2024-05-11 00:15:09,140: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:09.141059603Z [2024-05-11 00:15:09,140: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:09.141312349Z [2024-05-11 00:15:09,141: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:15:09.141851171Z [2024-05-11 00:15:09,141: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:15:09.142150215Z [2024-05-11 00:15:09,141: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:09.223563980Z [2024-05-11 00:15:09,223: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:09.777768787Z [2024-05-11 00:15:09,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[824b89b8-ede8-444d-a8ad-c8d0179b389b] succeeded in 2.3277623009998933s: None 2024-05-11T00:15:09.968877829Z [2024-05-11 00:15:09,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83bb94e1-f842-4ec7-a074-db7899bc921e] received 2024-05-11T00:15:09.981920016Z [2024-05-11 00:15:09,981: INFO/ForkPoolWorker-15] [83bb94e1-f842-4ec7-a074-db7899bc921e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:15:10.286458547Z [2024-05-11 00:15:10,282: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:15:11.463035171Z [2024-05-11 00:15:11,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:15:11.466371372Z [2024-05-11 00:15:11,465: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:11.490837607Z [2024-05-11 00:15:11,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:15:11.492548662Z [2024-05-11 00:15:11,492: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:15:11.492735985Z [2024-05-11 00:15:11,492: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:15:11.492749586Z [2024-05-11 00:15:11,492: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:15:11.492867421Z [2024-05-11 00:15:11,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:15:11.493188864Z [2024-05-11 00:15:11,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:15:11.493322154Z [2024-05-11 00:15:11,493: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:15:11.586590892Z [2024-05-11 00:15:11,586: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:12.261990963Z [2024-05-11 00:15:12,261: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83bb94e1-f842-4ec7-a074-db7899bc921e] succeeded in 2.2901917899998807s: None 2024-05-11T00:15:18.809255308Z [2024-05-11 00:15:18,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07e653f9-035a-4fbe-8e24-92bd0a7367a2] received 2024-05-11T00:15:18.819742928Z [2024-05-11 00:15:18,819: INFO/ForkPoolWorker-15] [07e653f9-035a-4fbe-8e24-92bd0a7367a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:15:19.129588713Z [2024-05-11 00:15:19,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:15:19.289726137Z [2024-05-11 00:15:19,288: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:15:19.292685308Z [2024-05-11 00:15:19,292: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:15:19.312076057Z [2024-05-11 00:15:19,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:15:19.313092065Z [2024-05-11 00:15:19,312: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:15:19.313240238Z [2024-05-11 00:15:19,313: INFO/ForkPoolWorker-15] Read SDNC a4a61494-3428-45e0-ad8f-14d08e0ee488 (epa_03) 2024-05-11T00:15:19.313501980Z [2024-05-11 00:15:19,313: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'a4a61494-3428-45e0-ad8f-14d08e0ee488', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-11T00:15:19.313725925Z [2024-05-11 00:15:19,313: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:15:19.314100775Z [2024-05-11 00:15:19,313: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:15:19.321854563Z [2024-05-11 00:15:19,321: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 2024-05-11T00:15:19.403744663Z [2024-05-11 00:15:19,403: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:15:19.975097214Z [2024-05-11 00:15:19,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07e653f9-035a-4fbe-8e24-92bd0a7367a2] succeeded in 1.1621760839998387s: None 2024-05-11T00:16:00.949664603Z [2024-05-11 00:16:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445346fe-5616-43eb-aec0-884ba8e064c6] received 2024-05-11T00:16:00.952204123Z [2024-05-11 00:16:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f787b67-9e42-4cb1-8842-e65376258fff] received 2024-05-11T00:16:00.954072045Z [2024-05-11 00:16:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e7d0c5e-4897-492a-97fc-f2395c3824fc] received 2024-05-11T00:16:00.957547759Z [2024-05-11 00:16:00,957: INFO/ForkPoolWorker-15] [445346fe-5616-43eb-aec0-884ba8e064c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:16:00.959588950Z [2024-05-11 00:16:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a31b6b61-b286-4506-a377-4ebb491ddbdb] received 2024-05-11T00:16:00.963444861Z [2024-05-11 00:16:00,962: INFO/ForkPoolWorker-16] [3f787b67-9e42-4cb1-8842-e65376258fff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:16:00.964314864Z [2024-05-11 00:16:00,964: INFO/ForkPoolWorker-1] [7e7d0c5e-4897-492a-97fc-f2395c3824fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:16:00.968925571Z [2024-05-11 00:16:00,968: INFO/ForkPoolWorker-2] [a31b6b61-b286-4506-a377-4ebb491ddbdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:16:00.979451834Z [2024-05-11 00:16:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b51cb69-1ed3-4fa3-bca1-091050da1a9f] received 2024-05-11T00:16:01.013119019Z [2024-05-11 00:16:01,012: INFO/ForkPoolWorker-3] [0b51cb69-1ed3-4fa3-bca1-091050da1a9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:16:01.445648199Z [2024-05-11 00:16:01,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:16:01.560593784Z [2024-05-11 00:16:01,557: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:16:01.573944024Z [2024-05-11 00:16:01,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:16:01.656384907Z [2024-05-11 00:16:01,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:16:01.861941228Z [2024-05-11 00:16:01,861: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:16:01.865901159Z [2024-05-11 00:16:01,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:16:01.896731752Z [2024-05-11 00:16:01,896: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:16:01.902851669Z [2024-05-11 00:16:01,902: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:16:01.902886036Z [2024-05-11 00:16:01,902: INFO/ForkPoolWorker-16] Read SDNC a4a61494-3428-45e0-ad8f-14d08e0ee488 (epa_03) 2024-05-11T00:16:01.903009898Z [2024-05-11 00:16:01,902: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'a4a61494-3428-45e0-ad8f-14d08e0ee488', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-11T00:16:01.903089177Z [2024-05-11 00:16:01,902: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:16:01.903531928Z [2024-05-11 00:16:01,903: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:16:01.911510361Z [2024-05-11 00:16:01,911: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 2024-05-11T00:16:02.016147232Z [2024-05-11 00:16:02,015: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:16:02.021704542Z [2024-05-11 00:16:02,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:16:02.037227191Z [2024-05-11 00:16:02,033: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:16:02.076836191Z [2024-05-11 00:16:02,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:16:02.077718788Z [2024-05-11 00:16:02,077: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:16:02.080243290Z [2024-05-11 00:16:02,080: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:16:02.086224356Z [2024-05-11 00:16:02,080: INFO/ForkPoolWorker-1] Read SDNC a4a61494-3428-45e0-ad8f-14d08e0ee488 (epa_03) 2024-05-11T00:16:02.086605020Z [2024-05-11 00:16:02,086: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'a4a61494-3428-45e0-ad8f-14d08e0ee488', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-11T00:16:02.086754188Z [2024-05-11 00:16:02,086: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:16:02.087039153Z [2024-05-11 00:16:02,086: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:16:02.105731383Z [2024-05-11 00:16:02,105: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488 2024-05-11T00:16:02.296002039Z [2024-05-11 00:16:02,295: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:16:02.339280515Z [2024-05-11 00:16:02,339: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:16:02.890872703Z [2024-05-11 00:16:02,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f787b67-9e42-4cb1-8842-e65376258fff] succeeded in 1.9367571820002922s: None 2024-05-11T00:16:03.085196093Z [2024-05-11 00:16:03,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e7d0c5e-4897-492a-97fc-f2395c3824fc] succeeded in 2.126311066999733s: None 2024-05-11T00:16:03.110478092Z [2024-05-11 00:16:03,110: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a31b6b61-b286-4506-a377-4ebb491ddbdb] succeeded in 2.148613286s: None 2024-05-11T00:16:03.142402096Z [2024-05-11 00:16:03,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:16:03.146208787Z [2024-05-11 00:16:03,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:16:03.165330017Z [2024-05-11 00:16:03,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:16:03.166341968Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:16:03.166392335Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:16:03.166555935Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:16:03.166615786Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:16:03.166944185Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:16:03.166995164Z [2024-05-11 00:16:03,166: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:16:03.256698230Z [2024-05-11 00:16:03,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:16:03.300337108Z [2024-05-11 00:16:03,299: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T00:16:03.303578794Z [2024-05-11 00:16:03,303: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:16:03.333350595Z [2024-05-11 00:16:03,333: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T00:16:03.338844971Z [2024-05-11 00:16:03,338: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:16:03.339053858Z [2024-05-11 00:16:03,338: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:16:03.339242844Z [2024-05-11 00:16:03,339: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:16:03.339370292Z [2024-05-11 00:16:03,339: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T00:16:03.339696004Z [2024-05-11 00:16:03,339: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:16:03.339810648Z [2024-05-11 00:16:03,339: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:16:03.430996215Z [2024-05-11 00:16:03,430: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:16:04.852868802Z [2024-05-11 00:16:04,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[445346fe-5616-43eb-aec0-884ba8e064c6] succeeded in 3.901021478000075s: None 2024-05-11T00:16:05.292889149Z [2024-05-11 00:16:05,292: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0b51cb69-1ed3-4fa3-bca1-091050da1a9f] succeeded in 4.309234373000436s: None 2024-05-11T00:17:00.791637888Z [2024-05-11 00:17:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ef1aea2-37aa-4058-af0c-5a514333d930] received 2024-05-11T00:17:00.793779267Z [2024-05-11 00:17:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25c1def9-ea48-4ce2-af09-dc20e469cebd] received 2024-05-11T00:17:00.799507366Z [2024-05-11 00:17:00,799: INFO/ForkPoolWorker-15] [6ef1aea2-37aa-4058-af0c-5a514333d930] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:17:00.799591045Z [2024-05-11 00:17:00,799: INFO/ForkPoolWorker-16] [25c1def9-ea48-4ce2-af09-dc20e469cebd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:17:00.800435771Z [2024-05-11 00:17:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fd6243a-c62a-4224-9d1d-55f509fa2da5] received 2024-05-11T00:17:00.805193827Z [2024-05-11 00:17:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3f66132-3710-4ac9-bb44-2dd07bee945c] received 2024-05-11T00:17:00.808777567Z [2024-05-11 00:17:00,808: INFO/ForkPoolWorker-1] [0fd6243a-c62a-4224-9d1d-55f509fa2da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:17:00.818426025Z [2024-05-11 00:17:00,818: INFO/ForkPoolWorker-2] [e3f66132-3710-4ac9-bb44-2dd07bee945c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:17:01.165114211Z [2024-05-11 00:17:01,158: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:17:01.177553450Z [2024-05-11 00:17:01,174: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:17:01.227051046Z [2024-05-11 00:17:01,223: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:17:01.297986946Z [2024-05-11 00:17:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:17:01.409106646Z [2024-05-11 00:17:01,408: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:17:01.414220421Z [2024-05-11 00:17:01,413: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:17:01.452598548Z [2024-05-11 00:17:01,452: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:17:01.454283393Z [2024-05-11 00:17:01,454: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:17:01.454524813Z [2024-05-11 00:17:01,454: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:17:01.454539337Z [2024-05-11 00:17:01,454: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:17:01.454841861Z [2024-05-11 00:17:01,454: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:17:01.460618409Z [2024-05-11 00:17:01,460: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:17:01.469762359Z [2024-05-11 00:17:01,469: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:17:01.470527162Z [2024-05-11 00:17:01,470: WARNING/ForkPoolWorker-16] Dag 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:17:01.470895902Z [2024-05-11 00:17:01,470: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:17:01.471840414Z [2024-05-11 00:17:01,471: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:17:01.474671695Z [2024-05-11 00:17:01,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:17:01.492119049Z [2024-05-11 00:17:01,491: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:17:01.493380246Z [2024-05-11 00:17:01,493: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:17:01.493455313Z [2024-05-11 00:17:01,493: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:17:01.493529721Z [2024-05-11 00:17:01,493: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:17:01.493712427Z [2024-05-11 00:17:01,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:17:01.493888583Z [2024-05-11 00:17:01,493: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:17:01.498764621Z [2024-05-11 00:17:01,498: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:17:01.498941344Z [2024-05-11 00:17:01,498: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:17:01.499140463Z [2024-05-11 00:17:01,499: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:17:01.499447901Z [2024-05-11 00:17:01,499: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:17:01.503383525Z [2024-05-11 00:17:01,502: ERROR/ForkPoolWorker-16] [25c1def9-ea48-4ce2-af09-dc20e469cebd] Failed to execute task Dag 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488' could not be found; either it does not exist or it failed to parse.. 2024-05-11T00:17:01.503406520Z Traceback (most recent call last): 2024-05-11T00:17:01.503410706Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T00:17:01.503414790Z args.func(args) 2024-05-11T00:17:01.503418648Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T00:17:01.503422277Z return func(*args, **kwargs) 2024-05-11T00:17:01.503425730Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T00:17:01.503428646Z return f(*args, **kwargs) 2024-05-11T00:17:01.503431679Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T00:17:01.503434778Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T00:17:01.503437730Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T00:17:01.503441243Z raise AirflowException( 2024-05-11T00:17:01.503444767Z airflow.exceptions.AirflowException: Dag 'sdnc_status_a4a61494-3428-45e0-ad8f-14d08e0ee488' could not be found; either it does not exist or it failed to parse. 2024-05-11T00:17:01.527946633Z [2024-05-11 00:17:01,527: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25c1def9-ea48-4ce2-af09-dc20e469cebd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25c1def9-ea48-4ce2-af09-dc20e469cebd') 2024-05-11T00:17:01.527987239Z Traceback (most recent call last): 2024-05-11T00:17:01.527992565Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T00:17:01.527996339Z R = retval = fun(*args, **kwargs) 2024-05-11T00:17:01.527999426Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T00:17:01.528002462Z return self.run(*args, **kwargs) 2024-05-11T00:17:01.528006425Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T00:17:01.528010490Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T00:17:01.528013997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T00:17:01.528017858Z raise AirflowException(msg) 2024-05-11T00:17:01.528022456Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25c1def9-ea48-4ce2-af09-dc20e469cebd 2024-05-11T00:17:01.607814993Z [2024-05-11 00:17:01,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:17:02.172612260Z [2024-05-11 00:17:02,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ef1aea2-37aa-4058-af0c-5a514333d930] succeeded in 1.3794702519999191s: None 2024-05-11T00:17:02.434731782Z [2024-05-11 00:17:02,434: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:17:02.438008385Z [2024-05-11 00:17:02,437: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:17:02.462092946Z [2024-05-11 00:17:02,461: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:17:02.463599474Z [2024-05-11 00:17:02,463: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:17:02.463811874Z [2024-05-11 00:17:02,463: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:17:02.464086398Z [2024-05-11 00:17:02,463: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:17:02.464227323Z [2024-05-11 00:17:02,464: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:17:02.464655169Z [2024-05-11 00:17:02,464: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:17:02.464803883Z [2024-05-11 00:17:02,464: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:17:02.512093155Z [2024-05-11 00:17:02,511: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:17:02.515584341Z [2024-05-11 00:17:02,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:17:02.539976526Z [2024-05-11 00:17:02,539: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:17:02.541351214Z [2024-05-11 00:17:02,541: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:17:02.541485858Z [2024-05-11 00:17:02,541: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:17:02.541693270Z [2024-05-11 00:17:02,541: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:17:02.541972994Z [2024-05-11 00:17:02,541: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:17:02.542380371Z [2024-05-11 00:17:02,542: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:17:02.542573143Z [2024-05-11 00:17:02,542: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:17:02.551531653Z [2024-05-11 00:17:02,551: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:17:02.640379880Z [2024-05-11 00:17:02,640: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:17:04.448950814Z [2024-05-11 00:17:04,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0fd6243a-c62a-4224-9d1d-55f509fa2da5] succeeded in 3.6472160249995795s: None 2024-05-11T00:17:04.462148830Z [2024-05-11 00:17:04,461: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3f66132-3710-4ac9-bb44-2dd07bee945c] succeeded in 3.655515643000399s: None 2024-05-11T00:18:00.574589981Z [2024-05-11 00:18:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f71fb9e8-ca74-47a5-9a58-a91cfd98e9fa] received 2024-05-11T00:18:00.579563281Z [2024-05-11 00:18:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e3b1899-88c2-4034-a600-023fd42973c2] received 2024-05-11T00:18:00.586263341Z [2024-05-11 00:18:00,586: INFO/ForkPoolWorker-16] [7e3b1899-88c2-4034-a600-023fd42973c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:18:00.586883007Z [2024-05-11 00:18:00,586: INFO/ForkPoolWorker-15] [f71fb9e8-ca74-47a5-9a58-a91cfd98e9fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:18:00.594470701Z [2024-05-11 00:18:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[317adb71-3c37-4f0e-8a90-16998b7af47b] received 2024-05-11T00:18:00.598522231Z [2024-05-11 00:18:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cdf5a6c-421c-458c-b3d0-a808eb82e29f] received 2024-05-11T00:18:00.606206727Z [2024-05-11 00:18:00,605: INFO/ForkPoolWorker-2] [4cdf5a6c-421c-458c-b3d0-a808eb82e29f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:18:00.606637851Z [2024-05-11 00:18:00,606: INFO/ForkPoolWorker-1] [317adb71-3c37-4f0e-8a90-16998b7af47b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:18:00.954987926Z [2024-05-11 00:18:00,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:18:01.069983062Z [2024-05-11 00:18:01,065: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:18:01.103094827Z [2024-05-11 00:18:01,094: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:18:01.279286631Z [2024-05-11 00:18:01,275: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:18:01.326884043Z [2024-05-11 00:18:01,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:18:01.399824395Z [2024-05-11 00:18:01,399: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:18:01.404446917Z [2024-05-11 00:18:01,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:18:01.448756282Z [2024-05-11 00:18:01,448: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:18:01.454361585Z [2024-05-11 00:18:01,454: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:18:01.454478963Z [2024-05-11 00:18:01,454: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:18:01.454554630Z [2024-05-11 00:18:01,454: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:18:01.454788441Z [2024-05-11 00:18:01,454: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:18:01.547599993Z [2024-05-11 00:18:01,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:18:01.901610186Z [2024-05-11 00:18:01,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f71fb9e8-ca74-47a5-9a58-a91cfd98e9fa] succeeded in 1.3227805250007805s: None 2024-05-11T00:18:02.204385376Z [2024-05-11 00:18:02,203: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e3b1899-88c2-4034-a600-023fd42973c2] succeeded in 1.6230574149994936s: None 2024-05-11T00:18:02.395764579Z [2024-05-11 00:18:02,395: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:18:02.399125813Z [2024-05-11 00:18:02,398: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:18:02.423709758Z [2024-05-11 00:18:02,423: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:18:02.427728167Z [2024-05-11 00:18:02,427: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:18:02.427797635Z [2024-05-11 00:18:02,427: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:18:02.428175549Z [2024-05-11 00:18:02,427: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:18:02.428369534Z [2024-05-11 00:18:02,428: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:18:02.428659287Z [2024-05-11 00:18:02,428: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:18:02.428770577Z [2024-05-11 00:18:02,428: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:18:02.539342971Z [2024-05-11 00:18:02,539: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:18:02.570221963Z [2024-05-11 00:18:02,569: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:18:02.573514935Z [2024-05-11 00:18:02,573: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:18:02.590480814Z [2024-05-11 00:18:02,590: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:18:02.591627134Z [2024-05-11 00:18:02,591: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:18:02.591687536Z [2024-05-11 00:18:02,591: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:18:02.591860568Z [2024-05-11 00:18:02,591: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:18:02.591928692Z [2024-05-11 00:18:02,591: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:18:02.592204160Z [2024-05-11 00:18:02,592: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:18:02.592263111Z [2024-05-11 00:18:02,592: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:18:02.669038057Z [2024-05-11 00:18:02,668: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:18:04.223673188Z [2024-05-11 00:18:04,223: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[317adb71-3c37-4f0e-8a90-16998b7af47b] succeeded in 3.6271102739992784s: None 2024-05-11T00:18:04.386384043Z [2024-05-11 00:18:04,385: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4cdf5a6c-421c-458c-b3d0-a808eb82e29f] succeeded in 3.7851523389999784s: None 2024-05-11T00:19:01.226599093Z [2024-05-11 00:19:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0268720a-f133-4151-87f7-8670f726c9ab] received 2024-05-11T00:19:01.228535920Z [2024-05-11 00:19:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6c528e8-a240-4d7c-a014-2a9998190c1c] received 2024-05-11T00:19:01.237177446Z [2024-05-11 00:19:01,236: INFO/ForkPoolWorker-15] [0268720a-f133-4151-87f7-8670f726c9ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:19:01.238297146Z [2024-05-11 00:19:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e9f41b0-ea1c-478d-abb7-41e3fcb6b149] received 2024-05-11T00:19:01.238578697Z [2024-05-11 00:19:01,238: INFO/ForkPoolWorker-16] [c6c528e8-a240-4d7c-a014-2a9998190c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:19:01.248011389Z [2024-05-11 00:19:01,247: INFO/ForkPoolWorker-1] [2e9f41b0-ea1c-478d-abb7-41e3fcb6b149] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:19:01.534664779Z [2024-05-11 00:19:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:19:01.551124415Z [2024-05-11 00:19:01,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:19:01.560500657Z [2024-05-11 00:19:01,556: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:19:01.708605662Z [2024-05-11 00:19:01,708: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:19:01.714039904Z [2024-05-11 00:19:01,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:19:01.735985563Z [2024-05-11 00:19:01,735: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:19:01.737198362Z [2024-05-11 00:19:01,736: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:19:01.737331274Z [2024-05-11 00:19:01,737: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:19:01.737456036Z [2024-05-11 00:19:01,737: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:19:01.737779678Z [2024-05-11 00:19:01,737: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:19:01.842703307Z [2024-05-11 00:19:01,842: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:19:02.603577620Z [2024-05-11 00:19:02,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e9f41b0-ea1c-478d-abb7-41e3fcb6b149] succeeded in 1.3634127360001003s: None 2024-05-11T00:19:02.827321368Z [2024-05-11 00:19:02,826: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:19:02.831373831Z [2024-05-11 00:19:02,830: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:19:02.862942388Z [2024-05-11 00:19:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:19:02.864857664Z [2024-05-11 00:19:02,864: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:19:02.865050052Z [2024-05-11 00:19:02,864: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:19:02.865340755Z [2024-05-11 00:19:02,865: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:19:02.865482976Z [2024-05-11 00:19:02,865: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:19:02.865926718Z [2024-05-11 00:19:02,865: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:19:02.866048536Z [2024-05-11 00:19:02,865: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:19:02.938201825Z [2024-05-11 00:19:02,937: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:19:02.941805884Z [2024-05-11 00:19:02,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:19:02.967551327Z [2024-05-11 00:19:02,967: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:19:02.969265039Z [2024-05-11 00:19:02,968: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:19:02.971017425Z [2024-05-11 00:19:02,970: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:19:02.971130852Z [2024-05-11 00:19:02,970: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:19:02.971436933Z [2024-05-11 00:19:02,971: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:19:02.971537807Z [2024-05-11 00:19:02,971: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:19:02.971911483Z [2024-05-11 00:19:02,971: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:19:02.972094656Z [2024-05-11 00:19:02,971: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:19:03.053962893Z [2024-05-11 00:19:03,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:19:05.084060625Z [2024-05-11 00:19:05,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0268720a-f133-4151-87f7-8670f726c9ab] succeeded in 3.854930534000232s: None 2024-05-11T00:19:05.403503378Z [2024-05-11 00:19:05,403: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6c528e8-a240-4d7c-a014-2a9998190c1c] succeeded in 4.1726993029997175s: None 2024-05-11T00:20:01.211080166Z [2024-05-11 00:20:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9675b733-d919-4c72-a036-6aeeb3c9abc6] received 2024-05-11T00:20:01.213075613Z [2024-05-11 00:20:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[713010b9-b911-4981-b6a3-014299b2ecbb] received 2024-05-11T00:20:01.216103978Z [2024-05-11 00:20:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95cc8118-f763-4d42-ae12-68e0f0cc18c4] received 2024-05-11T00:20:01.217975999Z [2024-05-11 00:20:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2755ac58-d5be-45a4-a03c-af9d056a97e4] received 2024-05-11T00:20:01.220351030Z [2024-05-11 00:20:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2637ae1-10dd-4229-936f-886fb40b66c1] received 2024-05-11T00:20:01.228205572Z [2024-05-11 00:20:01,227: INFO/ForkPoolWorker-1] [95cc8118-f763-4d42-ae12-68e0f0cc18c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:20:01.233826531Z [2024-05-11 00:20:01,233: INFO/ForkPoolWorker-15] [9675b733-d919-4c72-a036-6aeeb3c9abc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:01.235045098Z [2024-05-11 00:20:01,234: INFO/ForkPoolWorker-3] [d2637ae1-10dd-4229-936f-886fb40b66c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:20:01.235842119Z [2024-05-11 00:20:01,235: INFO/ForkPoolWorker-2] [2755ac58-d5be-45a4-a03c-af9d056a97e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:20:01.239174297Z [2024-05-11 00:20:01,238: INFO/ForkPoolWorker-16] [713010b9-b911-4981-b6a3-014299b2ecbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:20:01.571673585Z [2024-05-11 00:20:01,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:20:01.669062682Z [2024-05-11 00:20:01,665: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:20:01.718052770Z [2024-05-11 00:20:01,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:20:01.860853262Z [2024-05-11 00:20:01,856: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:20:01.937316105Z [2024-05-11 00:20:01,922: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:20:02.082506963Z [2024-05-11 00:20:02,081: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:20:02.086587606Z [2024-05-11 00:20:02,086: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:02.119155386Z [2024-05-11 00:20:02,118: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:20:02.123030237Z [2024-05-11 00:20:02,122: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:20:02.123050597Z [2024-05-11 00:20:02,122: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:20:02.123080716Z [2024-05-11 00:20:02,122: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:20:02.123391875Z [2024-05-11 00:20:02,123: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:20:02.271577011Z [2024-05-11 00:20:02,271: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:02.321306474Z [2024-05-11 00:20:02,320: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:03.048516506Z [2024-05-11 00:20:03,048: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95cc8118-f763-4d42-ae12-68e0f0cc18c4] succeeded in 1.8309860960007427s: None 2024-05-11T00:20:03.093235254Z [2024-05-11 00:20:03,092: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2755ac58-d5be-45a4-a03c-af9d056a97e4] succeeded in 1.8734286819999397s: None 2024-05-11T00:20:03.298339764Z [2024-05-11 00:20:03,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:20:03.301741454Z [2024-05-11 00:20:03,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:03.337949498Z [2024-05-11 00:20:03,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:20:03.339634285Z [2024-05-11 00:20:03,339: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:03.339646776Z [2024-05-11 00:20:03,339: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:03.339832180Z [2024-05-11 00:20:03,339: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:03.339838304Z [2024-05-11 00:20:03,339: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:20:03.340148609Z [2024-05-11 00:20:03,339: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:20:03.340157357Z [2024-05-11 00:20:03,340: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:03.370682905Z [2024-05-11 00:20:03,370: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:20:03.374294117Z [2024-05-11 00:20:03,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:03.400437160Z [2024-05-11 00:20:03,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:20:03.402509743Z [2024-05-11 00:20:03,402: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:03.402796911Z [2024-05-11 00:20:03,402: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:03.403124648Z [2024-05-11 00:20:03,402: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:03.403692610Z [2024-05-11 00:20:03,403: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:20:03.404212946Z [2024-05-11 00:20:03,404: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:20:03.404825380Z [2024-05-11 00:20:03,404: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:03.437736716Z [2024-05-11 00:20:03,437: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:03.462131961Z [2024-05-11 00:20:03,461: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T00:20:03.465486243Z [2024-05-11 00:20:03,464: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:03.522017596Z [2024-05-11 00:20:03,520: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T00:20:03.524772547Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:03.524799659Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:03.524805224Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:03.524809753Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T00:20:03.524813608Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:20:03.524817408Z [2024-05-11 00:20:03,523: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:03.540398192Z [2024-05-11 00:20:03,540: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:03.621181280Z [2024-05-11 00:20:03,620: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:04.150235428Z [2024-05-11 00:20:04,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d562b5c2-a0ca-479b-9537-a018c546b2f6] received 2024-05-11T00:20:04.158804371Z [2024-05-11 00:20:04,158: INFO/ForkPoolWorker-1] [d562b5c2-a0ca-479b-9537-a018c546b2f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:04.228385093Z [2024-05-11 00:20:04,227: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9675b733-d919-4c72-a036-6aeeb3c9abc6] succeeded in 3.0134653340001023s: None 2024-05-11T00:20:04.459451133Z [2024-05-11 00:20:04,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:20:05.279741193Z [2024-05-11 00:20:05,279: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d2637ae1-10dd-4229-936f-886fb40b66c1] succeeded in 4.056768464000015s: None 2024-05-11T00:20:05.407384917Z [2024-05-11 00:20:05,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[713010b9-b911-4981-b6a3-014299b2ecbb] succeeded in 4.191925209000146s: None 2024-05-11T00:20:05.810334742Z [2024-05-11 00:20:05,809: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:20:05.814573395Z [2024-05-11 00:20:05,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:05.837981164Z [2024-05-11 00:20:05,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:20:05.839244719Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:05.839255347Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:05.839336286Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:05.839377583Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:20:05.839653628Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:20:05.839689002Z [2024-05-11 00:20:05,839: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:05.957174379Z [2024-05-11 00:20:05,956: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:06.520596571Z [2024-05-11 00:20:06,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cce73ebc-f8d1-4ff7-b336-2a14a5f63969] received 2024-05-11T00:20:06.533839925Z [2024-05-11 00:20:06,533: INFO/ForkPoolWorker-15] [cce73ebc-f8d1-4ff7-b336-2a14a5f63969] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:20:06.610860301Z [2024-05-11 00:20:06,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d562b5c2-a0ca-479b-9537-a018c546b2f6] succeeded in 2.4590228180004488s: None 2024-05-11T00:20:06.842002131Z [2024-05-11 00:20:06,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:20:08.035649961Z [2024-05-11 00:20:08,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:20:08.039093779Z [2024-05-11 00:20:08,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:08.061123035Z [2024-05-11 00:20:08,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:20:08.062970730Z [2024-05-11 00:20:08,062: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:08.063020879Z [2024-05-11 00:20:08,062: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:08.063307321Z [2024-05-11 00:20:08,063: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:08.063532597Z [2024-05-11 00:20:08,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:20:08.063999429Z [2024-05-11 00:20:08,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:20:08.064191477Z [2024-05-11 00:20:08,064: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:08.171974075Z [2024-05-11 00:20:08,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:08.804543904Z [2024-05-11 00:20:08,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cce73ebc-f8d1-4ff7-b336-2a14a5f63969] succeeded in 2.275951463000638s: None 2024-05-11T00:20:09.160309084Z [2024-05-11 00:20:09,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58804382-6c9f-4ae3-93ed-ad9dee10f20d] received 2024-05-11T00:20:09.172769291Z [2024-05-11 00:20:09,172: INFO/ForkPoolWorker-15] [58804382-6c9f-4ae3-93ed-ad9dee10f20d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:20:09.442251837Z [2024-05-11 00:20:09,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:20:10.940744910Z [2024-05-11 00:20:10,940: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:20:10.944135387Z [2024-05-11 00:20:10,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:20:10.967528339Z [2024-05-11 00:20:10,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:20:10.969940541Z [2024-05-11 00:20:10,969: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:20:10.970131364Z [2024-05-11 00:20:10,969: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:20:10.970350449Z [2024-05-11 00:20:10,970: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:20:10.970533648Z [2024-05-11 00:20:10,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:20:10.970828303Z [2024-05-11 00:20:10,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:20:10.970992045Z [2024-05-11 00:20:10,970: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:20:11.120797910Z [2024-05-11 00:20:11,120: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:20:11.796224556Z [2024-05-11 00:20:11,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58804382-6c9f-4ae3-93ed-ad9dee10f20d] succeeded in 2.634027576000335s: None 2024-05-11T00:21:01.291139660Z [2024-05-11 00:21:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81dbe854-e5d8-4eb4-b3bc-1b2c9e008b9a] received 2024-05-11T00:21:01.298624850Z [2024-05-11 00:21:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb1a1994-e828-4ab5-b2d5-98e29d9bdb36] received 2024-05-11T00:21:01.304101705Z [2024-05-11 00:21:01,303: INFO/ForkPoolWorker-15] [81dbe854-e5d8-4eb4-b3bc-1b2c9e008b9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:21:01.306069762Z [2024-05-11 00:21:01,305: INFO/ForkPoolWorker-16] [fb1a1994-e828-4ab5-b2d5-98e29d9bdb36] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:21:01.310431643Z [2024-05-11 00:21:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157f31a6-f158-42c5-b565-2918ed02f74b] received 2024-05-11T00:21:01.317762820Z [2024-05-11 00:21:01,317: INFO/ForkPoolWorker-1] [157f31a6-f158-42c5-b565-2918ed02f74b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:21:01.611437456Z [2024-05-11 00:21:01,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:21:01.635445614Z [2024-05-11 00:21:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:21:01.649598160Z [2024-05-11 00:21:01,645: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:21:01.847789151Z [2024-05-11 00:21:01,847: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:21:01.852718848Z [2024-05-11 00:21:01,852: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:21:01.883421305Z [2024-05-11 00:21:01,883: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:21:01.884726709Z [2024-05-11 00:21:01,884: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:21:01.884775156Z [2024-05-11 00:21:01,884: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:21:01.884830459Z [2024-05-11 00:21:01,884: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:21:01.885070518Z [2024-05-11 00:21:01,884: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:21:02.016571605Z [2024-05-11 00:21:02,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:21:02.736684637Z [2024-05-11 00:21:02,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb1a1994-e828-4ab5-b2d5-98e29d9bdb36] succeeded in 1.4359738390003258s: None 2024-05-11T00:21:02.958239964Z [2024-05-11 00:21:02,957: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:21:02.962027391Z [2024-05-11 00:21:02,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:21:02.990586741Z [2024-05-11 00:21:02,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:21:02.992252241Z [2024-05-11 00:21:02,991: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:21:02.992838965Z [2024-05-11 00:21:02,992: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:21:02.993125665Z [2024-05-11 00:21:02,992: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:21:02.993279921Z [2024-05-11 00:21:02,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:21:02.994103927Z [2024-05-11 00:21:02,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:21:02.994252329Z [2024-05-11 00:21:02,994: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:21:03.015621982Z [2024-05-11 00:21:03,015: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:21:03.019165104Z [2024-05-11 00:21:03,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:21:03.047197501Z [2024-05-11 00:21:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:21:03.048716609Z [2024-05-11 00:21:03,048: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:21:03.048841101Z [2024-05-11 00:21:03,048: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:21:03.049070147Z [2024-05-11 00:21:03,048: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:21:03.049186268Z [2024-05-11 00:21:03,049: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:21:03.049538267Z [2024-05-11 00:21:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:21:03.049673674Z [2024-05-11 00:21:03,049: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:21:03.084855228Z [2024-05-11 00:21:03,084: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:21:03.155154150Z [2024-05-11 00:21:03,154: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:21:04.990366898Z [2024-05-11 00:21:04,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[157f31a6-f158-42c5-b565-2918ed02f74b] succeeded in 3.6780421570001636s: None 2024-05-11T00:21:05.300949521Z [2024-05-11 00:21:05,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81dbe854-e5d8-4eb4-b3bc-1b2c9e008b9a] succeeded in 4.005816738999783s: None 2024-05-11T00:22:01.204809265Z [2024-05-11 00:22:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fde1d3b7-1c2a-4bd0-b754-bb55273a2f15] received 2024-05-11T00:22:01.212691334Z [2024-05-11 00:22:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a7bfaa8-92f0-42da-98ed-185c001f629a] received 2024-05-11T00:22:01.219858981Z [2024-05-11 00:22:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acb129a4-df67-40ee-a57b-0411fecdfdbc] received 2024-05-11T00:22:01.228170898Z [2024-05-11 00:22:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e6bf599-996d-4d7d-897d-e45c8f976827] received 2024-05-11T00:22:01.228836515Z [2024-05-11 00:22:01,228: INFO/ForkPoolWorker-15] [fde1d3b7-1c2a-4bd0-b754-bb55273a2f15] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:22:01.236626119Z [2024-05-11 00:22:01,236: INFO/ForkPoolWorker-16] [3a7bfaa8-92f0-42da-98ed-185c001f629a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:22:01.237598905Z [2024-05-11 00:22:01,237: INFO/ForkPoolWorker-1] [acb129a4-df67-40ee-a57b-0411fecdfdbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:22:01.247009986Z [2024-05-11 00:22:01,246: INFO/ForkPoolWorker-2] [8e6bf599-996d-4d7d-897d-e45c8f976827] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:22:01.585608889Z [2024-05-11 00:22:01,582: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:22:01.627382667Z [2024-05-11 00:22:01,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:22:01.676675260Z [2024-05-11 00:22:01,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:22:01.911222281Z [2024-05-11 00:22:01,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:22:01.963975949Z [2024-05-11 00:22:01,958: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:22:02.157443574Z [2024-05-11 00:22:02,156: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:22:02.161436440Z [2024-05-11 00:22:02,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:22:02.203922828Z [2024-05-11 00:22:02,203: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:22:02.205540854Z [2024-05-11 00:22:02,205: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:22:02.209191400Z [2024-05-11 00:22:02,205: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:22:02.209485090Z [2024-05-11 00:22:02,209: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:22:02.209931894Z [2024-05-11 00:22:02,209: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:22:02.309569083Z [2024-05-11 00:22:02,309: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:22:02.584767367Z [2024-05-11 00:22:02,584: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fde1d3b7-1c2a-4bd0-b754-bb55273a2f15] succeeded in 1.377274794999721s: None 2024-05-11T00:22:02.984861696Z [2024-05-11 00:22:02,984: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[acb129a4-df67-40ee-a57b-0411fecdfdbc] succeeded in 1.7632065190000503s: None 2024-05-11T00:22:03.036105419Z [2024-05-11 00:22:03,035: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:22:03.042659673Z [2024-05-11 00:22:03,041: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:22:03.072494777Z [2024-05-11 00:22:03,072: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:22:03.073996156Z [2024-05-11 00:22:03,073: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:22:03.074235464Z [2024-05-11 00:22:03,074: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:22:03.074465365Z [2024-05-11 00:22:03,074: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:22:03.074563087Z [2024-05-11 00:22:03,074: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:22:03.075010498Z [2024-05-11 00:22:03,074: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:22:03.075030670Z [2024-05-11 00:22:03,074: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:22:03.103749865Z [2024-05-11 00:22:03,103: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:22:03.107707553Z [2024-05-11 00:22:03,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:22:03.126901284Z [2024-05-11 00:22:03,126: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:22:03.128286440Z [2024-05-11 00:22:03,128: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:22:03.128405585Z [2024-05-11 00:22:03,128: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:22:03.128616770Z [2024-05-11 00:22:03,128: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:22:03.128761319Z [2024-05-11 00:22:03,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:22:03.129322980Z [2024-05-11 00:22:03,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:22:03.129463745Z [2024-05-11 00:22:03,129: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:22:03.186238530Z [2024-05-11 00:22:03,185: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:22:03.238821413Z [2024-05-11 00:22:03,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:22:05.250118770Z [2024-05-11 00:22:05,249: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e6bf599-996d-4d7d-897d-e45c8f976827] succeeded in 4.0149602499996035s: None 2024-05-11T00:22:05.902468815Z [2024-05-11 00:22:05,901: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a7bfaa8-92f0-42da-98ed-185c001f629a] succeeded in 4.687109785000757s: None 2024-05-11T00:23:00.827838411Z [2024-05-11 00:23:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f370f22d-160d-4720-96d2-66fab12a0f8d] received 2024-05-11T00:23:00.836699926Z [2024-05-11 00:23:00,836: INFO/ForkPoolWorker-15] [f370f22d-160d-4720-96d2-66fab12a0f8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:23:00.837197678Z [2024-05-11 00:23:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc890935-1724-43b0-a345-0a8c38affc77] received 2024-05-11T00:23:00.844315913Z [2024-05-11 00:23:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71a27c25-cafa-4fe6-bcf3-fa0699cf3e01] received 2024-05-11T00:23:00.845606028Z [2024-05-11 00:23:00,845: INFO/ForkPoolWorker-16] [bc890935-1724-43b0-a345-0a8c38affc77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:23:00.853025906Z [2024-05-11 00:23:00,852: INFO/ForkPoolWorker-1] [71a27c25-cafa-4fe6-bcf3-fa0699cf3e01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:23:01.183580935Z [2024-05-11 00:23:01,179: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:23:01.224217158Z [2024-05-11 00:23:01,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:23:01.317786486Z [2024-05-11 00:23:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:23:01.472633214Z [2024-05-11 00:23:01,472: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:23:01.476726673Z [2024-05-11 00:23:01,476: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:23:01.505933945Z [2024-05-11 00:23:01,505: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:23:01.507367602Z [2024-05-11 00:23:01,507: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:23:01.507593015Z [2024-05-11 00:23:01,507: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:23:01.507733399Z [2024-05-11 00:23:01,507: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:23:01.508062231Z [2024-05-11 00:23:01,507: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:23:01.591721387Z [2024-05-11 00:23:01,591: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:23:02.146128598Z [2024-05-11 00:23:02,145: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71a27c25-cafa-4fe6-bcf3-fa0699cf3e01] succeeded in 1.3000173139998878s: None 2024-05-11T00:23:02.480235941Z [2024-05-11 00:23:02,479: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:23:02.483750200Z [2024-05-11 00:23:02,483: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:23:02.499355541Z [2024-05-11 00:23:02,498: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:23:02.503120634Z [2024-05-11 00:23:02,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:23:02.509505738Z [2024-05-11 00:23:02,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:23:02.511075292Z [2024-05-11 00:23:02,510: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:23:02.511260130Z [2024-05-11 00:23:02,510: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:23:02.511559425Z [2024-05-11 00:23:02,511: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:23:02.511766627Z [2024-05-11 00:23:02,511: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:23:02.512207550Z [2024-05-11 00:23:02,512: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:23:02.512924894Z [2024-05-11 00:23:02,512: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:23:02.528169584Z [2024-05-11 00:23:02,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:23:02.529950610Z [2024-05-11 00:23:02,529: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:23:02.530199863Z [2024-05-11 00:23:02,529: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:23:02.530388408Z [2024-05-11 00:23:02,530: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:23:02.530463933Z [2024-05-11 00:23:02,530: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:23:02.531368407Z [2024-05-11 00:23:02,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:23:02.531411965Z [2024-05-11 00:23:02,531: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:23:02.635204101Z [2024-05-11 00:23:02,634: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:23:02.640705436Z [2024-05-11 00:23:02,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:23:04.505680091Z [2024-05-11 00:23:04,505: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc890935-1724-43b0-a345-0a8c38affc77] succeeded in 3.6662692210002206s: None 2024-05-11T00:23:05.131671743Z [2024-05-11 00:23:05,131: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f370f22d-160d-4720-96d2-66fab12a0f8d] succeeded in 4.301572833000137s: None 2024-05-11T00:24:01.182805237Z [2024-05-11 00:24:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[752333eb-c6c5-4f81-8f67-1d4c4b099ec4] received 2024-05-11T00:24:01.186029391Z [2024-05-11 00:24:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af5e9fe7-06c4-4f10-bc7b-8690bfea8866] received 2024-05-11T00:24:01.197282239Z [2024-05-11 00:24:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c3aa79a-64d9-4fe9-b754-54c4b6126389] received 2024-05-11T00:24:01.198442533Z [2024-05-11 00:24:01,198: INFO/ForkPoolWorker-16] [af5e9fe7-06c4-4f10-bc7b-8690bfea8866] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:24:01.203790579Z [2024-05-11 00:24:01,203: INFO/ForkPoolWorker-15] [752333eb-c6c5-4f81-8f67-1d4c4b099ec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:24:01.204630178Z [2024-05-11 00:24:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2347c24d-e800-4505-b5c6-3079c696a83a] received 2024-05-11T00:24:01.215660796Z [2024-05-11 00:24:01,215: INFO/ForkPoolWorker-2] [2347c24d-e800-4505-b5c6-3079c696a83a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:24:01.219958110Z [2024-05-11 00:24:01,219: INFO/ForkPoolWorker-1] [0c3aa79a-64d9-4fe9-b754-54c4b6126389] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:24:01.559799176Z [2024-05-11 00:24:01,555: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:24:01.599675549Z [2024-05-11 00:24:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:24:01.683187183Z [2024-05-11 00:24:01,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:24:01.708514648Z [2024-05-11 00:24:01,705: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:24:02.040375357Z [2024-05-11 00:24:02,039: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:24:02.048124692Z [2024-05-11 00:24:02,047: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:24:02.056099575Z [2024-05-11 00:24:02,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:24:02.129372889Z [2024-05-11 00:24:02,129: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:24:02.133348730Z [2024-05-11 00:24:02,133: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:24:02.133757811Z [2024-05-11 00:24:02,133: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:24:02.133915911Z [2024-05-11 00:24:02,133: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:24:02.134261419Z [2024-05-11 00:24:02,134: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:24:02.305648005Z [2024-05-11 00:24:02,305: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:24:02.879697645Z [2024-05-11 00:24:02,879: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c3aa79a-64d9-4fe9-b754-54c4b6126389] succeeded in 1.6788094190005722s: None 2024-05-11T00:24:02.895115655Z [2024-05-11 00:24:02,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[752333eb-c6c5-4f81-8f67-1d4c4b099ec4] succeeded in 1.705963905000317s: None 2024-05-11T00:24:03.218145171Z [2024-05-11 00:24:03,217: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:24:03.224050697Z [2024-05-11 00:24:03,223: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:24:03.250730837Z [2024-05-11 00:24:03,250: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:24:03.253281087Z [2024-05-11 00:24:03,253: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:24:03.253416686Z [2024-05-11 00:24:03,253: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:24:03.253638130Z [2024-05-11 00:24:03,253: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:24:03.253763355Z [2024-05-11 00:24:03,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:24:03.254220735Z [2024-05-11 00:24:03,254: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:24:03.254354540Z [2024-05-11 00:24:03,254: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:24:03.345615348Z [2024-05-11 00:24:03,345: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:24:03.348713160Z [2024-05-11 00:24:03,348: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:24:03.351357551Z [2024-05-11 00:24:03,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:24:03.378023896Z [2024-05-11 00:24:03,377: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:24:03.380550180Z [2024-05-11 00:24:03,380: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:24:03.381014423Z [2024-05-11 00:24:03,380: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:24:03.381428282Z [2024-05-11 00:24:03,381: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:24:03.381972277Z [2024-05-11 00:24:03,381: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:24:03.382583796Z [2024-05-11 00:24:03,382: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:24:03.382844977Z [2024-05-11 00:24:03,382: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:24:03.482039787Z [2024-05-11 00:24:03,481: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:24:05.861274191Z [2024-05-11 00:24:05,860: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2347c24d-e800-4505-b5c6-3079c696a83a] succeeded in 4.654007344999627s: None 2024-05-11T00:24:06.133610913Z [2024-05-11 00:24:06,133: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af5e9fe7-06c4-4f10-bc7b-8690bfea8866] succeeded in 4.945055287000287s: None 2024-05-11T00:25:00.645663685Z [2024-05-11 00:25:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[649e4475-a056-4e57-8df2-f98f8e57ae0f] received 2024-05-11T00:25:00.652649660Z [2024-05-11 00:25:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7b27867-a45a-4bbf-b806-e4d9a8121201] received 2024-05-11T00:25:00.660964885Z [2024-05-11 00:25:00,660: INFO/ForkPoolWorker-15] [649e4475-a056-4e57-8df2-f98f8e57ae0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:00.664451077Z [2024-05-11 00:25:00,663: INFO/ForkPoolWorker-16] [e7b27867-a45a-4bbf-b806-e4d9a8121201] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:25:00.674746638Z [2024-05-11 00:25:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[093ae6b8-ee10-4873-ae77-fcc338ae20c9] received 2024-05-11T00:25:00.690650562Z [2024-05-11 00:25:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[002ba0e5-c7c8-4699-9c45-a93bcdaedccf] received 2024-05-11T00:25:00.691267469Z [2024-05-11 00:25:00,691: INFO/ForkPoolWorker-1] [093ae6b8-ee10-4873-ae77-fcc338ae20c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:25:00.726720038Z [2024-05-11 00:25:00,726: INFO/ForkPoolWorker-2] [002ba0e5-c7c8-4699-9c45-a93bcdaedccf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:25:01.367702547Z [2024-05-11 00:25:01,363: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:25:01.375864739Z [2024-05-11 00:25:01,345: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:25:01.431357622Z [2024-05-11 00:25:01,427: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:25:01.609626960Z [2024-05-11 00:25:01,609: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:25:01.614075528Z [2024-05-11 00:25:01,613: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:01.620188423Z [2024-05-11 00:25:01,595: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:25:01.638964306Z [2024-05-11 00:25:01,638: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:25:01.641311255Z [2024-05-11 00:25:01,641: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:25:01.641555106Z [2024-05-11 00:25:01,641: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:25:01.641685416Z [2024-05-11 00:25:01,641: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:25:01.642002397Z [2024-05-11 00:25:01,641: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:25:01.822763097Z [2024-05-11 00:25:01,822: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:02.723739639Z [2024-05-11 00:25:02,723: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[002ba0e5-c7c8-4699-9c45-a93bcdaedccf] succeeded in 2.0287580529993647s: None 2024-05-11T00:25:03.237242482Z [2024-05-11 00:25:03,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:25:03.240923808Z [2024-05-11 00:25:03,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:03.260416747Z [2024-05-11 00:25:03,260: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:25:03.262450109Z [2024-05-11 00:25:03,262: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:03.262490228Z [2024-05-11 00:25:03,262: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:03.262674513Z [2024-05-11 00:25:03,262: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:03.262728429Z [2024-05-11 00:25:03,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:25:03.263210791Z [2024-05-11 00:25:03,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:25:03.263613341Z [2024-05-11 00:25:03,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:03.371292660Z [2024-05-11 00:25:03,371: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:03.453090913Z [2024-05-11 00:25:03,452: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:25:03.457941151Z [2024-05-11 00:25:03,457: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:03.479483931Z [2024-05-11 00:25:03,478: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:25:03.488221210Z [2024-05-11 00:25:03,482: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:03.508894318Z [2024-05-11 00:25:03,508: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:25:03.511791252Z [2024-05-11 00:25:03,510: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:03.511808146Z [2024-05-11 00:25:03,510: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:03.511812398Z [2024-05-11 00:25:03,510: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:03.511816333Z [2024-05-11 00:25:03,511: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:25:03.511819322Z [2024-05-11 00:25:03,511: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:25:03.511822239Z [2024-05-11 00:25:03,511: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:03.541056161Z [2024-05-11 00:25:03,540: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:25:03.546400357Z [2024-05-11 00:25:03,545: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:03.547098367Z [2024-05-11 00:25:03,546: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:03.547327717Z [2024-05-11 00:25:03,547: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:03.547479293Z [2024-05-11 00:25:03,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:25:03.548103053Z [2024-05-11 00:25:03,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:25:03.548296626Z [2024-05-11 00:25:03,548: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:03.656049420Z [2024-05-11 00:25:03,655: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:03.667723680Z [2024-05-11 00:25:03,667: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:04.251157170Z [2024-05-11 00:25:04,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19119708-b9ee-4131-8e6c-37cdd59b30a7] received 2024-05-11T00:25:04.261277300Z [2024-05-11 00:25:04,260: INFO/ForkPoolWorker-2] [19119708-b9ee-4131-8e6c-37cdd59b30a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:04.331010797Z [2024-05-11 00:25:04,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[649e4475-a056-4e57-8df2-f98f8e57ae0f] succeeded in 3.6835162140005195s: None 2024-05-11T00:25:04.546084855Z [2024-05-11 00:25:04,542: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:25:05.326126757Z [2024-05-11 00:25:05,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[093ae6b8-ee10-4873-ae77-fcc338ae20c9] succeeded in 4.647985456999777s: None 2024-05-11T00:25:05.688040269Z [2024-05-11 00:25:05,687: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:25:05.691171364Z [2024-05-11 00:25:05,690: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:05.719795817Z [2024-05-11 00:25:05,719: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:25:05.722818394Z [2024-05-11 00:25:05,722: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:05.723046783Z [2024-05-11 00:25:05,722: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:05.723255310Z [2024-05-11 00:25:05,723: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:05.723383273Z [2024-05-11 00:25:05,723: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:25:05.723707951Z [2024-05-11 00:25:05,723: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:25:05.723838501Z [2024-05-11 00:25:05,723: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:05.799614985Z [2024-05-11 00:25:05,799: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:05.807557723Z [2024-05-11 00:25:05,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7b27867-a45a-4bbf-b806-e4d9a8121201] succeeded in 5.152677797000251s: None 2024-05-11T00:25:06.460718367Z [2024-05-11 00:25:06,460: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[19119708-b9ee-4131-8e6c-37cdd59b30a7] succeeded in 2.207776322999962s: None 2024-05-11T00:25:06.722749584Z [2024-05-11 00:25:06,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a424d60-9d7a-469c-a3e4-c114780a4cfe] received 2024-05-11T00:25:06.731455097Z [2024-05-11 00:25:06,731: INFO/ForkPoolWorker-15] [3a424d60-9d7a-469c-a3e4-c114780a4cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:25:07.033189396Z [2024-05-11 00:25:07,028: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:25:08.238878220Z [2024-05-11 00:25:08,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:25:08.243004115Z [2024-05-11 00:25:08,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:08.269662996Z [2024-05-11 00:25:08,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:25:08.271348249Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:08.271364542Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:08.271479685Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:08.271545214Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:25:08.271855861Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:25:08.272001515Z [2024-05-11 00:25:08,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:08.358779775Z [2024-05-11 00:25:08,358: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:09.043277020Z [2024-05-11 00:25:09,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a424d60-9d7a-469c-a3e4-c114780a4cfe] succeeded in 2.31834637799966s: None 2024-05-11T00:25:09.330583742Z [2024-05-11 00:25:09,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfe153e3-fd83-47fd-89c4-02585c259a70] received 2024-05-11T00:25:09.339731647Z [2024-05-11 00:25:09,339: INFO/ForkPoolWorker-15] [cfe153e3-fd83-47fd-89c4-02585c259a70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:25:09.616274906Z [2024-05-11 00:25:09,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:25:10.890802671Z [2024-05-11 00:25:10,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:25:10.894613285Z [2024-05-11 00:25:10,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:25:10.927953577Z [2024-05-11 00:25:10,927: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:25:10.930244033Z [2024-05-11 00:25:10,929: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:25:10.930518274Z [2024-05-11 00:25:10,930: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:25:10.930921250Z [2024-05-11 00:25:10,930: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:25:10.931097870Z [2024-05-11 00:25:10,930: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:25:10.931663809Z [2024-05-11 00:25:10,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:25:10.931868666Z [2024-05-11 00:25:10,931: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:25:11.115221438Z [2024-05-11 00:25:11,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:25:11.832921051Z [2024-05-11 00:25:11,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfe153e3-fd83-47fd-89c4-02585c259a70] succeeded in 2.500055801000599s: None 2024-05-11T00:26:01.099632575Z [2024-05-11 00:26:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d26722d8-38ab-46ee-9794-22a2050e7fe8] received 2024-05-11T00:26:01.110665197Z [2024-05-11 00:26:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50af0ab5-c868-4ab3-9c4d-ac9d44d5a7c0] received 2024-05-11T00:26:01.113439712Z [2024-05-11 00:26:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ea102d9-11d3-4c25-ac05-61f6fa1d3133] received 2024-05-11T00:26:01.117674710Z [2024-05-11 00:26:01,117: INFO/ForkPoolWorker-15] [d26722d8-38ab-46ee-9794-22a2050e7fe8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:26:01.122633065Z [2024-05-11 00:26:01,122: INFO/ForkPoolWorker-1] [4ea102d9-11d3-4c25-ac05-61f6fa1d3133] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:26:01.131151290Z [2024-05-11 00:26:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e8718c8-5d45-4ec6-9d3b-f5ad7bb8bf46] received 2024-05-11T00:26:01.135666528Z [2024-05-11 00:26:01,135: INFO/ForkPoolWorker-16] [50af0ab5-c868-4ab3-9c4d-ac9d44d5a7c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:26:01.139485645Z [2024-05-11 00:26:01,139: INFO/ForkPoolWorker-2] [1e8718c8-5d45-4ec6-9d3b-f5ad7bb8bf46] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:26:01.505637421Z [2024-05-11 00:26:01,502: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:26:01.519171105Z [2024-05-11 00:26:01,515: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:26:01.523581113Z [2024-05-11 00:26:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:26:01.556660743Z [2024-05-11 00:26:01,548: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:26:01.693387898Z [2024-05-11 00:26:01,692: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:26:01.697210239Z [2024-05-11 00:26:01,696: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:26:01.722964298Z [2024-05-11 00:26:01,722: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:26:01.726908283Z [2024-05-11 00:26:01,726: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:26:01.726992296Z [2024-05-11 00:26:01,726: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:26:01.727000863Z [2024-05-11 00:26:01,726: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:26:01.727306531Z [2024-05-11 00:26:01,727: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:26:01.822620042Z [2024-05-11 00:26:01,822: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:26:02.000526417Z [2024-05-11 00:26:02,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:26:02.505964995Z [2024-05-11 00:26:02,505: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e8718c8-5d45-4ec6-9d3b-f5ad7bb8bf46] succeeded in 1.3729258249995837s: None 2024-05-11T00:26:02.713935852Z [2024-05-11 00:26:02,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d26722d8-38ab-46ee-9794-22a2050e7fe8] succeeded in 1.6114028090005377s: None 2024-05-11T00:26:02.830478957Z [2024-05-11 00:26:02,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:26:02.834136776Z [2024-05-11 00:26:02,833: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:26:02.860715120Z [2024-05-11 00:26:02,860: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:26:02.862730097Z [2024-05-11 00:26:02,862: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:26:02.862953611Z [2024-05-11 00:26:02,862: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:26:02.863188853Z [2024-05-11 00:26:02,862: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:26:02.863320012Z [2024-05-11 00:26:02,863: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:26:02.863722824Z [2024-05-11 00:26:02,863: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:26:02.863763691Z [2024-05-11 00:26:02,863: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:26:02.978932372Z [2024-05-11 00:26:02,978: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:26:02.982659507Z [2024-05-11 00:26:02,982: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:26:02.983793953Z [2024-05-11 00:26:02,983: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:26:03.018516663Z [2024-05-11 00:26:03,018: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:26:03.022891039Z [2024-05-11 00:26:03,022: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:26:03.023073692Z [2024-05-11 00:26:03,022: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:26:03.023401835Z [2024-05-11 00:26:03,023: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:26:03.023601181Z [2024-05-11 00:26:03,023: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:26:03.024099863Z [2024-05-11 00:26:03,023: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:26:03.024567089Z [2024-05-11 00:26:03,024: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:26:03.134380871Z [2024-05-11 00:26:03,133: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:26:05.285547382Z [2024-05-11 00:26:05,285: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ea102d9-11d3-4c25-ac05-61f6fa1d3133] succeeded in 4.169330250000712s: None 2024-05-11T00:26:05.474425431Z [2024-05-11 00:26:05,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50af0ab5-c868-4ab3-9c4d-ac9d44d5a7c0] succeeded in 4.352327613999478s: None 2024-05-11T00:27:00.326659927Z [2024-05-11 00:27:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61dd17ba-ba44-4fb0-a16e-2068356f8ab2] received 2024-05-11T00:27:00.337269730Z [2024-05-11 00:27:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fac0a967-5d87-4ab4-85c7-3708e711dacf] received 2024-05-11T00:27:00.346030421Z [2024-05-11 00:27:00,343: INFO/ForkPoolWorker-16] [fac0a967-5d87-4ab4-85c7-3708e711dacf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:27:00.346058622Z [2024-05-11 00:27:00,344: INFO/ForkPoolWorker-15] [61dd17ba-ba44-4fb0-a16e-2068356f8ab2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:27:00.361084224Z [2024-05-11 00:27:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[034acf89-c847-470a-b4d5-c1d46e5471d2] received 2024-05-11T00:27:00.383803568Z [2024-05-11 00:27:00,383: INFO/ForkPoolWorker-1] [034acf89-c847-470a-b4d5-c1d46e5471d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:27:00.633554045Z [2024-05-11 00:27:00,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:27:00.664289063Z [2024-05-11 00:27:00,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:27:00.684754616Z [2024-05-11 00:27:00,681: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:27:00.794303922Z [2024-05-11 00:27:00,793: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:27:00.798879332Z [2024-05-11 00:27:00,798: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:27:00.820568458Z [2024-05-11 00:27:00,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:27:00.821681183Z [2024-05-11 00:27:00,821: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:27:00.822019605Z [2024-05-11 00:27:00,821: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:27:00.822155851Z [2024-05-11 00:27:00,821: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:27:00.822490417Z [2024-05-11 00:27:00,822: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:27:00.947721834Z [2024-05-11 00:27:00,947: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:27:01.574401368Z [2024-05-11 00:27:01,574: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fac0a967-5d87-4ab4-85c7-3708e711dacf] succeeded in 1.2396959919997244s: None 2024-05-11T00:27:01.866287934Z [2024-05-11 00:27:01,865: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:27:01.869836661Z [2024-05-11 00:27:01,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:27:01.897642236Z [2024-05-11 00:27:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:27:01.899128724Z [2024-05-11 00:27:01,898: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:27:01.899275952Z [2024-05-11 00:27:01,899: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:27:01.899473965Z [2024-05-11 00:27:01,899: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:27:01.899638075Z [2024-05-11 00:27:01,899: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:27:01.900055103Z [2024-05-11 00:27:01,899: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:27:01.900196999Z [2024-05-11 00:27:01,900: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:27:01.949654113Z [2024-05-11 00:27:01,949: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:27:01.952882613Z [2024-05-11 00:27:01,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:27:01.976711074Z [2024-05-11 00:27:01,976: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:27:01.977800701Z [2024-05-11 00:27:01,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:27:01.977812022Z [2024-05-11 00:27:01,977: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:27:01.977848260Z [2024-05-11 00:27:01,977: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:27:01.978045323Z [2024-05-11 00:27:01,977: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:27:01.978086545Z [2024-05-11 00:27:01,977: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:27:01.978283354Z [2024-05-11 00:27:01,978: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:27:01.978319193Z [2024-05-11 00:27:01,978: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:27:02.065463064Z [2024-05-11 00:27:02,065: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:27:03.630149373Z [2024-05-11 00:27:03,629: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[034acf89-c847-470a-b4d5-c1d46e5471d2] succeeded in 3.2585533150004267s: None 2024-05-11T00:27:03.958007818Z [2024-05-11 00:27:03,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61dd17ba-ba44-4fb0-a16e-2068356f8ab2] succeeded in 3.6310747759998776s: None 2024-05-11T00:28:00.239038990Z [2024-05-11 00:28:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29814fc9-9fa8-4495-9b88-edb8f8fb34b2] received 2024-05-11T00:28:00.241434268Z [2024-05-11 00:28:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93d88597-21ab-45f9-9905-bcf1c42664ca] received 2024-05-11T00:28:00.242770418Z [2024-05-11 00:28:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49033558-86aa-400a-b14d-f9fae0974a0a] received 2024-05-11T00:28:00.249025066Z [2024-05-11 00:28:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b92de09d-1926-4cd2-8042-670eb24c2b17] received 2024-05-11T00:28:00.249824945Z [2024-05-11 00:28:00,249: INFO/ForkPoolWorker-1] [49033558-86aa-400a-b14d-f9fae0974a0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:28:00.256691487Z [2024-05-11 00:28:00,252: INFO/ForkPoolWorker-15] [29814fc9-9fa8-4495-9b88-edb8f8fb34b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:28:00.256711664Z [2024-05-11 00:28:00,249: INFO/ForkPoolWorker-16] [93d88597-21ab-45f9-9905-bcf1c42664ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:28:00.272044336Z [2024-05-11 00:28:00,271: INFO/ForkPoolWorker-2] [b92de09d-1926-4cd2-8042-670eb24c2b17] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:28:00.617830050Z [2024-05-11 00:28:00,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:28:00.628521779Z [2024-05-11 00:28:00,621: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:28:00.655358372Z [2024-05-11 00:28:00,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:28:00.773066421Z [2024-05-11 00:28:00,769: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:28:00.983152354Z [2024-05-11 00:28:00,982: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:28:00.986118704Z [2024-05-11 00:28:00,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:28:00.986798041Z [2024-05-11 00:28:00,986: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:28:01.028270794Z [2024-05-11 00:28:01,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:28:01.034552363Z [2024-05-11 00:28:01,030: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:28:01.034570078Z [2024-05-11 00:28:01,030: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:28:01.034574451Z [2024-05-11 00:28:01,030: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:28:01.034577857Z [2024-05-11 00:28:01,031: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:28:01.300936347Z [2024-05-11 00:28:01,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:28:01.690926445Z [2024-05-11 00:28:01,690: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93d88597-21ab-45f9-9905-bcf1c42664ca] succeeded in 1.4468434700002035s: None 2024-05-11T00:28:01.877653752Z [2024-05-11 00:28:01,877: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b92de09d-1926-4cd2-8042-670eb24c2b17] succeeded in 1.6130412229995272s: None 2024-05-11T00:28:02.059484107Z [2024-05-11 00:28:02,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:28:02.062882508Z [2024-05-11 00:28:02,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:28:02.083433107Z [2024-05-11 00:28:02,083: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:28:02.086927144Z [2024-05-11 00:28:02,086: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:28:02.087831310Z [2024-05-11 00:28:02,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:28:02.089144552Z [2024-05-11 00:28:02,088: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:28:02.089190624Z [2024-05-11 00:28:02,089: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:28:02.089311459Z [2024-05-11 00:28:02,089: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:28:02.089386204Z [2024-05-11 00:28:02,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:28:02.089609173Z [2024-05-11 00:28:02,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:28:02.089650277Z [2024-05-11 00:28:02,089: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:28:02.112344660Z [2024-05-11 00:28:02,112: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:28:02.114598135Z [2024-05-11 00:28:02,114: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:28:02.114926312Z [2024-05-11 00:28:02,114: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:28:02.115197590Z [2024-05-11 00:28:02,114: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:28:02.115360042Z [2024-05-11 00:28:02,115: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:28:02.115718942Z [2024-05-11 00:28:02,115: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:28:02.115882573Z [2024-05-11 00:28:02,115: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:28:02.162113978Z [2024-05-11 00:28:02,161: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:28:02.195914573Z [2024-05-11 00:28:02,195: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:28:03.719910807Z [2024-05-11 00:28:03,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29814fc9-9fa8-4495-9b88-edb8f8fb34b2] succeeded in 3.478195112999856s: None 2024-05-11T00:28:03.984139112Z [2024-05-11 00:28:03,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49033558-86aa-400a-b14d-f9fae0974a0a] succeeded in 3.7400560730002326s: None 2024-05-11T00:29:01.215038136Z [2024-05-11 00:29:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5c9f818-e5ed-4cf5-bdf2-40ad2f607497] received 2024-05-11T00:29:01.216550943Z [2024-05-11 00:29:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[000b5aa9-29f0-422d-936d-41934d7bf773] received 2024-05-11T00:29:01.223255455Z [2024-05-11 00:29:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[550e7d81-4c06-4538-9fc8-da8b39bcd7ca] received 2024-05-11T00:29:01.225976391Z [2024-05-11 00:29:01,225: INFO/ForkPoolWorker-16] [000b5aa9-29f0-422d-936d-41934d7bf773] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:29:01.228919219Z [2024-05-11 00:29:01,228: INFO/ForkPoolWorker-15] [d5c9f818-e5ed-4cf5-bdf2-40ad2f607497] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:29:01.238774420Z [2024-05-11 00:29:01,238: INFO/ForkPoolWorker-1] [550e7d81-4c06-4538-9fc8-da8b39bcd7ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:29:01.505379150Z [2024-05-11 00:29:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:29:01.509584063Z [2024-05-11 00:29:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:29:01.513656247Z [2024-05-11 00:29:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:29:01.662050587Z [2024-05-11 00:29:01,661: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:29:01.665997938Z [2024-05-11 00:29:01,665: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:29:01.690556907Z [2024-05-11 00:29:01,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:29:01.692070751Z [2024-05-11 00:29:01,691: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:29:01.692355501Z [2024-05-11 00:29:01,691: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:29:01.692569625Z [2024-05-11 00:29:01,692: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:29:01.692903389Z [2024-05-11 00:29:01,692: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:29:01.773235033Z [2024-05-11 00:29:01,772: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:29:02.401697000Z [2024-05-11 00:29:02,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[550e7d81-4c06-4538-9fc8-da8b39bcd7ca] succeeded in 1.1770014029998492s: None 2024-05-11T00:29:02.724218542Z [2024-05-11 00:29:02,723: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:29:02.727942207Z [2024-05-11 00:29:02,727: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:29:02.749716520Z [2024-05-11 00:29:02,749: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:29:02.751062531Z [2024-05-11 00:29:02,750: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:29:02.751100953Z [2024-05-11 00:29:02,750: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:29:02.751223443Z [2024-05-11 00:29:02,751: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:29:02.751231856Z [2024-05-11 00:29:02,751: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:29:02.751469119Z [2024-05-11 00:29:02,751: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:29:02.751478331Z [2024-05-11 00:29:02,751: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:29:02.760200602Z [2024-05-11 00:29:02,759: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:29:02.765500014Z [2024-05-11 00:29:02,764: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:29:02.784094783Z [2024-05-11 00:29:02,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:29:02.786102780Z [2024-05-11 00:29:02,785: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:29:02.786121499Z [2024-05-11 00:29:02,786: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:29:02.786248767Z [2024-05-11 00:29:02,786: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:29:02.786269877Z [2024-05-11 00:29:02,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:29:02.786538678Z [2024-05-11 00:29:02,786: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:29:02.786549806Z [2024-05-11 00:29:02,786: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:29:02.831763159Z [2024-05-11 00:29:02,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:29:02.868244026Z [2024-05-11 00:29:02,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:29:04.630220664Z [2024-05-11 00:29:04,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5c9f818-e5ed-4cf5-bdf2-40ad2f607497] succeeded in 3.4117946870001106s: None 2024-05-11T00:29:05.193983670Z [2024-05-11 00:29:05,193: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[000b5aa9-29f0-422d-936d-41934d7bf773] succeeded in 3.975892417999603s: None 2024-05-11T00:30:01.178631686Z [2024-05-11 00:30:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e951f62f-e7bd-4b12-8ab7-e166840d24de] received 2024-05-11T00:30:01.181528434Z [2024-05-11 00:30:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19c69421-5816-40c0-a132-53b02f0fb211] received 2024-05-11T00:30:01.196011989Z [2024-05-11 00:30:01,195: INFO/ForkPoolWorker-16] [19c69421-5816-40c0-a132-53b02f0fb211] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:30:01.206258360Z [2024-05-11 00:30:01,205: INFO/ForkPoolWorker-15] [e951f62f-e7bd-4b12-8ab7-e166840d24de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:01.210829606Z [2024-05-11 00:30:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a98f12b8-67f8-4cc0-aefe-0706d461c083] received 2024-05-11T00:30:01.212267746Z [2024-05-11 00:30:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[284ebb7a-0c56-448f-b7c5-481c82995a82] received 2024-05-11T00:30:01.215456564Z [2024-05-11 00:30:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8293f449-ce3d-4c07-8df7-f597857dd1de] received 2024-05-11T00:30:01.219669022Z [2024-05-11 00:30:01,219: INFO/ForkPoolWorker-1] [a98f12b8-67f8-4cc0-aefe-0706d461c083] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:30:01.236201109Z [2024-05-11 00:30:01,235: INFO/ForkPoolWorker-3] [8293f449-ce3d-4c07-8df7-f597857dd1de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:30:01.236739146Z [2024-05-11 00:30:01,236: INFO/ForkPoolWorker-2] [284ebb7a-0c56-448f-b7c5-481c82995a82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:30:01.687398515Z [2024-05-11 00:30:01,672: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:30:01.700606661Z [2024-05-11 00:30:01,685: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:30:01.787685794Z [2024-05-11 00:30:01,783: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:30:01.791718184Z [2024-05-11 00:30:01,784: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:30:01.830819524Z [2024-05-11 00:30:01,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:30:02.039306011Z [2024-05-11 00:30:02,038: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:30:02.047203674Z [2024-05-11 00:30:02,046: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:02.073912751Z [2024-05-11 00:30:02,073: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:30:02.076110708Z [2024-05-11 00:30:02,075: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:30:02.076450784Z [2024-05-11 00:30:02,076: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:30:02.076715580Z [2024-05-11 00:30:02,076: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:30:02.077441216Z [2024-05-11 00:30:02,077: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:30:02.175636442Z [2024-05-11 00:30:02,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:02.258648742Z [2024-05-11 00:30:02,258: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:03.028650290Z [2024-05-11 00:30:03,028: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a98f12b8-67f8-4cc0-aefe-0706d461c083] succeeded in 1.8150417979995837s: None 2024-05-11T00:30:03.042487902Z [2024-05-11 00:30:03,042: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19c69421-5816-40c0-a132-53b02f0fb211] succeeded in 1.8587946799998463s: None 2024-05-11T00:30:03.441904560Z [2024-05-11 00:30:03,441: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:30:03.445822302Z [2024-05-11 00:30:03,445: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:03.484011869Z [2024-05-11 00:30:03,481: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:30:03.493985614Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:03.494014831Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:03.494019517Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:03.494023963Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:30:03.494027076Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:30:03.494030114Z [2024-05-11 00:30:03,488: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:03.510031352Z [2024-05-11 00:30:03,502: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T00:30:03.510062755Z [2024-05-11 00:30:03,506: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:03.547025979Z [2024-05-11 00:30:03,546: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T00:30:03.550181843Z [2024-05-11 00:30:03,549: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:03.550230637Z [2024-05-11 00:30:03,550: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:03.550345421Z [2024-05-11 00:30:03,550: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:03.550376223Z [2024-05-11 00:30:03,550: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T00:30:03.550726578Z [2024-05-11 00:30:03,550: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:30:03.550808175Z [2024-05-11 00:30:03,550: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:03.612440227Z [2024-05-11 00:30:03,611: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:03.660297255Z [2024-05-11 00:30:03,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:30:03.662113479Z [2024-05-11 00:30:03,661: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:03.665801026Z [2024-05-11 00:30:03,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:03.696259711Z [2024-05-11 00:30:03,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:30:03.698797217Z [2024-05-11 00:30:03,698: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:03.698911862Z [2024-05-11 00:30:03,698: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:03.699157677Z [2024-05-11 00:30:03,698: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:03.699256495Z [2024-05-11 00:30:03,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:30:03.699633455Z [2024-05-11 00:30:03,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:30:03.700106850Z [2024-05-11 00:30:03,699: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:03.800473664Z [2024-05-11 00:30:03,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:04.510316507Z [2024-05-11 00:30:04,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e951f62f-e7bd-4b12-8ab7-e166840d24de] succeeded in 3.318448905999503s: None 2024-05-11T00:30:05.240145387Z [2024-05-11 00:30:05,239: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8293f449-ce3d-4c07-8df7-f597857dd1de] succeeded in 4.022208303999832s: None 2024-05-11T00:30:05.307535291Z [2024-05-11 00:30:05,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25dee330-54fd-48a5-8ea9-e79c9a3efa98] received 2024-05-11T00:30:05.319521746Z [2024-05-11 00:30:05,319: INFO/ForkPoolWorker-15] [25dee330-54fd-48a5-8ea9-e79c9a3efa98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:05.576953992Z [2024-05-11 00:30:05,576: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[284ebb7a-0c56-448f-b7c5-481c82995a82] succeeded in 4.3623301779998656s: None 2024-05-11T00:30:05.630749216Z [2024-05-11 00:30:05,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:30:06.748067921Z [2024-05-11 00:30:06,747: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:30:06.756667146Z [2024-05-11 00:30:06,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:06.777067332Z [2024-05-11 00:30:06,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:30:06.778866204Z [2024-05-11 00:30:06,777: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:06.778881781Z [2024-05-11 00:30:06,777: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:06.778892387Z [2024-05-11 00:30:06,777: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:06.778898741Z [2024-05-11 00:30:06,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:30:06.778903270Z [2024-05-11 00:30:06,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:30:06.778908563Z [2024-05-11 00:30:06,778: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:06.865590196Z [2024-05-11 00:30:06,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:07.545574669Z [2024-05-11 00:30:07,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25dee330-54fd-48a5-8ea9-e79c9a3efa98] succeeded in 2.2332448910001403s: None 2024-05-11T00:30:07.756071064Z [2024-05-11 00:30:07,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe9cac07-ab02-415e-84ed-4e853e4e7ea7] received 2024-05-11T00:30:07.767377097Z [2024-05-11 00:30:07,767: INFO/ForkPoolWorker-15] [fe9cac07-ab02-415e-84ed-4e853e4e7ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:30:08.053498210Z [2024-05-11 00:30:08,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:30:09.306238917Z [2024-05-11 00:30:09,305: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:30:09.309830957Z [2024-05-11 00:30:09,309: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:09.329098681Z [2024-05-11 00:30:09,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:30:09.330659819Z [2024-05-11 00:30:09,330: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:09.330762416Z [2024-05-11 00:30:09,330: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:09.330928484Z [2024-05-11 00:30:09,330: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:09.331005598Z [2024-05-11 00:30:09,330: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:30:09.331310212Z [2024-05-11 00:30:09,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:30:09.331333545Z [2024-05-11 00:30:09,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:09.428430424Z [2024-05-11 00:30:09,428: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:10.080313789Z [2024-05-11 00:30:10,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe9cac07-ab02-415e-84ed-4e853e4e7ea7] succeeded in 2.3198401210001975s: None 2024-05-11T00:30:10.516967079Z [2024-05-11 00:30:10,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f61ef71-0033-4211-bf90-14cfb5fcc4c6] received 2024-05-11T00:30:10.524147092Z [2024-05-11 00:30:10,523: INFO/ForkPoolWorker-15] [7f61ef71-0033-4211-bf90-14cfb5fcc4c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:30:10.828503868Z [2024-05-11 00:30:10,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:30:12.154045951Z [2024-05-11 00:30:12,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:30:12.157754747Z [2024-05-11 00:30:12,157: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:30:12.184984583Z [2024-05-11 00:30:12,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:30:12.186559934Z [2024-05-11 00:30:12,186: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:30:12.186617954Z [2024-05-11 00:30:12,186: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:30:12.186796231Z [2024-05-11 00:30:12,186: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:30:12.186850041Z [2024-05-11 00:30:12,186: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:30:12.187162498Z [2024-05-11 00:30:12,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:30:12.187230269Z [2024-05-11 00:30:12,187: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:30:12.294455737Z [2024-05-11 00:30:12,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:30:12.946501539Z [2024-05-11 00:30:12,945: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f61ef71-0033-4211-bf90-14cfb5fcc4c6] succeeded in 2.4267185810003866s: None 2024-05-11T00:31:01.215420854Z [2024-05-11 00:31:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fb953fd-1dd2-4263-aefc-549d4d3fbc49] received 2024-05-11T00:31:01.218630039Z [2024-05-11 00:31:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a436fd0-58e2-4ee6-9877-f28abaf5162b] received 2024-05-11T00:31:01.228185806Z [2024-05-11 00:31:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27465ec0-494f-4759-a1bb-95f9e82c75d5] received 2024-05-11T00:31:01.231875020Z [2024-05-11 00:31:01,231: INFO/ForkPoolWorker-16] [3a436fd0-58e2-4ee6-9877-f28abaf5162b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:31:01.234846212Z [2024-05-11 00:31:01,234: INFO/ForkPoolWorker-15] [7fb953fd-1dd2-4263-aefc-549d4d3fbc49] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:31:01.240280207Z [2024-05-11 00:31:01,240: INFO/ForkPoolWorker-1] [27465ec0-494f-4759-a1bb-95f9e82c75d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:31:01.509911486Z [2024-05-11 00:31:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:31:01.547360615Z [2024-05-11 00:31:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:31:01.563520868Z [2024-05-11 00:31:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:31:01.726644723Z [2024-05-11 00:31:01,726: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:31:01.730668437Z [2024-05-11 00:31:01,730: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:31:01.752992301Z [2024-05-11 00:31:01,752: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:31:01.754314257Z [2024-05-11 00:31:01,754: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:31:01.754507144Z [2024-05-11 00:31:01,754: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:31:01.754615921Z [2024-05-11 00:31:01,754: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:31:01.754883665Z [2024-05-11 00:31:01,754: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:31:01.884335363Z [2024-05-11 00:31:01,884: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:31:02.475120089Z [2024-05-11 00:31:02,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fb953fd-1dd2-4263-aefc-549d4d3fbc49] succeeded in 1.2530189730005077s: None 2024-05-11T00:31:02.672422543Z [2024-05-11 00:31:02,672: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:31:02.675864723Z [2024-05-11 00:31:02,675: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:31:02.697160560Z [2024-05-11 00:31:02,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:31:02.698782345Z [2024-05-11 00:31:02,698: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:31:02.698936716Z [2024-05-11 00:31:02,698: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:31:02.699131778Z [2024-05-11 00:31:02,698: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:31:02.699245335Z [2024-05-11 00:31:02,699: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:31:02.699592871Z [2024-05-11 00:31:02,699: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:31:02.699737486Z [2024-05-11 00:31:02,699: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:31:02.758630766Z [2024-05-11 00:31:02,758: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:31:02.761739180Z [2024-05-11 00:31:02,761: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:31:02.783460624Z [2024-05-11 00:31:02,783: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:31:02.784509638Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:31:02.784529716Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:31:02.784666906Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:31:02.784681024Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:31:02.785000869Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:31:02.785016763Z [2024-05-11 00:31:02,784: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:31:02.791828311Z [2024-05-11 00:31:02,791: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:31:02.888810772Z [2024-05-11 00:31:02,888: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:31:04.521281293Z [2024-05-11 00:31:04,520: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a436fd0-58e2-4ee6-9877-f28abaf5162b] succeeded in 3.2984308159993816s: None 2024-05-11T00:31:06.149957261Z [2024-05-11 00:31:06,149: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27465ec0-494f-4759-a1bb-95f9e82c75d5] succeeded in 4.918878120000954s: None 2024-05-11T00:32:01.145234972Z [2024-05-11 00:32:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0e644cc-6e32-4936-b385-de7bb93db356] received 2024-05-11T00:32:01.147543547Z [2024-05-11 00:32:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bda2953-64da-4667-8465-c0d41097498a] received 2024-05-11T00:32:01.156329332Z [2024-05-11 00:32:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09557385-099f-4bf3-9c15-f5094d91849d] received 2024-05-11T00:32:01.159625282Z [2024-05-11 00:32:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8804a150-96f4-417d-b09c-fcf067641d97] received 2024-05-11T00:32:01.163624732Z [2024-05-11 00:32:01,163: INFO/ForkPoolWorker-15] [d0e644cc-6e32-4936-b385-de7bb93db356] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:32:01.167991078Z [2024-05-11 00:32:01,167: INFO/ForkPoolWorker-1] [09557385-099f-4bf3-9c15-f5094d91849d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:32:01.173699576Z [2024-05-11 00:32:01,173: INFO/ForkPoolWorker-2] [8804a150-96f4-417d-b09c-fcf067641d97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:32:01.192037803Z [2024-05-11 00:32:01,191: INFO/ForkPoolWorker-16] [8bda2953-64da-4667-8465-c0d41097498a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:32:01.510108169Z [2024-05-11 00:32:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:32:01.521983200Z [2024-05-11 00:32:01,518: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:32:01.551216638Z [2024-05-11 00:32:01,548: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:32:01.635522544Z [2024-05-11 00:32:01,632: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:32:01.705825045Z [2024-05-11 00:32:01,705: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:32:01.710603893Z [2024-05-11 00:32:01,710: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:32:01.735277224Z [2024-05-11 00:32:01,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:32:01.737255906Z [2024-05-11 00:32:01,737: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:32:01.737406489Z [2024-05-11 00:32:01,737: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:32:01.737474991Z [2024-05-11 00:32:01,737: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:32:01.737755497Z [2024-05-11 00:32:01,737: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:32:01.839572867Z [2024-05-11 00:32:01,839: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:32:01.841973751Z [2024-05-11 00:32:01,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:32:02.389028879Z [2024-05-11 00:32:02,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bda2953-64da-4667-8465-c0d41097498a] succeeded in 1.234224580000955s: None 2024-05-11T00:32:02.541282822Z [2024-05-11 00:32:02,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0e644cc-6e32-4936-b385-de7bb93db356] succeeded in 1.3913639420006803s: None 2024-05-11T00:32:02.745926618Z [2024-05-11 00:32:02,745: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:32:02.749222748Z [2024-05-11 00:32:02,748: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:32:02.778614397Z [2024-05-11 00:32:02,778: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:32:02.780422062Z [2024-05-11 00:32:02,780: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:32:02.780596085Z [2024-05-11 00:32:02,780: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:32:02.780886816Z [2024-05-11 00:32:02,780: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:32:02.781035111Z [2024-05-11 00:32:02,780: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:32:02.781484487Z [2024-05-11 00:32:02,781: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:32:02.781642411Z [2024-05-11 00:32:02,781: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:32:02.811670040Z [2024-05-11 00:32:02,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:32:02.820802994Z [2024-05-11 00:32:02,820: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:32:02.852612718Z [2024-05-11 00:32:02,852: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:32:02.856099163Z [2024-05-11 00:32:02,854: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:32:02.858179736Z [2024-05-11 00:32:02,857: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:32:02.858737560Z [2024-05-11 00:32:02,858: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:32:02.858891811Z [2024-05-11 00:32:02,858: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:32:02.859297024Z [2024-05-11 00:32:02,859: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:32:02.859428608Z [2024-05-11 00:32:02,859: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:32:02.908119745Z [2024-05-11 00:32:02,907: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:32:02.949189980Z [2024-05-11 00:32:02,948: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:32:04.444145252Z [2024-05-11 00:32:04,443: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8804a150-96f4-417d-b09c-fcf067641d97] succeeded in 3.2772778119997383s: None 2024-05-11T00:32:04.696123026Z [2024-05-11 00:32:04,695: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[09557385-099f-4bf3-9c15-f5094d91849d] succeeded in 3.535231923000538s: None 2024-05-11T00:33:01.170154461Z [2024-05-11 00:33:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81e4828f-bb5a-45fb-8a8f-82aad0e50d72] received 2024-05-11T00:33:01.170911360Z [2024-05-11 00:33:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20cf5b64-e9d3-4388-aeee-e73641a50f11] received 2024-05-11T00:33:01.192411377Z [2024-05-11 00:33:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca67b0d1-a191-45f2-b271-92f1fd8025d1] received 2024-05-11T00:33:01.220782307Z [2024-05-11 00:33:01,220: INFO/ForkPoolWorker-16] [20cf5b64-e9d3-4388-aeee-e73641a50f11] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:33:01.237991602Z [2024-05-11 00:33:01,237: INFO/ForkPoolWorker-1] [ca67b0d1-a191-45f2-b271-92f1fd8025d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:33:01.249202705Z [2024-05-11 00:33:01,248: INFO/ForkPoolWorker-15] [81e4828f-bb5a-45fb-8a8f-82aad0e50d72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:33:01.559563963Z [2024-05-11 00:33:01,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:33:01.570024400Z [2024-05-11 00:33:01,566: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:33:01.589144864Z [2024-05-11 00:33:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:33:01.728982871Z [2024-05-11 00:33:01,728: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:33:01.733573590Z [2024-05-11 00:33:01,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:33:01.764756167Z [2024-05-11 00:33:01,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:33:01.771326520Z [2024-05-11 00:33:01,770: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:33:01.771695744Z [2024-05-11 00:33:01,771: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:33:01.772632724Z [2024-05-11 00:33:01,772: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:33:01.774242631Z [2024-05-11 00:33:01,773: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:33:01.938486366Z [2024-05-11 00:33:01,938: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:33:02.681750474Z [2024-05-11 00:33:02,681: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20cf5b64-e9d3-4388-aeee-e73641a50f11] succeeded in 1.5063086110003496s: None 2024-05-11T00:33:02.788441994Z [2024-05-11 00:33:02,788: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:33:02.791804972Z [2024-05-11 00:33:02,791: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:33:02.823037828Z [2024-05-11 00:33:02,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:33:02.824746618Z [2024-05-11 00:33:02,824: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:33:02.824970073Z [2024-05-11 00:33:02,824: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:33:02.825307849Z [2024-05-11 00:33:02,824: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:33:02.825347350Z [2024-05-11 00:33:02,825: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:33:02.825636604Z [2024-05-11 00:33:02,825: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:33:02.825902184Z [2024-05-11 00:33:02,825: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:33:02.911096387Z [2024-05-11 00:33:02,910: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:33:02.944743037Z [2024-05-11 00:33:02,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:33:02.948579145Z [2024-05-11 00:33:02,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:33:02.972464597Z [2024-05-11 00:33:02,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:33:02.974097457Z [2024-05-11 00:33:02,973: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:33:02.974120018Z [2024-05-11 00:33:02,974: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:33:02.974288659Z [2024-05-11 00:33:02,974: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:33:02.974317961Z [2024-05-11 00:33:02,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:33:02.974715197Z [2024-05-11 00:33:02,974: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:33:02.974820334Z [2024-05-11 00:33:02,974: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:33:03.079446330Z [2024-05-11 00:33:03,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:33:04.657978427Z [2024-05-11 00:33:04,657: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca67b0d1-a191-45f2-b271-92f1fd8025d1] succeeded in 3.446705447999193s: None 2024-05-11T00:33:06.697660420Z [2024-05-11 00:33:06,696: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81e4828f-bb5a-45fb-8a8f-82aad0e50d72] succeeded in 5.532277554999382s: None 2024-05-11T00:34:00.707426990Z [2024-05-11 00:34:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70242243-4179-4e32-83cf-3bec87ddc6a7] received 2024-05-11T00:34:00.709547809Z [2024-05-11 00:34:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a745486-65cc-46b1-bca9-564afb01f030] received 2024-05-11T00:34:00.717830202Z [2024-05-11 00:34:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42c3e5e4-1336-4097-8d06-309090de0d72] received 2024-05-11T00:34:00.720894139Z [2024-05-11 00:34:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fe32e51-c526-4a5b-a86b-03d2475430d1] received 2024-05-11T00:34:00.731585695Z [2024-05-11 00:34:00,731: INFO/ForkPoolWorker-2] [3fe32e51-c526-4a5b-a86b-03d2475430d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:34:00.734748757Z [2024-05-11 00:34:00,734: INFO/ForkPoolWorker-1] [42c3e5e4-1336-4097-8d06-309090de0d72] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:34:00.735496800Z [2024-05-11 00:34:00,735: INFO/ForkPoolWorker-16] [8a745486-65cc-46b1-bca9-564afb01f030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:34:00.737117273Z [2024-05-11 00:34:00,736: INFO/ForkPoolWorker-15] [70242243-4179-4e32-83cf-3bec87ddc6a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:34:01.245018692Z [2024-05-11 00:34:01,241: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:34:01.434078842Z [2024-05-11 00:34:01,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:34:01.609037671Z [2024-05-11 00:34:01,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:34:01.726216876Z [2024-05-11 00:34:01,721: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:34:01.767340687Z [2024-05-11 00:34:01,767: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:34:01.851257196Z [2024-05-11 00:34:01,850: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:34:01.855375232Z [2024-05-11 00:34:01,854: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:34:01.900308717Z [2024-05-11 00:34:01,900: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:34:01.914778200Z [2024-05-11 00:34:01,914: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:34:01.914915746Z [2024-05-11 00:34:01,914: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:34:01.914982241Z [2024-05-11 00:34:01,914: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:34:01.915328332Z [2024-05-11 00:34:01,915: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:34:02.124743362Z [2024-05-11 00:34:02,124: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:34:02.567018625Z [2024-05-11 00:34:02,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70242243-4179-4e32-83cf-3bec87ddc6a7] succeeded in 1.8562899230000767s: None 2024-05-11T00:34:02.923344660Z [2024-05-11 00:34:02,922: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42c3e5e4-1336-4097-8d06-309090de0d72] succeeded in 2.2020020149993798s: None 2024-05-11T00:34:03.271098237Z [2024-05-11 00:34:03,270: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:34:03.275022301Z [2024-05-11 00:34:03,274: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:34:03.298529370Z [2024-05-11 00:34:03,298: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:34:03.300030703Z [2024-05-11 00:34:03,299: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:34:03.300184799Z [2024-05-11 00:34:03,300: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:34:03.300396371Z [2024-05-11 00:34:03,300: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:34:03.300526565Z [2024-05-11 00:34:03,300: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:34:03.300778986Z [2024-05-11 00:34:03,300: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:34:03.300883887Z [2024-05-11 00:34:03,300: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:34:03.390546297Z [2024-05-11 00:34:03,390: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:34:03.410440884Z [2024-05-11 00:34:03,410: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:34:03.413887859Z [2024-05-11 00:34:03,413: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:34:03.446810391Z [2024-05-11 00:34:03,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:34:03.448375222Z [2024-05-11 00:34:03,448: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:34:03.448576979Z [2024-05-11 00:34:03,448: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:34:03.448842793Z [2024-05-11 00:34:03,448: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:34:03.449038218Z [2024-05-11 00:34:03,448: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:34:03.449378400Z [2024-05-11 00:34:03,449: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:34:03.449594453Z [2024-05-11 00:34:03,449: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:34:03.599977577Z [2024-05-11 00:34:03,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:34:05.204056327Z [2024-05-11 00:34:05,203: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3fe32e51-c526-4a5b-a86b-03d2475430d1] succeeded in 4.480952593999973s: None 2024-05-11T00:34:05.550119167Z [2024-05-11 00:34:05,549: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a745486-65cc-46b1-bca9-564afb01f030] succeeded in 4.837261557000602s: None 2024-05-11T00:35:00.450746942Z [2024-05-11 00:35:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6fd8028-bde5-43f4-a7c8-c9c9d0c262dd] received 2024-05-11T00:35:00.459164504Z [2024-05-11 00:35:00,458: INFO/ForkPoolWorker-15] [d6fd8028-bde5-43f4-a7c8-c9c9d0c262dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:00.462461460Z [2024-05-11 00:35:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2fcbdd9-27bf-457a-ac0d-0195404406de] received 2024-05-11T00:35:00.467957782Z [2024-05-11 00:35:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72912b0a-577d-4bb3-99a9-40dd29e195ba] received 2024-05-11T00:35:00.470596413Z [2024-05-11 00:35:00,470: INFO/ForkPoolWorker-16] [d2fcbdd9-27bf-457a-ac0d-0195404406de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:35:00.473433955Z [2024-05-11 00:35:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ba27f4b-cef7-4f25-9db6-34ee9afc0b60] received 2024-05-11T00:35:00.486277195Z [2024-05-11 00:35:00,486: INFO/ForkPoolWorker-2] [5ba27f4b-cef7-4f25-9db6-34ee9afc0b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:35:00.486443282Z [2024-05-11 00:35:00,485: INFO/ForkPoolWorker-1] [72912b0a-577d-4bb3-99a9-40dd29e195ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:35:00.793972136Z [2024-05-11 00:35:00,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:35:00.795300836Z [2024-05-11 00:35:00,790: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:35:00.816090217Z [2024-05-11 00:35:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:35:00.920191943Z [2024-05-11 00:35:00,915: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:35:01.037958502Z [2024-05-11 00:35:01,031: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:35:01.082028975Z [2024-05-11 00:35:01,078: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:01.216826825Z [2024-05-11 00:35:01,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:35:01.217835752Z [2024-05-11 00:35:01,217: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:35:01.217939490Z [2024-05-11 00:35:01,217: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:35:01.217947042Z [2024-05-11 00:35:01,217: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:35:01.218148498Z [2024-05-11 00:35:01,218: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:35:01.382693843Z [2024-05-11 00:35:01,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:02.088133439Z [2024-05-11 00:35:02,087: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72912b0a-577d-4bb3-99a9-40dd29e195ba] succeeded in 1.6133922760000132s: None 2024-05-11T00:35:02.176510533Z [2024-05-11 00:35:02,176: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:35:02.180166935Z [2024-05-11 00:35:02,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:02.219616652Z [2024-05-11 00:35:02,219: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:35:02.223617559Z [2024-05-11 00:35:02,223: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:02.223791105Z [2024-05-11 00:35:02,223: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:02.224003381Z [2024-05-11 00:35:02,223: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:02.224138474Z [2024-05-11 00:35:02,224: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:35:02.224493914Z [2024-05-11 00:35:02,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:35:02.225067388Z [2024-05-11 00:35:02,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:02.268485216Z [2024-05-11 00:35:02,268: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:35:02.272042943Z [2024-05-11 00:35:02,271: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:02.306276223Z [2024-05-11 00:35:02,306: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:35:02.308268122Z [2024-05-11 00:35:02,307: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:02.308560965Z [2024-05-11 00:35:02,308: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:02.308847987Z [2024-05-11 00:35:02,308: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:02.310120994Z [2024-05-11 00:35:02,309: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:35:02.310436818Z [2024-05-11 00:35:02,310: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:35:02.310545257Z [2024-05-11 00:35:02,310: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:02.356696786Z [2024-05-11 00:35:02,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:02.379720941Z [2024-05-11 00:35:02,378: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:35:02.383499558Z [2024-05-11 00:35:02,383: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:02.408413759Z [2024-05-11 00:35:02,408: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:35:02.411178860Z [2024-05-11 00:35:02,410: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:02.412159680Z [2024-05-11 00:35:02,411: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:02.412338052Z [2024-05-11 00:35:02,412: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:02.412584248Z [2024-05-11 00:35:02,412: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:02.412614684Z [2024-05-11 00:35:02,412: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:35:02.413040395Z [2024-05-11 00:35:02,412: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:35:02.413273874Z [2024-05-11 00:35:02,412: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:02.523974715Z [2024-05-11 00:35:02,523: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:03.111026544Z [2024-05-11 00:35:03,110: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6fd8028-bde5-43f4-a7c8-c9c9d0c262dd] succeeded in 2.658368884000083s: None 2024-05-11T00:35:03.215609846Z [2024-05-11 00:35:03,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e262d694-c9da-451f-9976-3eb219d019e1] received 2024-05-11T00:35:03.223994740Z [2024-05-11 00:35:03,223: INFO/ForkPoolWorker-15] [e262d694-c9da-451f-9976-3eb219d019e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:03.524185927Z [2024-05-11 00:35:03,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:35:03.869927505Z [2024-05-11 00:35:03,869: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5ba27f4b-cef7-4f25-9db6-34ee9afc0b60] succeeded in 3.3914686900006927s: None 2024-05-11T00:35:04.378137883Z [2024-05-11 00:35:04,377: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2fcbdd9-27bf-457a-ac0d-0195404406de] succeeded in 3.9135067560000607s: None 2024-05-11T00:35:04.666327645Z [2024-05-11 00:35:04,665: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:35:04.669575431Z [2024-05-11 00:35:04,669: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:04.694140134Z [2024-05-11 00:35:04,693: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:35:04.695423174Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:04.695443612Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:04.695583253Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:04.695595497Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:35:04.695895548Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:35:04.695900425Z [2024-05-11 00:35:04,695: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:04.792322358Z [2024-05-11 00:35:04,791: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:05.583234929Z [2024-05-11 00:35:05,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e262d694-c9da-451f-9976-3eb219d019e1] succeeded in 2.3652485940001498s: None 2024-05-11T00:35:05.625326072Z [2024-05-11 00:35:05,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[446267c3-898a-4631-8803-091a3796a2e6] received 2024-05-11T00:35:05.634059083Z [2024-05-11 00:35:05,633: INFO/ForkPoolWorker-15] [446267c3-898a-4631-8803-091a3796a2e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:35:05.955004070Z [2024-05-11 00:35:05,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:35:07.524912811Z [2024-05-11 00:35:07,524: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:35:07.529019551Z [2024-05-11 00:35:07,528: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:07.549030540Z [2024-05-11 00:35:07,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:35:07.550302189Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:07.550326828Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:07.550566478Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:07.550576611Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:35:07.550839281Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:35:07.550916113Z [2024-05-11 00:35:07,550: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:07.639442049Z [2024-05-11 00:35:07,639: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:08.274796067Z [2024-05-11 00:35:08,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[446267c3-898a-4631-8803-091a3796a2e6] succeeded in 2.646743264000179s: None 2024-05-11T00:35:08.383949143Z [2024-05-11 00:35:08,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5719719c-db77-4528-a1c7-4a070879852c] received 2024-05-11T00:35:08.390691849Z [2024-05-11 00:35:08,390: INFO/ForkPoolWorker-15] [5719719c-db77-4528-a1c7-4a070879852c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:35:08.643302675Z [2024-05-11 00:35:08,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:35:09.743027960Z [2024-05-11 00:35:09,742: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:35:09.746388302Z [2024-05-11 00:35:09,745: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:35:09.781649778Z [2024-05-11 00:35:09,781: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:35:09.786829404Z [2024-05-11 00:35:09,786: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:35:09.786858410Z [2024-05-11 00:35:09,786: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:35:09.786977276Z [2024-05-11 00:35:09,786: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:35:09.786993125Z [2024-05-11 00:35:09,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:35:09.787239580Z [2024-05-11 00:35:09,787: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:35:09.787269236Z [2024-05-11 00:35:09,787: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:35:09.877954448Z [2024-05-11 00:35:09,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:35:10.409295048Z [2024-05-11 00:35:10,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5719719c-db77-4528-a1c7-4a070879852c] succeeded in 2.0227957090010023s: None 2024-05-11T00:36:00.476066975Z [2024-05-11 00:36:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5324887-399b-48bd-98e5-7d62d9f63d09] received 2024-05-11T00:36:00.479074221Z [2024-05-11 00:36:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b94d21c-4d3d-4997-a0b9-e22eea782ff1] received 2024-05-11T00:36:00.481350458Z [2024-05-11 00:36:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87c237e9-7450-4ba4-b418-89700cf19ec2] received 2024-05-11T00:36:00.481973258Z [2024-05-11 00:36:00,481: INFO/ForkPoolWorker-15] [d5324887-399b-48bd-98e5-7d62d9f63d09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:36:00.485068062Z [2024-05-11 00:36:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0323110-76a0-413e-abdd-7b98b86b1b23] received 2024-05-11T00:36:00.502011152Z [2024-05-11 00:36:00,501: INFO/ForkPoolWorker-1] [87c237e9-7450-4ba4-b418-89700cf19ec2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:36:00.502657065Z [2024-05-11 00:36:00,502: INFO/ForkPoolWorker-16] [3b94d21c-4d3d-4997-a0b9-e22eea782ff1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:36:00.505779713Z [2024-05-11 00:36:00,505: INFO/ForkPoolWorker-2] [f0323110-76a0-413e-abdd-7b98b86b1b23] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:36:00.807565240Z [2024-05-11 00:36:00,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:36:00.807604446Z [2024-05-11 00:36:00,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:36:00.852239481Z [2024-05-11 00:36:00,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:36:00.977335719Z [2024-05-11 00:36:00,974: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:36:01.177775987Z [2024-05-11 00:36:01,177: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:36:01.325584948Z [2024-05-11 00:36:01,325: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:36:01.330139356Z [2024-05-11 00:36:01,329: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:36:01.357744335Z [2024-05-11 00:36:01,357: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:36:01.359838103Z [2024-05-11 00:36:01,359: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:36:01.360213803Z [2024-05-11 00:36:01,359: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:36:01.360354770Z [2024-05-11 00:36:01,360: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:36:01.360858093Z [2024-05-11 00:36:01,360: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:36:01.492959540Z [2024-05-11 00:36:01,492: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:36:01.909918581Z [2024-05-11 00:36:01,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b94d21c-4d3d-4997-a0b9-e22eea782ff1] succeeded in 1.4248772640003153s: None 2024-05-11T00:36:02.068869545Z [2024-05-11 00:36:02,068: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f0323110-76a0-413e-abdd-7b98b86b1b23] succeeded in 1.5809219279999525s: None 2024-05-11T00:36:02.263555495Z [2024-05-11 00:36:02,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:36:02.263581337Z [2024-05-11 00:36:02,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:36:02.290770068Z [2024-05-11 00:36:02,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:36:02.292001806Z [2024-05-11 00:36:02,291: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:36:02.292159731Z [2024-05-11 00:36:02,291: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:36:02.292352676Z [2024-05-11 00:36:02,292: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:36:02.292510687Z [2024-05-11 00:36:02,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:36:02.293064885Z [2024-05-11 00:36:02,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:36:02.293254116Z [2024-05-11 00:36:02,293: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:36:02.378717008Z [2024-05-11 00:36:02,378: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:36:02.381818851Z [2024-05-11 00:36:02,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:36:02.400917723Z [2024-05-11 00:36:02,400: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:36:02.401431718Z [2024-05-11 00:36:02,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:36:02.402160780Z [2024-05-11 00:36:02,401: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:36:02.402169564Z [2024-05-11 00:36:02,402: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:36:02.402308006Z [2024-05-11 00:36:02,402: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:36:02.402665837Z [2024-05-11 00:36:02,402: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:36:02.403072102Z [2024-05-11 00:36:02,402: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:36:02.403080734Z [2024-05-11 00:36:02,402: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:36:02.481817646Z [2024-05-11 00:36:02,481: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:36:03.748194163Z [2024-05-11 00:36:03,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5324887-399b-48bd-98e5-7d62d9f63d09] succeeded in 3.270507073000772s: None 2024-05-11T00:36:04.443982404Z [2024-05-11 00:36:04,443: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87c237e9-7450-4ba4-b418-89700cf19ec2] succeeded in 3.9491485559992725s: None 2024-05-11T00:37:00.384947702Z [2024-05-11 00:37:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bebf221a-8a6d-4650-9ec6-ab9efc3a092d] received 2024-05-11T00:37:00.388458417Z [2024-05-11 00:37:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[190c81bc-15c8-403e-a546-f29a53a3cbac] received 2024-05-11T00:37:00.394771795Z [2024-05-11 00:37:00,394: INFO/ForkPoolWorker-15] [bebf221a-8a6d-4650-9ec6-ab9efc3a092d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:37:00.395371785Z [2024-05-11 00:37:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d0327d2-e315-47e7-9b35-f9ce4f6808fc] received 2024-05-11T00:37:00.402018383Z [2024-05-11 00:37:00,401: INFO/ForkPoolWorker-1] [4d0327d2-e315-47e7-9b35-f9ce4f6808fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:37:00.403747294Z [2024-05-11 00:37:00,403: INFO/ForkPoolWorker-16] [190c81bc-15c8-403e-a546-f29a53a3cbac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:37:00.699831371Z [2024-05-11 00:37:00,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:37:00.701351310Z [2024-05-11 00:37:00,695: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:37:00.707771913Z [2024-05-11 00:37:00,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:37:00.874380951Z [2024-05-11 00:37:00,873: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:37:00.879190295Z [2024-05-11 00:37:00,878: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:37:00.904865724Z [2024-05-11 00:37:00,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:37:00.906435487Z [2024-05-11 00:37:00,906: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:37:00.906730843Z [2024-05-11 00:37:00,906: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:37:00.906920828Z [2024-05-11 00:37:00,906: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:37:00.908260325Z [2024-05-11 00:37:00,908: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:37:00.990624157Z [2024-05-11 00:37:00,990: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:37:01.665139157Z [2024-05-11 00:37:01,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[190c81bc-15c8-403e-a546-f29a53a3cbac] succeeded in 1.2750574909987336s: None 2024-05-11T00:37:01.951864546Z [2024-05-11 00:37:01,951: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:37:01.955515116Z [2024-05-11 00:37:01,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:37:01.983807619Z [2024-05-11 00:37:01,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:37:01.985015432Z [2024-05-11 00:37:01,984: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:37:01.985032772Z [2024-05-11 00:37:01,984: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:37:01.985274567Z [2024-05-11 00:37:01,985: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:37:01.985344623Z [2024-05-11 00:37:01,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:37:01.985632351Z [2024-05-11 00:37:01,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:37:01.986164664Z [2024-05-11 00:37:01,985: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:37:01.990485716Z [2024-05-11 00:37:01,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:37:01.993804197Z [2024-05-11 00:37:01,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:37:02.015597769Z [2024-05-11 00:37:02,015: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:37:02.016867483Z [2024-05-11 00:37:02,016: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:37:02.016955415Z [2024-05-11 00:37:02,016: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:37:02.017112212Z [2024-05-11 00:37:02,016: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:37:02.017195824Z [2024-05-11 00:37:02,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:37:02.017469657Z [2024-05-11 00:37:02,017: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:37:02.017534548Z [2024-05-11 00:37:02,017: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:37:02.085979628Z [2024-05-11 00:37:02,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:37:02.111099233Z [2024-05-11 00:37:02,110: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:37:03.678846297Z [2024-05-11 00:37:03,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bebf221a-8a6d-4650-9ec6-ab9efc3a092d] succeeded in 3.2881527000008646s: None 2024-05-11T00:37:04.259144555Z [2024-05-11 00:37:04,258: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d0327d2-e315-47e7-9b35-f9ce4f6808fc] succeeded in 3.861984739000036s: None 2024-05-11T00:38:00.855227931Z [2024-05-11 00:38:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[365268fe-5cbd-4460-bc22-11d8fe936996] received 2024-05-11T00:38:00.862602732Z [2024-05-11 00:38:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e218bcd9-9614-4867-a3f6-d480342efd28] received 2024-05-11T00:38:00.865198743Z [2024-05-11 00:38:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ec8affb-2abd-4e22-be6c-8382cbf1f180] received 2024-05-11T00:38:00.867004084Z [2024-05-11 00:38:00,866: INFO/ForkPoolWorker-15] [365268fe-5cbd-4460-bc22-11d8fe936996] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:38:00.867909931Z [2024-05-11 00:38:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6288fc8a-aeca-4427-96b0-0a842d9d7315] received 2024-05-11T00:38:00.872219846Z [2024-05-11 00:38:00,871: INFO/ForkPoolWorker-16] [e218bcd9-9614-4867-a3f6-d480342efd28] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:38:00.877694037Z [2024-05-11 00:38:00,877: INFO/ForkPoolWorker-2] [6288fc8a-aeca-4427-96b0-0a842d9d7315] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:38:00.885792232Z [2024-05-11 00:38:00,885: INFO/ForkPoolWorker-1] [9ec8affb-2abd-4e22-be6c-8382cbf1f180] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:38:01.273518811Z [2024-05-11 00:38:01,268: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:38:01.346908120Z [2024-05-11 00:38:01,343: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:38:01.435226510Z [2024-05-11 00:38:01,432: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:38:01.442253943Z [2024-05-11 00:38:01,441: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:38:01.446260584Z [2024-05-11 00:38:01,445: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:38:01.477649378Z [2024-05-11 00:38:01,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:38:01.478828139Z [2024-05-11 00:38:01,478: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:38:01.478872424Z [2024-05-11 00:38:01,478: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:38:01.478927451Z [2024-05-11 00:38:01,478: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:38:01.479111612Z [2024-05-11 00:38:01,479: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:38:01.509174040Z [2024-05-11 00:38:01,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:38:01.575314461Z [2024-05-11 00:38:01,575: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:38:01.753609193Z [2024-05-11 00:38:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:38:02.146564786Z [2024-05-11 00:38:02,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e218bcd9-9614-4867-a3f6-d480342efd28] succeeded in 1.281993198001146s: None 2024-05-11T00:38:02.321334609Z [2024-05-11 00:38:02,320: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[365268fe-5cbd-4460-bc22-11d8fe936996] succeeded in 1.4626286269995035s: None 2024-05-11T00:38:02.600208559Z [2024-05-11 00:38:02,599: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:38:02.603692230Z [2024-05-11 00:38:02,603: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:38:02.624992281Z [2024-05-11 00:38:02,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:38:02.626474590Z [2024-05-11 00:38:02,626: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:38:02.626669824Z [2024-05-11 00:38:02,626: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:38:02.626854594Z [2024-05-11 00:38:02,626: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:38:02.626988599Z [2024-05-11 00:38:02,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:38:02.627276574Z [2024-05-11 00:38:02,627: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:38:02.627672837Z [2024-05-11 00:38:02,627: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:38:02.691846043Z [2024-05-11 00:38:02,691: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:38:02.695243187Z [2024-05-11 00:38:02,694: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:38:02.709000599Z [2024-05-11 00:38:02,708: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:38:02.719206776Z [2024-05-11 00:38:02,718: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:38:02.720607061Z [2024-05-11 00:38:02,720: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:38:02.720650006Z [2024-05-11 00:38:02,720: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:38:02.720822951Z [2024-05-11 00:38:02,720: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:38:02.720869363Z [2024-05-11 00:38:02,720: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:38:02.721117620Z [2024-05-11 00:38:02,720: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:38:02.721174474Z [2024-05-11 00:38:02,721: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:38:02.819238948Z [2024-05-11 00:38:02,818: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:38:04.617533474Z [2024-05-11 00:38:04,616: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6288fc8a-aeca-4427-96b0-0a842d9d7315] succeeded in 3.7465417200000957s: None 2024-05-11T00:38:04.919875314Z [2024-05-11 00:38:04,919: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9ec8affb-2abd-4e22-be6c-8382cbf1f180] succeeded in 4.052921731999959s: None 2024-05-11T00:39:00.802562888Z [2024-05-11 00:39:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2ebc85e-180f-4a83-b703-c76f9ff9a490] received 2024-05-11T00:39:00.806013482Z [2024-05-11 00:39:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9656852d-d931-4a9a-82a2-2021c96a4cf0] received 2024-05-11T00:39:00.810500957Z [2024-05-11 00:39:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a858a48-40c0-4b38-aaae-23205b54356f] received 2024-05-11T00:39:00.814102981Z [2024-05-11 00:39:00,813: INFO/ForkPoolWorker-16] [9656852d-d931-4a9a-82a2-2021c96a4cf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:39:00.825034905Z [2024-05-11 00:39:00,824: INFO/ForkPoolWorker-15] [b2ebc85e-180f-4a83-b703-c76f9ff9a490] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:39:00.830903948Z [2024-05-11 00:39:00,830: INFO/ForkPoolWorker-1] [5a858a48-40c0-4b38-aaae-23205b54356f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:39:01.182052899Z [2024-05-11 00:39:01,177: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:39:01.235623142Z [2024-05-11 00:39:01,232: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:39:01.248860773Z [2024-05-11 00:39:01,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:39:01.391097512Z [2024-05-11 00:39:01,390: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:39:01.394871765Z [2024-05-11 00:39:01,394: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:39:01.427113007Z [2024-05-11 00:39:01,426: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:39:01.428429998Z [2024-05-11 00:39:01,428: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:39:01.428573400Z [2024-05-11 00:39:01,428: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:39:01.428634482Z [2024-05-11 00:39:01,428: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:39:01.428863550Z [2024-05-11 00:39:01,428: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:39:01.536824099Z [2024-05-11 00:39:01,536: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:39:02.221073771Z [2024-05-11 00:39:02,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9656852d-d931-4a9a-82a2-2021c96a4cf0] succeeded in 1.4123482300001342s: None 2024-05-11T00:39:02.468925428Z [2024-05-11 00:39:02,468: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:39:02.471998981Z [2024-05-11 00:39:02,471: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:39:02.493981371Z [2024-05-11 00:39:02,493: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:39:02.495177447Z [2024-05-11 00:39:02,494: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:39:02.495188478Z [2024-05-11 00:39:02,495: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:39:02.495302403Z [2024-05-11 00:39:02,495: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:39:02.495341585Z [2024-05-11 00:39:02,495: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:39:02.495610356Z [2024-05-11 00:39:02,495: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:39:02.495628076Z [2024-05-11 00:39:02,495: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:39:02.588726183Z [2024-05-11 00:39:02,588: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:39:02.627893233Z [2024-05-11 00:39:02,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:39:02.631074310Z [2024-05-11 00:39:02,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:39:02.654974054Z [2024-05-11 00:39:02,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:39:02.657539665Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:39:02.657558434Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:39:02.657670272Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:39:02.657678233Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:39:02.657949474Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:39:02.657991364Z [2024-05-11 00:39:02,657: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:39:02.749463073Z [2024-05-11 00:39:02,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:39:04.421587343Z [2024-05-11 00:39:04,421: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2ebc85e-180f-4a83-b703-c76f9ff9a490] succeeded in 3.614486079000926s: None 2024-05-11T00:39:04.668293717Z [2024-05-11 00:39:04,667: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a858a48-40c0-4b38-aaae-23205b54356f] succeeded in 3.8488362680000137s: None 2024-05-11T00:40:00.873553962Z [2024-05-11 00:40:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37fb86b4-4cce-4718-84fd-b64359839bc6] received 2024-05-11T00:40:00.876767032Z [2024-05-11 00:40:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42e5a931-c77d-4d47-bc77-9a436c719c1b] received 2024-05-11T00:40:00.886922531Z [2024-05-11 00:40:00,886: INFO/ForkPoolWorker-15] [37fb86b4-4cce-4718-84fd-b64359839bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:40:00.887209110Z [2024-05-11 00:40:00,886: INFO/ForkPoolWorker-16] [42e5a931-c77d-4d47-bc77-9a436c719c1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:40:00.890065042Z [2024-05-11 00:40:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7eb0be5-52fd-42ba-86cb-ed66b5cc82ad] received 2024-05-11T00:40:00.893035029Z [2024-05-11 00:40:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e1bc64b-4cf9-4871-b92d-f8476e647523] received 2024-05-11T00:40:00.900166253Z [2024-05-11 00:40:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73881bcf-27bf-4295-a4e4-351af3357438] received 2024-05-11T00:40:00.905316316Z [2024-05-11 00:40:00,905: INFO/ForkPoolWorker-2] [0e1bc64b-4cf9-4871-b92d-f8476e647523] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:00.905387165Z [2024-05-11 00:40:00,905: INFO/ForkPoolWorker-1] [c7eb0be5-52fd-42ba-86cb-ed66b5cc82ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:40:00.918121836Z [2024-05-11 00:40:00,917: INFO/ForkPoolWorker-3] [73881bcf-27bf-4295-a4e4-351af3357438] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:40:01.320970825Z [2024-05-11 00:40:01,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:40:01.374079885Z [2024-05-11 00:40:01,370: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:40:01.428864407Z [2024-05-11 00:40:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:40:01.495683535Z [2024-05-11 00:40:01,495: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:40:01.496269202Z [2024-05-11 00:40:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:40:01.497960777Z [2024-05-11 00:40:01,493: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:40:01.500812180Z [2024-05-11 00:40:01,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:01.549995188Z [2024-05-11 00:40:01,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:40:01.554926635Z [2024-05-11 00:40:01,554: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:40:01.555440936Z [2024-05-11 00:40:01,554: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:40:01.555506069Z [2024-05-11 00:40:01,555: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:40:01.555784185Z [2024-05-11 00:40:01,555: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:40:01.739367929Z [2024-05-11 00:40:01,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:02.106239315Z [2024-05-11 00:40:02,105: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:02.366652066Z [2024-05-11 00:40:02,366: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37fb86b4-4cce-4718-84fd-b64359839bc6] succeeded in 1.4879013999998278s: None 2024-05-11T00:40:02.730935271Z [2024-05-11 00:40:02,730: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[73881bcf-27bf-4295-a4e4-351af3357438] succeeded in 1.8235491570012528s: None 2024-05-11T00:40:02.826019631Z [2024-05-11 00:40:02,825: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:40:02.829407126Z [2024-05-11 00:40:02,828: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:02.854061825Z [2024-05-11 00:40:02,853: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:40:02.855174535Z [2024-05-11 00:40:02,854: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:02.855185823Z [2024-05-11 00:40:02,855: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:02.855316794Z [2024-05-11 00:40:02,855: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:02.855326129Z [2024-05-11 00:40:02,855: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:40:02.855555041Z [2024-05-11 00:40:02,855: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:40:02.855569034Z [2024-05-11 00:40:02,855: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:02.944249630Z [2024-05-11 00:40:02,943: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:02.962918605Z [2024-05-11 00:40:02,962: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:40:02.966658415Z [2024-05-11 00:40:02,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:02.987769654Z [2024-05-11 00:40:02,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:40:02.991099565Z [2024-05-11 00:40:02,990: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:02.991328356Z [2024-05-11 00:40:02,991: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:02.992011497Z [2024-05-11 00:40:02,991: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:02.992743376Z [2024-05-11 00:40:02,992: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:40:02.993299876Z [2024-05-11 00:40:02,993: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:40:02.994050090Z [2024-05-11 00:40:02,993: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:03.085279860Z [2024-05-11 00:40:03,084: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:03.240779033Z [2024-05-11 00:40:03,240: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:40:03.244194195Z [2024-05-11 00:40:03,243: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:03.273904914Z [2024-05-11 00:40:03,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:40:03.275604322Z [2024-05-11 00:40:03,275: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:03.275616570Z [2024-05-11 00:40:03,275: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:03.275762111Z [2024-05-11 00:40:03,275: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:03.275795141Z [2024-05-11 00:40:03,275: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:40:03.276189852Z [2024-05-11 00:40:03,275: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:40:03.276195940Z [2024-05-11 00:40:03,276: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:03.388967105Z [2024-05-11 00:40:03,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:03.589251216Z [2024-05-11 00:40:03,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b08dbd1-08e4-4151-bb3c-948cb8fc121d] received 2024-05-11T00:40:03.597212626Z [2024-05-11 00:40:03,596: INFO/ForkPoolWorker-15] [1b08dbd1-08e4-4151-bb3c-948cb8fc121d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:03.619809083Z [2024-05-11 00:40:03,619: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e1bc64b-4cf9-4871-b92d-f8476e647523] succeeded in 2.720307423000122s: None 2024-05-11T00:40:03.880009974Z [2024-05-11 00:40:03,875: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:40:05.006391394Z [2024-05-11 00:40:05,005: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7eb0be5-52fd-42ba-86cb-ed66b5cc82ad] succeeded in 4.113964494999891s: None 2024-05-11T00:40:05.020648488Z [2024-05-11 00:40:05,020: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42e5a931-c77d-4d47-bc77-9a436c719c1b] succeeded in 4.141375880000851s: None 2024-05-11T00:40:05.047267752Z [2024-05-11 00:40:05,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:40:05.050570714Z [2024-05-11 00:40:05,050: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:05.072653253Z [2024-05-11 00:40:05,072: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:40:05.074073429Z [2024-05-11 00:40:05,073: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:05.074180113Z [2024-05-11 00:40:05,074: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:05.074394911Z [2024-05-11 00:40:05,074: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:05.074444626Z [2024-05-11 00:40:05,074: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:40:05.074873819Z [2024-05-11 00:40:05,074: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:40:05.074912009Z [2024-05-11 00:40:05,074: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:05.174727289Z [2024-05-11 00:40:05,174: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:05.861465014Z [2024-05-11 00:40:05,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b08dbd1-08e4-4151-bb3c-948cb8fc121d] succeeded in 2.2705411890001415s: None 2024-05-11T00:40:06.011713590Z [2024-05-11 00:40:06,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e17240c-ab76-471c-9a58-529b9d07a688] received 2024-05-11T00:40:06.032149323Z [2024-05-11 00:40:06,031: INFO/ForkPoolWorker-15] [8e17240c-ab76-471c-9a58-529b9d07a688] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:40:06.297203009Z [2024-05-11 00:40:06,293: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:40:07.489519352Z [2024-05-11 00:40:07,488: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:40:07.493039638Z [2024-05-11 00:40:07,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:07.515999495Z [2024-05-11 00:40:07,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:40:07.517931084Z [2024-05-11 00:40:07,517: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:07.517956465Z [2024-05-11 00:40:07,517: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:07.518010647Z [2024-05-11 00:40:07,517: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:07.518022142Z [2024-05-11 00:40:07,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:40:07.518538746Z [2024-05-11 00:40:07,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:40:07.518554860Z [2024-05-11 00:40:07,518: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:07.629514632Z [2024-05-11 00:40:07,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:08.211870975Z [2024-05-11 00:40:08,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e17240c-ab76-471c-9a58-529b9d07a688] succeeded in 2.197477395000533s: None 2024-05-11T00:40:08.782020485Z [2024-05-11 00:40:08,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c099e3f-9630-49d1-8a17-30a7e01d8519] received 2024-05-11T00:40:08.794747774Z [2024-05-11 00:40:08,794: INFO/ForkPoolWorker-15] [3c099e3f-9630-49d1-8a17-30a7e01d8519] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:40:09.080515543Z [2024-05-11 00:40:09,077: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:40:10.233441613Z [2024-05-11 00:40:10,233: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:40:10.236869006Z [2024-05-11 00:40:10,236: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:40:10.264255046Z [2024-05-11 00:40:10,263: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:40:10.265921498Z [2024-05-11 00:40:10,265: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:40:10.266127612Z [2024-05-11 00:40:10,265: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:40:10.266404656Z [2024-05-11 00:40:10,266: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:40:10.266561405Z [2024-05-11 00:40:10,266: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:40:10.266951556Z [2024-05-11 00:40:10,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:40:10.267167704Z [2024-05-11 00:40:10,266: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:40:10.369643642Z [2024-05-11 00:40:10,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:40:11.054022718Z [2024-05-11 00:40:11,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c099e3f-9630-49d1-8a17-30a7e01d8519] succeeded in 2.2635640270000295s: None 2024-05-11T00:41:00.946781935Z [2024-05-11 00:41:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33c4d139-7049-4a15-aba0-67a3cb4d4919] received 2024-05-11T00:41:00.953377815Z [2024-05-11 00:41:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d3404e-ac77-462f-a320-0e57b6a9cdd5] received 2024-05-11T00:41:00.954639038Z [2024-05-11 00:41:00,954: INFO/ForkPoolWorker-15] [33c4d139-7049-4a15-aba0-67a3cb4d4919] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:41:00.962012038Z [2024-05-11 00:41:00,961: INFO/ForkPoolWorker-16] [20d3404e-ac77-462f-a320-0e57b6a9cdd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:41:00.966137891Z [2024-05-11 00:41:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cb598e8-3c11-41b5-aa20-5be19d60a4d7] received 2024-05-11T00:41:00.974004506Z [2024-05-11 00:41:00,973: INFO/ForkPoolWorker-1] [4cb598e8-3c11-41b5-aa20-5be19d60a4d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:41:01.343904088Z [2024-05-11 00:41:01,340: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:41:01.377360385Z [2024-05-11 00:41:01,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:41:01.423341281Z [2024-05-11 00:41:01,419: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:41:01.542713115Z [2024-05-11 00:41:01,542: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:41:01.546749384Z [2024-05-11 00:41:01,546: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:41:01.575557824Z [2024-05-11 00:41:01,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:41:01.577114594Z [2024-05-11 00:41:01,576: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:41:01.577353416Z [2024-05-11 00:41:01,577: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:41:01.577522106Z [2024-05-11 00:41:01,577: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:41:01.577839414Z [2024-05-11 00:41:01,577: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:41:01.670205899Z [2024-05-11 00:41:01,669: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:41:02.300865097Z [2024-05-11 00:41:02,300: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20d3404e-ac77-462f-a320-0e57b6a9cdd5] succeeded in 1.3457244239998545s: None 2024-05-11T00:41:02.490482817Z [2024-05-11 00:41:02,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:41:02.493873423Z [2024-05-11 00:41:02,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:41:02.516368707Z [2024-05-11 00:41:02,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:41:02.517981179Z [2024-05-11 00:41:02,517: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:41:02.518149608Z [2024-05-11 00:41:02,517: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:41:02.518368035Z [2024-05-11 00:41:02,518: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:41:02.518520643Z [2024-05-11 00:41:02,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:41:02.518862946Z [2024-05-11 00:41:02,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:41:02.519080337Z [2024-05-11 00:41:02,518: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:41:02.612308547Z [2024-05-11 00:41:02,612: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:41:02.682378970Z [2024-05-11 00:41:02,682: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:41:02.685787740Z [2024-05-11 00:41:02,685: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:41:02.712265266Z [2024-05-11 00:41:02,712: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:41:02.715240683Z [2024-05-11 00:41:02,714: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:41:02.715403979Z [2024-05-11 00:41:02,715: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:41:02.715632679Z [2024-05-11 00:41:02,715: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:41:02.715780771Z [2024-05-11 00:41:02,715: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:41:02.716150279Z [2024-05-11 00:41:02,715: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:41:02.716311245Z [2024-05-11 00:41:02,716: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:41:02.839781375Z [2024-05-11 00:41:02,838: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:41:05.184364058Z [2024-05-11 00:41:05,182: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cb598e8-3c11-41b5-aa20-5be19d60a4d7] succeeded in 4.21446557300078s: None 2024-05-11T00:41:05.634254884Z [2024-05-11 00:41:05,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33c4d139-7049-4a15-aba0-67a3cb4d4919] succeeded in 4.68572514600055s: None 2024-05-11T00:42:00.892081380Z [2024-05-11 00:42:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fa25fb1-7134-4935-8920-1271f8140056] received 2024-05-11T00:42:00.898833553Z [2024-05-11 00:42:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8e6adfd-9dc8-4d9d-9fe7-5e89ae39ba3e] received 2024-05-11T00:42:00.902048396Z [2024-05-11 00:42:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0861e989-a4ed-45cc-9518-455d27435367] received 2024-05-11T00:42:00.905815795Z [2024-05-11 00:42:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2244acd3-8c6e-42c3-b592-426fd58ad4fc] received 2024-05-11T00:42:00.917983880Z [2024-05-11 00:42:00,917: INFO/ForkPoolWorker-15] [7fa25fb1-7134-4935-8920-1271f8140056] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:42:00.918475596Z [2024-05-11 00:42:00,918: INFO/ForkPoolWorker-16] [d8e6adfd-9dc8-4d9d-9fe7-5e89ae39ba3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:42:00.918925853Z [2024-05-11 00:42:00,918: INFO/ForkPoolWorker-1] [0861e989-a4ed-45cc-9518-455d27435367] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:42:00.929213612Z [2024-05-11 00:42:00,928: INFO/ForkPoolWorker-2] [2244acd3-8c6e-42c3-b592-426fd58ad4fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:42:01.294081304Z [2024-05-11 00:42:01,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:42:01.302476876Z [2024-05-11 00:42:01,298: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:42:01.335633296Z [2024-05-11 00:42:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:42:01.405777008Z [2024-05-11 00:42:01,402: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:42:01.541288570Z [2024-05-11 00:42:01,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:42:01.688602842Z [2024-05-11 00:42:01,688: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:42:01.693287040Z [2024-05-11 00:42:01,692: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:42:01.728825579Z [2024-05-11 00:42:01,728: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:42:01.729977401Z [2024-05-11 00:42:01,729: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:42:01.730079577Z [2024-05-11 00:42:01,729: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:42:01.730114774Z [2024-05-11 00:42:01,730: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:42:01.730333000Z [2024-05-11 00:42:01,730: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:42:01.845708070Z [2024-05-11 00:42:01,845: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:42:02.103420261Z [2024-05-11 00:42:02,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fa25fb1-7134-4935-8920-1271f8140056] succeeded in 1.2029557959995145s: None 2024-05-11T00:42:02.431629011Z [2024-05-11 00:42:02,431: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2244acd3-8c6e-42c3-b592-426fd58ad4fc] succeeded in 1.5232729759991344s: None 2024-05-11T00:42:02.440269694Z [2024-05-11 00:42:02,439: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:42:02.443566892Z [2024-05-11 00:42:02,443: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:42:02.467473692Z [2024-05-11 00:42:02,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:42:02.468939253Z [2024-05-11 00:42:02,468: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:42:02.469135256Z [2024-05-11 00:42:02,468: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:42:02.469380204Z [2024-05-11 00:42:02,469: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:42:02.469543722Z [2024-05-11 00:42:02,469: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:42:02.470131748Z [2024-05-11 00:42:02,469: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:42:02.470312845Z [2024-05-11 00:42:02,470: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:42:02.568728623Z [2024-05-11 00:42:02,568: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:42:02.625657805Z [2024-05-11 00:42:02,625: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:42:02.629184715Z [2024-05-11 00:42:02,628: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:42:02.648879504Z [2024-05-11 00:42:02,648: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:42:02.650205147Z [2024-05-11 00:42:02,649: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:42:02.650278556Z [2024-05-11 00:42:02,650: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:42:02.650358930Z [2024-05-11 00:42:02,650: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:42:02.650422111Z [2024-05-11 00:42:02,650: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:42:02.650648095Z [2024-05-11 00:42:02,650: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:42:02.650725226Z [2024-05-11 00:42:02,650: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:42:02.741795187Z [2024-05-11 00:42:02,741: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:42:04.516154737Z [2024-05-11 00:42:04,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0861e989-a4ed-45cc-9518-455d27435367] succeeded in 3.6114023509999242s: None 2024-05-11T00:42:05.025769740Z [2024-05-11 00:42:05,025: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8e6adfd-9dc8-4d9d-9fe7-5e89ae39ba3e] succeeded in 4.122913762999815s: None 2024-05-11T00:43:00.443225060Z [2024-05-11 00:43:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[988c8edc-b722-41c2-b866-4eb302279e79] received 2024-05-11T00:43:00.449668600Z [2024-05-11 00:43:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceeadf32-0b89-4234-9b59-899092d1e399] received 2024-05-11T00:43:00.454591478Z [2024-05-11 00:43:00,454: INFO/ForkPoolWorker-15] [988c8edc-b722-41c2-b866-4eb302279e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:43:00.455512654Z [2024-05-11 00:43:00,455: INFO/ForkPoolWorker-16] [ceeadf32-0b89-4234-9b59-899092d1e399] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:43:00.458770865Z [2024-05-11 00:43:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a461a6f8-a6c8-4ec2-a873-ebebd79c0959] received 2024-05-11T00:43:00.464515350Z [2024-05-11 00:43:00,464: INFO/ForkPoolWorker-1] [a461a6f8-a6c8-4ec2-a873-ebebd79c0959] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:43:00.752182054Z [2024-05-11 00:43:00,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:43:00.769758766Z [2024-05-11 00:43:00,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:43:00.803127027Z [2024-05-11 00:43:00,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:43:01.018957059Z [2024-05-11 00:43:01,018: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:43:01.052235006Z [2024-05-11 00:43:01,032: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:43:01.122355751Z [2024-05-11 00:43:01,122: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:43:01.124505574Z [2024-05-11 00:43:01,124: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:43:01.124697247Z [2024-05-11 00:43:01,124: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:43:01.124827223Z [2024-05-11 00:43:01,124: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:43:01.125135249Z [2024-05-11 00:43:01,124: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:43:01.241824227Z [2024-05-11 00:43:01,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:43:01.877108117Z [2024-05-11 00:43:01,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a461a6f8-a6c8-4ec2-a873-ebebd79c0959] succeeded in 1.4169976860011957s: None 2024-05-11T00:43:02.017584790Z [2024-05-11 00:43:02,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:43:02.021234525Z [2024-05-11 00:43:02,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:43:02.050954351Z [2024-05-11 00:43:02,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:43:02.055025802Z [2024-05-11 00:43:02,054: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:43:02.055225029Z [2024-05-11 00:43:02,055: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:43:02.055502653Z [2024-05-11 00:43:02,055: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:43:02.055665317Z [2024-05-11 00:43:02,055: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:43:02.056139863Z [2024-05-11 00:43:02,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:43:02.056317413Z [2024-05-11 00:43:02,056: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:43:02.127152626Z [2024-05-11 00:43:02,126: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:43:02.130823912Z [2024-05-11 00:43:02,130: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:43:02.149917425Z [2024-05-11 00:43:02,149: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:43:02.158190527Z [2024-05-11 00:43:02,157: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:43:02.160236542Z [2024-05-11 00:43:02,160: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:43:02.160403722Z [2024-05-11 00:43:02,160: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:43:02.160756792Z [2024-05-11 00:43:02,160: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:43:02.160949436Z [2024-05-11 00:43:02,160: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:43:02.161233603Z [2024-05-11 00:43:02,161: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:43:02.161343108Z [2024-05-11 00:43:02,161: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:43:02.248506403Z [2024-05-11 00:43:02,248: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:43:03.555341628Z [2024-05-11 00:43:03,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[988c8edc-b722-41c2-b866-4eb302279e79] succeeded in 3.1109071690007113s: None 2024-05-11T00:43:04.431620406Z [2024-05-11 00:43:04,431: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ceeadf32-0b89-4234-9b59-899092d1e399] succeeded in 3.9802096690000326s: None 2024-05-11T00:44:00.891838288Z [2024-05-11 00:44:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df6ec530-ff80-43fc-9eb6-0a4e7c556866] received 2024-05-11T00:44:00.894006738Z [2024-05-11 00:44:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2219de3-72b9-4662-a4f2-3c3533a4cd1f] received 2024-05-11T00:44:00.900921674Z [2024-05-11 00:44:00,900: INFO/ForkPoolWorker-16] [b2219de3-72b9-4662-a4f2-3c3533a4cd1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:44:00.901349545Z [2024-05-11 00:44:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26263c00-4aef-44b1-93e5-889ca4fe38c2] received 2024-05-11T00:44:00.906928224Z [2024-05-11 00:44:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f63ff8d-a334-4cf6-895d-4395730b3f85] received 2024-05-11T00:44:00.913713192Z [2024-05-11 00:44:00,913: INFO/ForkPoolWorker-15] [df6ec530-ff80-43fc-9eb6-0a4e7c556866] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:44:00.916064892Z [2024-05-11 00:44:00,915: INFO/ForkPoolWorker-1] [26263c00-4aef-44b1-93e5-889ca4fe38c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:44:00.923116255Z [2024-05-11 00:44:00,922: INFO/ForkPoolWorker-2] [1f63ff8d-a334-4cf6-895d-4395730b3f85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:44:01.336150045Z [2024-05-11 00:44:01,332: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:44:01.345268714Z [2024-05-11 00:44:01,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:44:01.419031656Z [2024-05-11 00:44:01,414: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:44:01.435749514Z [2024-05-11 00:44:01,432: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:44:01.597654789Z [2024-05-11 00:44:01,597: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:44:01.601723581Z [2024-05-11 00:44:01,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:44:01.626188619Z [2024-05-11 00:44:01,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:44:01.630817868Z [2024-05-11 00:44:01,630: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:44:01.631005531Z [2024-05-11 00:44:01,630: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:44:01.631145097Z [2024-05-11 00:44:01,630: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:44:01.631502694Z [2024-05-11 00:44:01,631: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:44:01.760426012Z [2024-05-11 00:44:01,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:44:01.763190784Z [2024-05-11 00:44:01,762: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:44:02.400083802Z [2024-05-11 00:44:02,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df6ec530-ff80-43fc-9eb6-0a4e7c556866] succeeded in 1.5041175759997714s: None 2024-05-11T00:44:02.492814465Z [2024-05-11 00:44:02,492: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f63ff8d-a334-4cf6-895d-4395730b3f85] succeeded in 1.5829983429994172s: None 2024-05-11T00:44:02.671677370Z [2024-05-11 00:44:02,671: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:44:02.675186723Z [2024-05-11 00:44:02,674: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:44:02.703715743Z [2024-05-11 00:44:02,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:44:02.705109247Z [2024-05-11 00:44:02,704: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:44:02.705304384Z [2024-05-11 00:44:02,705: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:44:02.705513157Z [2024-05-11 00:44:02,705: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:44:02.705552668Z [2024-05-11 00:44:02,705: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:44:02.705841128Z [2024-05-11 00:44:02,705: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:44:02.705997049Z [2024-05-11 00:44:02,705: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:44:02.747491059Z [2024-05-11 00:44:02,747: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:44:02.751074301Z [2024-05-11 00:44:02,750: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:44:02.774853732Z [2024-05-11 00:44:02,774: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:44:02.778641979Z [2024-05-11 00:44:02,778: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:44:02.778819705Z [2024-05-11 00:44:02,778: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:44:02.778996475Z [2024-05-11 00:44:02,778: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:44:02.779110742Z [2024-05-11 00:44:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:44:02.779529664Z [2024-05-11 00:44:02,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:44:02.779607275Z [2024-05-11 00:44:02,779: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:44:02.787159639Z [2024-05-11 00:44:02,786: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:44:02.890050412Z [2024-05-11 00:44:02,889: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:44:05.015022201Z [2024-05-11 00:44:05,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26263c00-4aef-44b1-93e5-889ca4fe38c2] succeeded in 4.111499894999724s: None 2024-05-11T00:44:05.613346436Z [2024-05-11 00:44:05,612: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2219de3-72b9-4662-a4f2-3c3533a4cd1f] succeeded in 4.717421917999673s: None 2024-05-11T00:45:00.534544736Z [2024-05-11 00:45:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[245335f9-8a0f-4e04-b4c5-7a06667601e7] received 2024-05-11T00:45:00.540445696Z [2024-05-11 00:45:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73af12da-75e0-4913-85b5-cfc0a6ae3fa1] received 2024-05-11T00:45:00.545556199Z [2024-05-11 00:45:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990d8c7a-f60b-4d2a-ade6-30b3b9b982e8] received 2024-05-11T00:45:00.545575008Z [2024-05-11 00:45:00,543: INFO/ForkPoolWorker-15] [245335f9-8a0f-4e04-b4c5-7a06667601e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:45:00.545578649Z [2024-05-11 00:45:00,545: INFO/ForkPoolWorker-16] [73af12da-75e0-4913-85b5-cfc0a6ae3fa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:45:00.552233646Z [2024-05-11 00:45:00,551: INFO/ForkPoolWorker-1] [990d8c7a-f60b-4d2a-ade6-30b3b9b982e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:00.561484376Z [2024-05-11 00:45:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4de8d7ad-65c6-480f-b41d-e04eea2633cc] received 2024-05-11T00:45:00.574302461Z [2024-05-11 00:45:00,574: INFO/ForkPoolWorker-2] [4de8d7ad-65c6-480f-b41d-e04eea2633cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:45:00.866656698Z [2024-05-11 00:45:00,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:45:00.885928303Z [2024-05-11 00:45:00,882: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:45:00.920843288Z [2024-05-11 00:45:00,917: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:45:00.923002986Z [2024-05-11 00:45:00,918: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:45:01.034473305Z [2024-05-11 00:45:01,034: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:45:01.038241719Z [2024-05-11 00:45:01,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:01.172819943Z [2024-05-11 00:45:01,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:45:01.178748645Z [2024-05-11 00:45:01,178: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:45:01.178791747Z [2024-05-11 00:45:01,178: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:45:01.178867334Z [2024-05-11 00:45:01,178: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:45:01.179100316Z [2024-05-11 00:45:01,178: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:45:01.288505568Z [2024-05-11 00:45:01,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:01.926069004Z [2024-05-11 00:45:01,925: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73af12da-75e0-4913-85b5-cfc0a6ae3fa1] succeeded in 1.3864036009999836s: None 2024-05-11T00:45:02.315321516Z [2024-05-11 00:45:02,314: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:45:02.318720153Z [2024-05-11 00:45:02,318: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:02.383239050Z [2024-05-11 00:45:02,383: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:45:02.402685024Z [2024-05-11 00:45:02,402: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:02.402785848Z [2024-05-11 00:45:02,402: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:02.402961472Z [2024-05-11 00:45:02,402: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:02.403064796Z [2024-05-11 00:45:02,402: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:45:02.403394834Z [2024-05-11 00:45:02,403: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:45:02.403488767Z [2024-05-11 00:45:02,403: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:02.435306026Z [2024-05-11 00:45:02,434: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:45:02.438674909Z [2024-05-11 00:45:02,438: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:02.502014562Z [2024-05-11 00:45:02,501: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:45:02.509282192Z [2024-05-11 00:45:02,508: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:02.509303260Z [2024-05-11 00:45:02,509: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:02.509513261Z [2024-05-11 00:45:02,509: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:02.509588149Z [2024-05-11 00:45:02,509: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:45:02.510175242Z [2024-05-11 00:45:02,510: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:45:02.511872301Z [2024-05-11 00:45:02,510: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:02.567854765Z [2024-05-11 00:45:02,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:45:02.568759606Z [2024-05-11 00:45:02,568: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:02.572041950Z [2024-05-11 00:45:02,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:02.603120467Z [2024-05-11 00:45:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:45:02.604406209Z [2024-05-11 00:45:02,604: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:02.604547443Z [2024-05-11 00:45:02,604: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:02.604787054Z [2024-05-11 00:45:02,604: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:02.604998288Z [2024-05-11 00:45:02,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:45:02.605365069Z [2024-05-11 00:45:02,605: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:45:02.605501838Z [2024-05-11 00:45:02,605: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:02.658086533Z [2024-05-11 00:45:02,657: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:02.787815593Z [2024-05-11 00:45:02,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:03.484573179Z [2024-05-11 00:45:03,484: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[990d8c7a-f60b-4d2a-ade6-30b3b9b982e8] succeeded in 2.939386464000563s: None 2024-05-11T00:45:03.606660209Z [2024-05-11 00:45:03,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a4a98ae-77e8-4fa4-b1a1-a462bc83cbfe] received 2024-05-11T00:45:03.618328408Z [2024-05-11 00:45:03,618: INFO/ForkPoolWorker-16] [5a4a98ae-77e8-4fa4-b1a1-a462bc83cbfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:03.901245141Z [2024-05-11 00:45:03,898: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:45:04.506629573Z [2024-05-11 00:45:04,506: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4de8d7ad-65c6-480f-b41d-e04eea2633cc] succeeded in 3.943326522999996s: None 2024-05-11T00:45:04.590246224Z [2024-05-11 00:45:04,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[245335f9-8a0f-4e04-b4c5-7a06667601e7] succeeded in 4.054090405999887s: None 2024-05-11T00:45:05.050694635Z [2024-05-11 00:45:05,050: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:45:05.054299986Z [2024-05-11 00:45:05,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:05.078181678Z [2024-05-11 00:45:05,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:45:05.079858450Z [2024-05-11 00:45:05,079: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:05.079966145Z [2024-05-11 00:45:05,079: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:05.080162684Z [2024-05-11 00:45:05,079: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:05.080262759Z [2024-05-11 00:45:05,080: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:45:05.080615077Z [2024-05-11 00:45:05,080: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:45:05.080691505Z [2024-05-11 00:45:05,080: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:05.168169371Z [2024-05-11 00:45:05,165: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:05.799069558Z [2024-05-11 00:45:05,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a4a98ae-77e8-4fa4-b1a1-a462bc83cbfe] succeeded in 2.1898579349999636s: None 2024-05-11T00:45:06.648630487Z [2024-05-11 00:45:06,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef6ae642-ad1e-4f91-8130-89ae79dd9c13] received 2024-05-11T00:45:06.681477230Z [2024-05-11 00:45:06,678: INFO/ForkPoolWorker-15] [ef6ae642-ad1e-4f91-8130-89ae79dd9c13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:45:07.016081540Z [2024-05-11 00:45:07,013: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:45:08.134886342Z [2024-05-11 00:45:08,134: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:45:08.138553351Z [2024-05-11 00:45:08,137: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:08.163671640Z [2024-05-11 00:45:08,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:45:08.164940467Z [2024-05-11 00:45:08,164: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:08.164956222Z [2024-05-11 00:45:08,164: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:08.165123027Z [2024-05-11 00:45:08,164: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:08.165201128Z [2024-05-11 00:45:08,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:45:08.165447906Z [2024-05-11 00:45:08,165: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:45:08.165515950Z [2024-05-11 00:45:08,165: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:08.259568737Z [2024-05-11 00:45:08,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:08.846974735Z [2024-05-11 00:45:08,846: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef6ae642-ad1e-4f91-8130-89ae79dd9c13] succeeded in 2.1895034039989696s: None 2024-05-11T00:45:08.981802523Z [2024-05-11 00:45:08,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b93a5981-828c-4869-a05d-2a4e63f11d5c] received 2024-05-11T00:45:08.988954193Z [2024-05-11 00:45:08,988: INFO/ForkPoolWorker-15] [b93a5981-828c-4869-a05d-2a4e63f11d5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:45:09.286389168Z [2024-05-11 00:45:09,282: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:45:10.423106327Z [2024-05-11 00:45:10,422: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:45:10.426350294Z [2024-05-11 00:45:10,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:45:10.455538545Z [2024-05-11 00:45:10,455: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:45:10.456689598Z [2024-05-11 00:45:10,456: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:45:10.456704906Z [2024-05-11 00:45:10,456: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:45:10.456844872Z [2024-05-11 00:45:10,456: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:45:10.456863793Z [2024-05-11 00:45:10,456: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:45:10.457116001Z [2024-05-11 00:45:10,456: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:45:10.457182687Z [2024-05-11 00:45:10,457: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:45:10.554779778Z [2024-05-11 00:45:10,554: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:45:11.107418837Z [2024-05-11 00:45:11,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b93a5981-828c-4869-a05d-2a4e63f11d5c] succeeded in 2.1232601890005753s: None 2024-05-11T00:46:00.371139396Z [2024-05-11 00:46:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51ef3f81-67a9-4b72-b441-0559365c89db] received 2024-05-11T00:46:00.375666704Z [2024-05-11 00:46:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bf2888d-e0e0-483d-9a27-971805604c10] received 2024-05-11T00:46:00.386933673Z [2024-05-11 00:46:00,386: INFO/ForkPoolWorker-16] [4bf2888d-e0e0-483d-9a27-971805604c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:46:00.387862745Z [2024-05-11 00:46:00,387: INFO/ForkPoolWorker-15] [51ef3f81-67a9-4b72-b441-0559365c89db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:46:00.390745171Z [2024-05-11 00:46:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b526f780-4bc7-4c07-84f1-886c26011fa7] received 2024-05-11T00:46:00.396134643Z [2024-05-11 00:46:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5127a37-3776-4e76-b875-3d0015bc5ac0] received 2024-05-11T00:46:00.399855082Z [2024-05-11 00:46:00,399: INFO/ForkPoolWorker-1] [b526f780-4bc7-4c07-84f1-886c26011fa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:46:00.402776814Z [2024-05-11 00:46:00,402: INFO/ForkPoolWorker-2] [c5127a37-3776-4e76-b875-3d0015bc5ac0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:46:00.715510166Z [2024-05-11 00:46:00,705: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:46:00.727310475Z [2024-05-11 00:46:00,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:46:00.748396679Z [2024-05-11 00:46:00,745: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:46:00.804285992Z [2024-05-11 00:46:00,801: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:46:00.980942031Z [2024-05-11 00:46:00,980: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:46:00.985103657Z [2024-05-11 00:46:00,984: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:46:01.014878572Z [2024-05-11 00:46:01,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:46:01.020195208Z [2024-05-11 00:46:01,017: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:46:01.020212401Z [2024-05-11 00:46:01,017: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:46:01.020216484Z [2024-05-11 00:46:01,017: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:46:01.020300998Z [2024-05-11 00:46:01,017: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:46:01.127624692Z [2024-05-11 00:46:01,127: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:46:01.208861781Z [2024-05-11 00:46:01,208: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:46:01.780637673Z [2024-05-11 00:46:01,780: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4bf2888d-e0e0-483d-9a27-971805604c10] succeeded in 1.401660608000384s: None 2024-05-11T00:46:01.949792995Z [2024-05-11 00:46:01,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b526f780-4bc7-4c07-84f1-886c26011fa7] succeeded in 1.5569969910011423s: None 2024-05-11T00:46:02.143463155Z [2024-05-11 00:46:02,143: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:46:02.143998801Z [2024-05-11 00:46:02,143: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:46:02.146746524Z [2024-05-11 00:46:02,146: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:46:02.147537193Z [2024-05-11 00:46:02,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:46:02.172355290Z [2024-05-11 00:46:02,172: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:46:02.174742370Z [2024-05-11 00:46:02,174: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:46:02.174791730Z [2024-05-11 00:46:02,174: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:46:02.175027855Z [2024-05-11 00:46:02,174: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:46:02.175040825Z [2024-05-11 00:46:02,174: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:46:02.175320539Z [2024-05-11 00:46:02,175: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:46:02.175399553Z [2024-05-11 00:46:02,175: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:46:02.177522244Z [2024-05-11 00:46:02,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:46:02.178790225Z [2024-05-11 00:46:02,178: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:46:02.178937461Z [2024-05-11 00:46:02,178: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:46:02.179114251Z [2024-05-11 00:46:02,178: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:46:02.179223664Z [2024-05-11 00:46:02,179: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:46:02.179574949Z [2024-05-11 00:46:02,179: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:46:02.179691043Z [2024-05-11 00:46:02,179: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:46:02.250707816Z [2024-05-11 00:46:02,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:46:02.252841928Z [2024-05-11 00:46:02,252: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:46:03.687640630Z [2024-05-11 00:46:03,687: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51ef3f81-67a9-4b72-b441-0559365c89db] succeeded in 3.3092218949987s: None 2024-05-11T00:46:04.155181218Z [2024-05-11 00:46:04,154: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c5127a37-3776-4e76-b875-3d0015bc5ac0] succeeded in 3.7572150510004576s: None 2024-05-11T00:47:00.200685063Z [2024-05-11 00:47:00,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24123de8-0d82-411e-ab9d-b580e73bc27e] received 2024-05-11T00:47:00.217152449Z [2024-05-11 00:47:00,216: INFO/ForkPoolWorker-15] [24123de8-0d82-411e-ab9d-b580e73bc27e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:47:00.224069781Z [2024-05-11 00:47:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29b3a13c-f017-4313-b159-20f87709d8cb] received 2024-05-11T00:47:00.235851494Z [2024-05-11 00:47:00,235: INFO/ForkPoolWorker-16] [29b3a13c-f017-4313-b159-20f87709d8cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:47:00.300887571Z [2024-05-11 00:47:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1070c83-ffa3-4a89-bacc-715adebf47d3] received 2024-05-11T00:47:00.326836083Z [2024-05-11 00:47:00,322: INFO/ForkPoolWorker-1] [c1070c83-ffa3-4a89-bacc-715adebf47d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:47:00.571977021Z [2024-05-11 00:47:00,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:47:00.623294852Z [2024-05-11 00:47:00,619: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:47:00.629358860Z [2024-05-11 00:47:00,625: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:47:00.790812186Z [2024-05-11 00:47:00,790: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T00:47:00.794775472Z [2024-05-11 00:47:00,794: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:47:00.817964020Z [2024-05-11 00:47:00,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:47:00.819257432Z [2024-05-11 00:47:00,819: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:47:00.819488134Z [2024-05-11 00:47:00,819: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:47:00.819518242Z [2024-05-11 00:47:00,819: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T00:47:00.819730349Z [2024-05-11 00:47:00,819: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:47:00.916352339Z [2024-05-11 00:47:00,915: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:47:01.605427025Z [2024-05-11 00:47:01,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29b3a13c-f017-4313-b159-20f87709d8cb] succeeded in 1.3791471240001556s: None 2024-05-11T00:47:01.830804080Z [2024-05-11 00:47:01,829: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:47:01.835021297Z [2024-05-11 00:47:01,834: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:47:01.844195659Z [2024-05-11 00:47:01,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:47:01.847728191Z [2024-05-11 00:47:01,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:47:01.863272778Z [2024-05-11 00:47:01,863: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:47:01.864992700Z [2024-05-11 00:47:01,864: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:47:01.865746072Z [2024-05-11 00:47:01,865: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:47:01.866155082Z [2024-05-11 00:47:01,865: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:47:01.866418245Z [2024-05-11 00:47:01,866: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:47:01.866800151Z [2024-05-11 00:47:01,866: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:47:01.866962732Z [2024-05-11 00:47:01,866: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:47:01.870792877Z [2024-05-11 00:47:01,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:47:01.871924964Z [2024-05-11 00:47:01,871: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:47:01.871940585Z [2024-05-11 00:47:01,871: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:47:01.872054914Z [2024-05-11 00:47:01,871: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:47:01.872080854Z [2024-05-11 00:47:01,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:47:01.872310637Z [2024-05-11 00:47:01,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:47:01.872326806Z [2024-05-11 00:47:01,872: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:47:01.951330005Z [2024-05-11 00:47:01,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:47:01.972171181Z [2024-05-11 00:47:01,971: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:47:03.472571679Z [2024-05-11 00:47:03,471: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1070c83-ffa3-4a89-bacc-715adebf47d3] succeeded in 3.171312512999066s: None 2024-05-11T00:47:03.831977319Z [2024-05-11 00:47:03,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24123de8-0d82-411e-ab9d-b580e73bc27e] succeeded in 3.62619485399955s: None 2024-05-11T00:48:00.382032712Z [2024-05-11 00:48:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[172d8030-eb02-4d95-a532-d6949a83e83e] received 2024-05-11T00:48:00.392422597Z [2024-05-11 00:48:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e16a815-129c-4fca-a8d7-02c9835471ba] received 2024-05-11T00:48:00.396307922Z [2024-05-11 00:48:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29cf6fb7-6fa8-4d3a-9c4d-e9a71f2e074c] received 2024-05-11T00:48:00.401094489Z [2024-05-11 00:48:00,400: INFO/ForkPoolWorker-16] [0e16a815-129c-4fca-a8d7-02c9835471ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:48:00.405431086Z [2024-05-11 00:48:00,405: INFO/ForkPoolWorker-1] [29cf6fb7-6fa8-4d3a-9c4d-e9a71f2e074c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:48:00.405776375Z [2024-05-11 00:48:00,400: INFO/ForkPoolWorker-15] [172d8030-eb02-4d95-a532-d6949a83e83e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:48:00.412324097Z [2024-05-11 00:48:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dcd86ce-0d5c-49eb-b265-45cc2b40844c] received 2024-05-11T00:48:00.470921153Z [2024-05-11 00:48:00,470: INFO/ForkPoolWorker-2] [1dcd86ce-0d5c-49eb-b265-45cc2b40844c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:48:00.766438805Z [2024-05-11 00:48:00,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:48:00.936184096Z [2024-05-11 00:48:00,932: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:48:00.986156731Z [2024-05-11 00:48:00,982: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:48:01.155703213Z [2024-05-11 00:48:01,155: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:48:01.337396120Z [2024-05-11 00:48:01,336: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:48:01.341888684Z [2024-05-11 00:48:01,341: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:48:01.367447046Z [2024-05-11 00:48:01,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:48:01.368646660Z [2024-05-11 00:48:01,368: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:48:01.368911815Z [2024-05-11 00:48:01,368: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:48:01.368965854Z [2024-05-11 00:48:01,368: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:48:01.369203878Z [2024-05-11 00:48:01,369: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:48:01.554557969Z [2024-05-11 00:48:01,554: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:48:01.930111807Z [2024-05-11 00:48:01,924: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:48:02.312630037Z [2024-05-11 00:48:02,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[172d8030-eb02-4d95-a532-d6949a83e83e] succeeded in 1.9310041959997761s: None 2024-05-11T00:48:02.470160937Z [2024-05-11 00:48:02,469: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1dcd86ce-0d5c-49eb-b265-45cc2b40844c] succeeded in 2.051130006000676s: None 2024-05-11T00:48:02.636327272Z [2024-05-11 00:48:02,635: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:48:02.640411814Z [2024-05-11 00:48:02,639: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:48:02.665529948Z [2024-05-11 00:48:02,665: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:48:02.667637185Z [2024-05-11 00:48:02,667: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:48:02.667670427Z [2024-05-11 00:48:02,667: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:48:02.667787217Z [2024-05-11 00:48:02,667: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:48:02.667880359Z [2024-05-11 00:48:02,667: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:48:02.668259679Z [2024-05-11 00:48:02,668: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:48:02.668843148Z [2024-05-11 00:48:02,668: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:48:02.764033035Z [2024-05-11 00:48:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:48:03.392968182Z [2024-05-11 00:48:03,392: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:48:03.396255441Z [2024-05-11 00:48:03,395: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:48:03.421145319Z [2024-05-11 00:48:03,420: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:48:03.422707449Z [2024-05-11 00:48:03,422: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:48:03.422920683Z [2024-05-11 00:48:03,422: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:48:03.423203532Z [2024-05-11 00:48:03,422: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:48:03.423217424Z [2024-05-11 00:48:03,423: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:48:03.423596876Z [2024-05-11 00:48:03,423: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:48:03.423835843Z [2024-05-11 00:48:03,423: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:48:03.508012081Z [2024-05-11 00:48:03,507: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:48:04.646733660Z [2024-05-11 00:48:04,646: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e16a815-129c-4fca-a8d7-02c9835471ba] succeeded in 4.252399311000772s: None 2024-05-11T00:48:05.241016232Z [2024-05-11 00:48:05,240: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29cf6fb7-6fa8-4d3a-9c4d-e9a71f2e074c] succeeded in 4.8431845150007575s: None 2024-05-11T00:49:00.652988994Z [2024-05-11 00:49:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba45aa55-8fc3-4eb8-9ab1-2733e6c2889f] received 2024-05-11T00:49:00.662605708Z [2024-05-11 00:49:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20542516-55e8-43f5-96a5-b29145adc04c] received 2024-05-11T00:49:00.666262575Z [2024-05-11 00:49:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff7857b7-2c07-44df-bd30-4da8ec57201c] received 2024-05-11T00:49:00.671684667Z [2024-05-11 00:49:00,663: INFO/ForkPoolWorker-15] [ba45aa55-8fc3-4eb8-9ab1-2733e6c2889f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:49:00.682899032Z [2024-05-11 00:49:00,682: INFO/ForkPoolWorker-16] [20542516-55e8-43f5-96a5-b29145adc04c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:49:00.683262192Z [2024-05-11 00:49:00,682: INFO/ForkPoolWorker-1] [ff7857b7-2c07-44df-bd30-4da8ec57201c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:49:01.061965013Z [2024-05-11 00:49:01,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:49:01.077986288Z [2024-05-11 00:49:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:49:01.120657479Z [2024-05-11 00:49:01,116: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:49:01.338142113Z [2024-05-11 00:49:01,332: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:49:01.342521176Z [2024-05-11 00:49:01,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:49:01.380204147Z [2024-05-11 00:49:01,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:49:01.381424057Z [2024-05-11 00:49:01,381: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:49:01.381643483Z [2024-05-11 00:49:01,381: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:49:01.381735168Z [2024-05-11 00:49:01,381: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:49:01.381976450Z [2024-05-11 00:49:01,381: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:49:01.483287555Z [2024-05-11 00:49:01,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:49:02.111746259Z [2024-05-11 00:49:02,111: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff7857b7-2c07-44df-bd30-4da8ec57201c] succeeded in 1.4429974999984552s: None 2024-05-11T00:49:02.244244175Z [2024-05-11 00:49:02,243: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:49:02.247701634Z [2024-05-11 00:49:02,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:49:02.270275883Z [2024-05-11 00:49:02,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:49:02.271903495Z [2024-05-11 00:49:02,271: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:49:02.272219239Z [2024-05-11 00:49:02,272: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:49:02.272546461Z [2024-05-11 00:49:02,272: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:49:02.272744095Z [2024-05-11 00:49:02,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:49:02.273174336Z [2024-05-11 00:49:02,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:49:02.273789211Z [2024-05-11 00:49:02,273: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:49:02.352144420Z [2024-05-11 00:49:02,351: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:49:02.355581015Z [2024-05-11 00:49:02,355: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:49:02.377376266Z [2024-05-11 00:49:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:49:02.378805495Z [2024-05-11 00:49:02,378: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:49:02.378933637Z [2024-05-11 00:49:02,378: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:49:02.379135126Z [2024-05-11 00:49:02,378: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:49:02.379271538Z [2024-05-11 00:49:02,379: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:49:02.379578990Z [2024-05-11 00:49:02,379: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:49:02.379725008Z [2024-05-11 00:49:02,379: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:49:02.392021525Z [2024-05-11 00:49:02,391: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:49:02.464336033Z [2024-05-11 00:49:02,464: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:49:04.102894182Z [2024-05-11 00:49:04,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20542516-55e8-43f5-96a5-b29145adc04c] succeeded in 3.434160310000152s: None 2024-05-11T00:49:04.228678401Z [2024-05-11 00:49:04,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba45aa55-8fc3-4eb8-9ab1-2733e6c2889f] succeeded in 3.5727913880000415s: None 2024-05-11T00:50:00.539268284Z [2024-05-11 00:50:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae01f785-879f-4166-8314-f940a99e84f2] received 2024-05-11T00:50:00.541385212Z [2024-05-11 00:50:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5533702d-47d0-4c70-931a-5ca47911be10] received 2024-05-11T00:50:00.545006716Z [2024-05-11 00:50:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b03f6284-a6c1-4aff-9b14-49b020f10c85] received 2024-05-11T00:50:00.547945432Z [2024-05-11 00:50:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a38c5f4f-1b58-41c2-abf8-4ef2fae39263] received 2024-05-11T00:50:00.548420504Z [2024-05-11 00:50:00,547: INFO/ForkPoolWorker-16] [5533702d-47d0-4c70-931a-5ca47911be10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:50:00.552796677Z [2024-05-11 00:50:00,552: INFO/ForkPoolWorker-15] [ae01f785-879f-4166-8314-f940a99e84f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:00.553492897Z [2024-05-11 00:50:00,553: INFO/ForkPoolWorker-1] [b03f6284-a6c1-4aff-9b14-49b020f10c85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:50:00.554745442Z [2024-05-11 00:50:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99122680-a964-45b7-ab93-a354ddd2cb40] received 2024-05-11T00:50:00.557547411Z [2024-05-11 00:50:00,557: INFO/ForkPoolWorker-2] [a38c5f4f-1b58-41c2-abf8-4ef2fae39263] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:50:00.568970086Z [2024-05-11 00:50:00,567: INFO/ForkPoolWorker-3] [99122680-a964-45b7-ab93-a354ddd2cb40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:50:00.923431541Z [2024-05-11 00:50:00,919: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:50:00.966594878Z [2024-05-11 00:50:00,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:50:00.980470351Z [2024-05-11 00:50:00,976: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:50:01.050056280Z [2024-05-11 00:50:01,032: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:50:01.320230446Z [2024-05-11 00:50:01,319: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:01.353245010Z [2024-05-11 00:50:01,343: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:50:01.395566855Z [2024-05-11 00:50:01,395: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:50:01.399893195Z [2024-05-11 00:50:01,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:01.440377685Z [2024-05-11 00:50:01,440: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:50:01.441767605Z [2024-05-11 00:50:01,441: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:50:01.442065779Z [2024-05-11 00:50:01,441: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:50:01.442286597Z [2024-05-11 00:50:01,442: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:50:01.442832740Z [2024-05-11 00:50:01,442: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:50:01.578924708Z [2024-05-11 00:50:01,578: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:02.037657004Z [2024-05-11 00:50:02,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5533702d-47d0-4c70-931a-5ca47911be10] succeeded in 1.4946499289999338s: None 2024-05-11T00:50:02.311906259Z [2024-05-11 00:50:02,311: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b03f6284-a6c1-4aff-9b14-49b020f10c85] succeeded in 1.7651744009999675s: None 2024-05-11T00:50:02.571883109Z [2024-05-11 00:50:02,571: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:50:02.575109740Z [2024-05-11 00:50:02,574: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:02.587442516Z [2024-05-11 00:50:02,587: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:50:02.591635919Z [2024-05-11 00:50:02,591: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:02.602026859Z [2024-05-11 00:50:02,601: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:50:02.603736955Z [2024-05-11 00:50:02,603: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:02.603752597Z [2024-05-11 00:50:02,603: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:02.603901198Z [2024-05-11 00:50:02,603: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:02.603974663Z [2024-05-11 00:50:02,603: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:50:02.604200710Z [2024-05-11 00:50:02,604: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:50:02.604244428Z [2024-05-11 00:50:02,604: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:02.610876464Z [2024-05-11 00:50:02,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:50:02.612143463Z [2024-05-11 00:50:02,611: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:02.612309981Z [2024-05-11 00:50:02,612: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:02.612521401Z [2024-05-11 00:50:02,612: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:02.612664043Z [2024-05-11 00:50:02,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:50:02.614661854Z [2024-05-11 00:50:02,614: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:50:02.614856490Z [2024-05-11 00:50:02,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:02.723970984Z [2024-05-11 00:50:02,723: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:02.725712677Z [2024-05-11 00:50:02,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:02.876286419Z [2024-05-11 00:50:02,875: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T00:50:02.879774652Z [2024-05-11 00:50:02,879: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:02.905475427Z [2024-05-11 00:50:02,905: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T00:50:02.906659520Z [2024-05-11 00:50:02,906: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:02.906734344Z [2024-05-11 00:50:02,906: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:02.906864966Z [2024-05-11 00:50:02,906: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:02.906919013Z [2024-05-11 00:50:02,906: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T00:50:02.907135406Z [2024-05-11 00:50:02,907: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:50:02.907222503Z [2024-05-11 00:50:02,907: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:03.000593873Z [2024-05-11 00:50:02,999: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:03.297200091Z [2024-05-11 00:50:03,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae01f785-879f-4166-8314-f940a99e84f2] succeeded in 2.7543027119991166s: None 2024-05-11T00:50:04.311844743Z [2024-05-11 00:50:04,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c84abd1-9ce4-4507-8e9c-5f891c3baae6] received 2024-05-11T00:50:04.331017987Z [2024-05-11 00:50:04,330: INFO/ForkPoolWorker-15] [2c84abd1-9ce4-4507-8e9c-5f891c3baae6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:04.432025649Z [2024-05-11 00:50:04,431: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[99122680-a964-45b7-ab93-a354ddd2cb40] succeeded in 3.874025568999059s: None 2024-05-11T00:50:04.606612965Z [2024-05-11 00:50:04,606: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a38c5f4f-1b58-41c2-abf8-4ef2fae39263] succeeded in 4.056295463000424s: None 2024-05-11T00:50:04.627704076Z [2024-05-11 00:50:04,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:50:05.767036406Z [2024-05-11 00:50:05,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:50:05.770685407Z [2024-05-11 00:50:05,770: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:05.800576487Z [2024-05-11 00:50:05,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:50:05.803079375Z [2024-05-11 00:50:05,802: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:05.803511035Z [2024-05-11 00:50:05,803: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:05.804092258Z [2024-05-11 00:50:05,803: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:05.804580344Z [2024-05-11 00:50:05,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:50:05.805594101Z [2024-05-11 00:50:05,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:50:05.806079008Z [2024-05-11 00:50:05,805: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:05.896047094Z [2024-05-11 00:50:05,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:06.511335729Z [2024-05-11 00:50:06,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c84abd1-9ce4-4507-8e9c-5f891c3baae6] succeeded in 2.1972114620002685s: None 2024-05-11T00:50:06.744880233Z [2024-05-11 00:50:06,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a6cb2a8-37b7-420f-ac17-316de7d6aed4] received 2024-05-11T00:50:06.768107391Z [2024-05-11 00:50:06,767: INFO/ForkPoolWorker-15] [9a6cb2a8-37b7-420f-ac17-316de7d6aed4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:50:07.161788538Z [2024-05-11 00:50:07,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:50:08.334837521Z [2024-05-11 00:50:08,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:50:08.338065981Z [2024-05-11 00:50:08,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:08.359498119Z [2024-05-11 00:50:08,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:50:08.360768109Z [2024-05-11 00:50:08,360: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:08.360794830Z [2024-05-11 00:50:08,360: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:08.360895127Z [2024-05-11 00:50:08,360: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:08.360904283Z [2024-05-11 00:50:08,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:50:08.361232597Z [2024-05-11 00:50:08,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:50:08.361245868Z [2024-05-11 00:50:08,361: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:08.462265220Z [2024-05-11 00:50:08,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:09.033933030Z [2024-05-11 00:50:09,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a6cb2a8-37b7-420f-ac17-316de7d6aed4] succeeded in 2.2848329030002787s: None 2024-05-11T00:50:09.160434003Z [2024-05-11 00:50:09,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1a67210-e439-4124-89dd-da6b70e09eb4] received 2024-05-11T00:50:09.171714879Z [2024-05-11 00:50:09,171: INFO/ForkPoolWorker-15] [c1a67210-e439-4124-89dd-da6b70e09eb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:50:09.436291001Z [2024-05-11 00:50:09,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:50:10.617469312Z [2024-05-11 00:50:10,617: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:50:10.620734463Z [2024-05-11 00:50:10,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:50:10.643013771Z [2024-05-11 00:50:10,642: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:50:10.644246564Z [2024-05-11 00:50:10,644: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:50:10.644333305Z [2024-05-11 00:50:10,644: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:50:10.644549852Z [2024-05-11 00:50:10,644: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:50:10.644697945Z [2024-05-11 00:50:10,644: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:50:10.645058103Z [2024-05-11 00:50:10,644: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:50:10.645167265Z [2024-05-11 00:50:10,645: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:50:10.726697398Z [2024-05-11 00:50:10,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:50:11.376252221Z [2024-05-11 00:50:11,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1a67210-e439-4124-89dd-da6b70e09eb4] succeeded in 2.2107109780008614s: None 2024-05-11T00:51:00.423457955Z [2024-05-11 00:51:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4742057b-ea59-4c63-8906-54a7566e27df] received 2024-05-11T00:51:00.428842243Z [2024-05-11 00:51:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f9d9476-6eab-4343-a350-5f3c132ce31a] received 2024-05-11T00:51:00.436325214Z [2024-05-11 00:51:00,435: INFO/ForkPoolWorker-16] [2f9d9476-6eab-4343-a350-5f3c132ce31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:51:00.440106803Z [2024-05-11 00:51:00,439: INFO/ForkPoolWorker-15] [4742057b-ea59-4c63-8906-54a7566e27df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:51:00.461186259Z [2024-05-11 00:51:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5045daf9-f8a4-4615-8ebf-b51a4adeb8fd] received 2024-05-11T00:51:00.467746600Z [2024-05-11 00:51:00,467: INFO/ForkPoolWorker-1] [5045daf9-f8a4-4615-8ebf-b51a4adeb8fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:51:00.702941211Z [2024-05-11 00:51:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:51:00.789973148Z [2024-05-11 00:51:00,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:51:00.795895651Z [2024-05-11 00:51:00,792: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:51:00.956211000Z [2024-05-11 00:51:00,955: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:51:00.960222347Z [2024-05-11 00:51:00,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:51:00.989556977Z [2024-05-11 00:51:00,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:51:00.998815915Z [2024-05-11 00:51:00,998: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:51:00.998870976Z [2024-05-11 00:51:00,998: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:51:00.998882324Z [2024-05-11 00:51:00,998: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:51:00.999220660Z [2024-05-11 00:51:00,999: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:51:01.155264200Z [2024-05-11 00:51:01,154: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:51:01.735148665Z [2024-05-11 00:51:01,734: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5045daf9-f8a4-4615-8ebf-b51a4adeb8fd] succeeded in 1.2723331329998473s: None 2024-05-11T00:51:01.984827054Z [2024-05-11 00:51:01,984: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:51:01.988733978Z [2024-05-11 00:51:01,988: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:51:02.008952877Z [2024-05-11 00:51:02,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:51:02.010193632Z [2024-05-11 00:51:02,009: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:51:02.010207269Z [2024-05-11 00:51:02,010: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:51:02.010336242Z [2024-05-11 00:51:02,010: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:51:02.010343220Z [2024-05-11 00:51:02,010: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:51:02.010572010Z [2024-05-11 00:51:02,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:51:02.010578824Z [2024-05-11 00:51:02,010: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:51:02.024077358Z [2024-05-11 00:51:02,023: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:51:02.027632517Z [2024-05-11 00:51:02,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:51:02.051882838Z [2024-05-11 00:51:02,051: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:51:02.053222175Z [2024-05-11 00:51:02,052: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:51:02.053249598Z [2024-05-11 00:51:02,053: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:51:02.053476539Z [2024-05-11 00:51:02,053: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:51:02.053533240Z [2024-05-11 00:51:02,053: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:51:02.053897120Z [2024-05-11 00:51:02,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:51:02.054310342Z [2024-05-11 00:51:02,053: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:51:02.110835968Z [2024-05-11 00:51:02,110: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:51:02.133580828Z [2024-05-11 00:51:02,133: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:51:03.908691094Z [2024-05-11 00:51:03,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f9d9476-6eab-4343-a350-5f3c132ce31a] succeeded in 3.478273910999633s: None 2024-05-11T00:51:04.616711922Z [2024-05-11 00:51:04,616: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4742057b-ea59-4c63-8906-54a7566e27df] succeeded in 4.18642793700019s: None 2024-05-11T00:52:00.314015132Z [2024-05-11 00:52:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16dd0b82-89bd-4ed4-9d92-fbadc3a29783] received 2024-05-11T00:52:00.321184501Z [2024-05-11 00:52:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00136c92-bd70-4f06-807a-018ff438fe28] received 2024-05-11T00:52:00.328705145Z [2024-05-11 00:52:00,328: INFO/ForkPoolWorker-16] [00136c92-bd70-4f06-807a-018ff438fe28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:52:00.335206885Z [2024-05-11 00:52:00,334: INFO/ForkPoolWorker-15] [16dd0b82-89bd-4ed4-9d92-fbadc3a29783] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:52:00.377308013Z [2024-05-11 00:52:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75e14185-44d1-489a-a7f6-9d20aaac317a] received 2024-05-11T00:52:00.378942864Z [2024-05-11 00:52:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7e7034a-0693-44a6-a6b2-a533cb7d6831] received 2024-05-11T00:52:00.426861906Z [2024-05-11 00:52:00,426: INFO/ForkPoolWorker-1] [75e14185-44d1-489a-a7f6-9d20aaac317a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:52:00.443017084Z [2024-05-11 00:52:00,442: INFO/ForkPoolWorker-2] [a7e7034a-0693-44a6-a6b2-a533cb7d6831] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:52:00.915209839Z [2024-05-11 00:52:00,912: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:52:00.934318692Z [2024-05-11 00:52:00,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:52:01.181409344Z [2024-05-11 00:52:01,177: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:52:01.311037527Z [2024-05-11 00:52:01,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:52:01.355947404Z [2024-05-11 00:52:01,355: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:52:01.360106904Z [2024-05-11 00:52:01,359: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:52:01.387096573Z [2024-05-11 00:52:01,386: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:52:01.388252201Z [2024-05-11 00:52:01,388: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:52:01.388501375Z [2024-05-11 00:52:01,388: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:52:01.388623441Z [2024-05-11 00:52:01,388: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:52:01.389217381Z [2024-05-11 00:52:01,388: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:52:01.473057776Z [2024-05-11 00:52:01,472: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:52:01.749150991Z [2024-05-11 00:52:01,745: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:52:01.847023481Z [2024-05-11 00:52:01,846: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16dd0b82-89bd-4ed4-9d92-fbadc3a29783] succeeded in 1.5315805889986223s: None 2024-05-11T00:52:02.071646719Z [2024-05-11 00:52:02,071: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a7e7034a-0693-44a6-a6b2-a533cb7d6831] succeeded in 1.6845340269992448s: None 2024-05-11T00:52:02.414882382Z [2024-05-11 00:52:02,414: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:52:02.418066927Z [2024-05-11 00:52:02,417: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:52:02.470746913Z [2024-05-11 00:52:02,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:52:02.473092390Z [2024-05-11 00:52:02,472: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:52:02.473187922Z [2024-05-11 00:52:02,473: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:52:02.473408539Z [2024-05-11 00:52:02,473: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:52:02.473467322Z [2024-05-11 00:52:02,473: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:52:02.473812042Z [2024-05-11 00:52:02,473: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:52:02.474060930Z [2024-05-11 00:52:02,473: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:52:02.595777490Z [2024-05-11 00:52:02,595: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:52:03.036037492Z [2024-05-11 00:52:03,035: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:52:03.039240098Z [2024-05-11 00:52:03,038: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:52:03.058060466Z [2024-05-11 00:52:03,057: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:52:03.059471197Z [2024-05-11 00:52:03,059: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:52:03.059532160Z [2024-05-11 00:52:03,059: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:52:03.059710167Z [2024-05-11 00:52:03,059: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:52:03.059789888Z [2024-05-11 00:52:03,059: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:52:03.060055750Z [2024-05-11 00:52:03,059: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:52:03.060138103Z [2024-05-11 00:52:03,060: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:52:03.148139996Z [2024-05-11 00:52:03,147: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:52:04.429138820Z [2024-05-11 00:52:04,428: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00136c92-bd70-4f06-807a-018ff438fe28] succeeded in 4.105046284001219s: None 2024-05-11T00:52:04.897066596Z [2024-05-11 00:52:04,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75e14185-44d1-489a-a7f6-9d20aaac317a] succeeded in 4.517013686998325s: None 2024-05-11T00:53:00.563462067Z [2024-05-11 00:53:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2410e44b-695e-4cd5-bd63-d5b0f7b1a015] received 2024-05-11T00:53:00.573905688Z [2024-05-11 00:53:00,573: INFO/ForkPoolWorker-15] [2410e44b-695e-4cd5-bd63-d5b0f7b1a015] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:53:00.586421557Z [2024-05-11 00:53:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ebe5223-9a73-4e8b-81e4-1021fa289840] received 2024-05-11T00:53:00.599605328Z [2024-05-11 00:53:00,599: INFO/ForkPoolWorker-16] [6ebe5223-9a73-4e8b-81e4-1021fa289840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:53:00.606660717Z [2024-05-11 00:53:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c14df5a-34db-4f60-b846-2b282dace8f7] received 2024-05-11T00:53:00.629885947Z [2024-05-11 00:53:00,629: INFO/ForkPoolWorker-1] [9c14df5a-34db-4f60-b846-2b282dace8f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:53:00.902181456Z [2024-05-11 00:53:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:53:00.995966988Z [2024-05-11 00:53:00,992: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:53:01.011374796Z [2024-05-11 00:53:01,000: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:53:01.327933840Z [2024-05-11 00:53:01,327: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:53:01.333619450Z [2024-05-11 00:53:01,333: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:53:01.369827310Z [2024-05-11 00:53:01,369: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:53:01.371164794Z [2024-05-11 00:53:01,370: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:53:01.371191546Z [2024-05-11 00:53:01,371: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:53:01.371300929Z [2024-05-11 00:53:01,371: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:53:01.371431787Z [2024-05-11 00:53:01,371: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:53:01.459332401Z [2024-05-11 00:53:01,458: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:53:01.990065324Z [2024-05-11 00:53:01,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c14df5a-34db-4f60-b846-2b282dace8f7] succeeded in 1.3795314540002437s: None 2024-05-11T00:53:02.259490432Z [2024-05-11 00:53:02,258: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:53:02.262988901Z [2024-05-11 00:53:02,262: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:53:02.286433946Z [2024-05-11 00:53:02,286: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:53:02.288050916Z [2024-05-11 00:53:02,287: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:53:02.288211052Z [2024-05-11 00:53:02,287: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:53:02.288476331Z [2024-05-11 00:53:02,288: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:53:02.288623081Z [2024-05-11 00:53:02,288: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:53:02.288955673Z [2024-05-11 00:53:02,288: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:53:02.289428408Z [2024-05-11 00:53:02,288: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:53:02.304373267Z [2024-05-11 00:53:02,304: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:53:02.308163094Z [2024-05-11 00:53:02,307: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:53:02.330899078Z [2024-05-11 00:53:02,330: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:53:02.332336599Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:53:02.332358276Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:53:02.332579168Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:53:02.332591571Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:53:02.332920248Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:53:02.332993580Z [2024-05-11 00:53:02,332: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:53:02.366391835Z [2024-05-11 00:53:02,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:53:02.425853477Z [2024-05-11 00:53:02,425: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:53:03.790094983Z [2024-05-11 00:53:03,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ebe5223-9a73-4e8b-81e4-1021fa289840] succeeded in 3.2023078670008545s: None 2024-05-11T00:53:04.164294574Z [2024-05-11 00:53:04,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2410e44b-695e-4cd5-bd63-d5b0f7b1a015] succeeded in 3.597020273999078s: None 2024-05-11T00:54:00.780119364Z [2024-05-11 00:54:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0425ca9-327a-4cf7-8640-a1f52796866d] received 2024-05-11T00:54:00.782303446Z [2024-05-11 00:54:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48643e97-7781-443a-ab3d-5136c0b3bdbb] received 2024-05-11T00:54:00.792633497Z [2024-05-11 00:54:00,792: INFO/ForkPoolWorker-16] [48643e97-7781-443a-ab3d-5136c0b3bdbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:54:00.793724508Z [2024-05-11 00:54:00,793: INFO/ForkPoolWorker-15] [b0425ca9-327a-4cf7-8640-a1f52796866d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:54:00.799576760Z [2024-05-11 00:54:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4fb5ebe-02b2-4d0d-ac82-097deebe6ce0] received 2024-05-11T00:54:00.802189628Z [2024-05-11 00:54:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74babc61-4fd6-40ae-8313-5052b97b1a2d] received 2024-05-11T00:54:00.818699940Z [2024-05-11 00:54:00,818: INFO/ForkPoolWorker-1] [b4fb5ebe-02b2-4d0d-ac82-097deebe6ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:54:00.820044704Z [2024-05-11 00:54:00,819: INFO/ForkPoolWorker-2] [74babc61-4fd6-40ae-8313-5052b97b1a2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:54:01.123955060Z [2024-05-11 00:54:01,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:54:01.263367611Z [2024-05-11 00:54:01,260: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:54:01.354885281Z [2024-05-11 00:54:01,349: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:54:01.435533702Z [2024-05-11 00:54:01,431: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:54:01.516496005Z [2024-05-11 00:54:01,516: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:54:01.597945249Z [2024-05-11 00:54:01,597: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T00:54:01.602253559Z [2024-05-11 00:54:01,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:54:01.629265896Z [2024-05-11 00:54:01,628: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:54:01.630774641Z [2024-05-11 00:54:01,630: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:54:01.630807098Z [2024-05-11 00:54:01,630: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:54:01.630824185Z [2024-05-11 00:54:01,630: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T00:54:01.631389119Z [2024-05-11 00:54:01,631: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:54:01.796735154Z [2024-05-11 00:54:01,796: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:54:02.141138763Z [2024-05-11 00:54:02,140: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0425ca9-327a-4cf7-8640-a1f52796866d] succeeded in 1.3564701659997809s: None 2024-05-11T00:54:02.571203086Z [2024-05-11 00:54:02,570: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74babc61-4fd6-40ae-8313-5052b97b1a2d] succeeded in 1.7654884490002587s: None 2024-05-11T00:54:02.761418633Z [2024-05-11 00:54:02,761: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:54:02.764913491Z [2024-05-11 00:54:02,764: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:54:02.792198528Z [2024-05-11 00:54:02,791: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:54:02.793619213Z [2024-05-11 00:54:02,793: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:54:02.793658687Z [2024-05-11 00:54:02,793: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:54:02.793835879Z [2024-05-11 00:54:02,793: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:54:02.793854357Z [2024-05-11 00:54:02,793: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:54:02.794664675Z [2024-05-11 00:54:02,794: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:54:02.794724803Z [2024-05-11 00:54:02,794: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:54:02.840280524Z [2024-05-11 00:54:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:54:02.843666309Z [2024-05-11 00:54:02,843: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:54:02.870931974Z [2024-05-11 00:54:02,870: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:54:02.872634413Z [2024-05-11 00:54:02,871: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:54:02.872686815Z [2024-05-11 00:54:02,872: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:54:02.872807138Z [2024-05-11 00:54:02,872: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:54:02.872840535Z [2024-05-11 00:54:02,872: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:54:02.873256842Z [2024-05-11 00:54:02,873: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:54:02.873336631Z [2024-05-11 00:54:02,873: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:54:02.877528953Z [2024-05-11 00:54:02,877: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:54:02.962257016Z [2024-05-11 00:54:02,961: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:54:04.647638648Z [2024-05-11 00:54:04,647: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4fb5ebe-02b2-4d0d-ac82-097deebe6ce0] succeeded in 3.846166440000161s: None 2024-05-11T00:54:04.885622731Z [2024-05-11 00:54:04,885: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48643e97-7781-443a-ab3d-5136c0b3bdbb] succeeded in 4.100133520998497s: None 2024-05-11T00:55:01.154010821Z [2024-05-11 00:55:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d081ff3c-0450-4814-9fbd-ba49fdd95457] received 2024-05-11T00:55:01.157715893Z [2024-05-11 00:55:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94f3f3e6-6c29-4792-96f4-e919d2481e00] received 2024-05-11T00:55:01.163666895Z [2024-05-11 00:55:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b8a9a5-385b-4e34-acd7-5f7acab45ea5] received 2024-05-11T00:55:01.165660813Z [2024-05-11 00:55:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63200cd4-6f6a-4cee-9d96-20692f5b768c] received 2024-05-11T00:55:01.170905852Z [2024-05-11 00:55:01,169: INFO/ForkPoolWorker-15] [d081ff3c-0450-4814-9fbd-ba49fdd95457] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:55:01.176604679Z [2024-05-11 00:55:01,176: INFO/ForkPoolWorker-1] [e8b8a9a5-385b-4e34-acd7-5f7acab45ea5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:55:01.179689981Z [2024-05-11 00:55:01,179: INFO/ForkPoolWorker-16] [94f3f3e6-6c29-4792-96f4-e919d2481e00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:01.182934400Z [2024-05-11 00:55:01,182: INFO/ForkPoolWorker-2] [63200cd4-6f6a-4cee-9d96-20692f5b768c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:55:01.563745996Z [2024-05-11 00:55:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:55:01.571403121Z [2024-05-11 00:55:01,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:55:01.632717967Z [2024-05-11 00:55:01,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:55:01.821741662Z [2024-05-11 00:55:01,821: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:55:01.831257165Z [2024-05-11 00:55:01,825: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:01.890457116Z [2024-05-11 00:55:01,890: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:55:01.892414970Z [2024-05-11 00:55:01,892: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:55:01.892521782Z [2024-05-11 00:55:01,892: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:55:01.892656797Z [2024-05-11 00:55:01,892: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:55:01.893069188Z [2024-05-11 00:55:01,892: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:55:01.912989974Z [2024-05-11 00:55:01,904: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:55:01.996693329Z [2024-05-11 00:55:01,996: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:02.622974801Z [2024-05-11 00:55:02,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e8b8a9a5-385b-4e34-acd7-5f7acab45ea5] succeeded in 1.4563691559997096s: None 2024-05-11T00:55:03.020000050Z [2024-05-11 00:55:03,019: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:55:03.023987344Z [2024-05-11 00:55:03,023: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:03.042361310Z [2024-05-11 00:55:03,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:55:03.044380571Z [2024-05-11 00:55:03,044: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:03.044485129Z [2024-05-11 00:55:03,044: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:03.044797801Z [2024-05-11 00:55:03,044: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:03.044973187Z [2024-05-11 00:55:03,044: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:55:03.045316335Z [2024-05-11 00:55:03,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:55:03.045450347Z [2024-05-11 00:55:03,045: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:03.129055282Z [2024-05-11 00:55:03,128: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:55:03.132609304Z [2024-05-11 00:55:03,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:03.150076892Z [2024-05-11 00:55:03,149: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:55:03.153551828Z [2024-05-11 00:55:03,153: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:03.157695630Z [2024-05-11 00:55:03,157: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:55:03.159344916Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:03.159357687Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:03.159555717Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:03.159675514Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:55:03.160136821Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:55:03.160149969Z [2024-05-11 00:55:03,160: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:03.160368274Z [2024-05-11 00:55:03,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:03.179959052Z [2024-05-11 00:55:03,179: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:55:03.181355430Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:03.181387477Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:03.181597625Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:03.181610202Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:55:03.181964012Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:55:03.182050377Z [2024-05-11 00:55:03,181: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:03.246539606Z [2024-05-11 00:55:03,246: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:03.286349889Z [2024-05-11 00:55:03,286: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:03.853776683Z [2024-05-11 00:55:03,853: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94f3f3e6-6c29-4792-96f4-e919d2481e00] succeeded in 2.687258155001473s: None 2024-05-11T00:55:04.023931356Z [2024-05-11 00:55:04,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a707bf2-fb1f-4efd-af2f-353b587f3f36] received 2024-05-11T00:55:04.030813471Z [2024-05-11 00:55:04,030: INFO/ForkPoolWorker-16] [8a707bf2-fb1f-4efd-af2f-353b587f3f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:04.331035176Z [2024-05-11 00:55:04,327: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:55:04.670807013Z [2024-05-11 00:55:04,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d081ff3c-0450-4814-9fbd-ba49fdd95457] succeeded in 3.514763850000236s: None 2024-05-11T00:55:05.242137417Z [2024-05-11 00:55:05,241: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[63200cd4-6f6a-4cee-9d96-20692f5b768c] succeeded in 4.071248201998969s: None 2024-05-11T00:55:05.441229029Z [2024-05-11 00:55:05,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:55:05.444713478Z [2024-05-11 00:55:05,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:05.468265760Z [2024-05-11 00:55:05,468: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:55:05.470278598Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:05.470307134Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:05.470453267Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:05.470473328Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:55:05.470773251Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:55:05.470779465Z [2024-05-11 00:55:05,470: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:05.538517861Z [2024-05-11 00:55:05,538: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:06.117073819Z [2024-05-11 00:55:06,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a707bf2-fb1f-4efd-af2f-353b587f3f36] succeeded in 2.0911196430006385s: None 2024-05-11T00:55:06.595314588Z [2024-05-11 00:55:06,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2179f6b3-a2cd-4ab2-978a-c28fb5fb9fd5] received 2024-05-11T00:55:06.602226792Z [2024-05-11 00:55:06,601: INFO/ForkPoolWorker-15] [2179f6b3-a2cd-4ab2-978a-c28fb5fb9fd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T00:55:06.973936188Z [2024-05-11 00:55:06,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:55:08.179459687Z [2024-05-11 00:55:08,179: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:55:08.182856478Z [2024-05-11 00:55:08,182: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:08.219052904Z [2024-05-11 00:55:08,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:55:08.223408745Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:08.223462510Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:08.223597674Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:08.223605447Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:55:08.223995616Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:55:08.224077074Z [2024-05-11 00:55:08,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:08.313618842Z [2024-05-11 00:55:08,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:08.913573313Z [2024-05-11 00:55:08,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2179f6b3-a2cd-4ab2-978a-c28fb5fb9fd5] succeeded in 2.3165894580015447s: None 2024-05-11T00:55:08.996091327Z [2024-05-11 00:55:08,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd55cc45-231b-481e-8ae4-548c92be7be2] received 2024-05-11T00:55:09.005016507Z [2024-05-11 00:55:09,004: INFO/ForkPoolWorker-15] [bd55cc45-231b-481e-8ae4-548c92be7be2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T00:55:09.274619101Z [2024-05-11 00:55:09,271: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T00:55:10.346109066Z [2024-05-11 00:55:10,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:55:10.350094912Z [2024-05-11 00:55:10,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:55:10.368227994Z [2024-05-11 00:55:10,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:55:10.369600650Z [2024-05-11 00:55:10,369: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:55:10.369798637Z [2024-05-11 00:55:10,369: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:55:10.370115396Z [2024-05-11 00:55:10,369: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:55:10.370289628Z [2024-05-11 00:55:10,370: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:55:10.370741738Z [2024-05-11 00:55:10,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T00:55:10.370906886Z [2024-05-11 00:55:10,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:55:10.450727058Z [2024-05-11 00:55:10,450: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:55:11.048986693Z [2024-05-11 00:55:11,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd55cc45-231b-481e-8ae4-548c92be7be2] succeeded in 2.050718780999887s: None 2024-05-11T00:56:00.223200682Z [2024-05-11 00:56:00,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d0cec69-530c-4e4b-8156-6093d8dbf340] received 2024-05-11T00:56:00.227105432Z [2024-05-11 00:56:00,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f510658b-4520-4aae-8937-3e13c8ef9d52] received 2024-05-11T00:56:00.232178853Z [2024-05-11 00:56:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4782c71-929e-4ab3-910e-6376c0a57d53] received 2024-05-11T00:56:00.239852537Z [2024-05-11 00:56:00,239: INFO/ForkPoolWorker-16] [f510658b-4520-4aae-8937-3e13c8ef9d52] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:56:00.241048907Z [2024-05-11 00:56:00,240: INFO/ForkPoolWorker-15] [2d0cec69-530c-4e4b-8156-6093d8dbf340] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:56:00.241335492Z [2024-05-11 00:56:00,240: INFO/ForkPoolWorker-1] [e4782c71-929e-4ab3-910e-6376c0a57d53] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:56:00.243226126Z [2024-05-11 00:56:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[554c6c68-21ff-4198-80c1-e01389c8bd09] received 2024-05-11T00:56:00.249526577Z [2024-05-11 00:56:00,249: INFO/ForkPoolWorker-2] [554c6c68-21ff-4198-80c1-e01389c8bd09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:56:00.579292065Z [2024-05-11 00:56:00,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:56:00.584552825Z [2024-05-11 00:56:00,581: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:56:00.595898948Z [2024-05-11 00:56:00,592: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:56:00.634605178Z [2024-05-11 00:56:00,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:56:00.856242026Z [2024-05-11 00:56:00,855: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:56:00.863219320Z [2024-05-11 00:56:00,861: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:56:00.864893025Z [2024-05-11 00:56:00,864: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:56:00.908722243Z [2024-05-11 00:56:00,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:56:00.909841095Z [2024-05-11 00:56:00,909: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:56:00.910005641Z [2024-05-11 00:56:00,909: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:56:00.910059337Z [2024-05-11 00:56:00,909: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:56:00.910381227Z [2024-05-11 00:56:00,910: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:56:01.086617232Z [2024-05-11 00:56:01,083: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:56:01.591843129Z [2024-05-11 00:56:01,591: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f510658b-4520-4aae-8937-3e13c8ef9d52] succeeded in 1.3614311700002872s: None 2024-05-11T00:56:01.740701742Z [2024-05-11 00:56:01,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4782c71-929e-4ab3-910e-6376c0a57d53] succeeded in 1.5059740300002886s: None 2024-05-11T00:56:01.913360739Z [2024-05-11 00:56:01,913: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:56:01.917310501Z [2024-05-11 00:56:01,916: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:56:01.928697352Z [2024-05-11 00:56:01,928: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:56:01.932985352Z [2024-05-11 00:56:01,932: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:56:01.944520523Z [2024-05-11 00:56:01,944: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:56:01.945742763Z [2024-05-11 00:56:01,945: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:56:01.945759466Z [2024-05-11 00:56:01,945: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:56:01.945930846Z [2024-05-11 00:56:01,945: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:56:01.945990380Z [2024-05-11 00:56:01,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:56:01.946255174Z [2024-05-11 00:56:01,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:56:01.946353615Z [2024-05-11 00:56:01,946: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:56:01.954808781Z [2024-05-11 00:56:01,954: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:56:01.955967052Z [2024-05-11 00:56:01,955: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:56:01.955977974Z [2024-05-11 00:56:01,955: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:56:01.956093965Z [2024-05-11 00:56:01,955: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:56:01.956108654Z [2024-05-11 00:56:01,956: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:56:01.956376057Z [2024-05-11 00:56:01,956: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:56:01.956427006Z [2024-05-11 00:56:01,956: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:56:02.023624285Z [2024-05-11 00:56:02,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:56:02.060534550Z [2024-05-11 00:56:02,060: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:56:03.596148550Z [2024-05-11 00:56:03,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d0cec69-530c-4e4b-8156-6093d8dbf340] succeeded in 3.370602768000026s: None 2024-05-11T00:56:04.377611201Z [2024-05-11 00:56:04,377: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[554c6c68-21ff-4198-80c1-e01389c8bd09] succeeded in 4.132829641999706s: None 2024-05-11T00:57:01.078431201Z [2024-05-11 00:57:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1821dab8-b6ef-41ce-b986-8f02af9fcb2c] received 2024-05-11T00:57:01.081681327Z [2024-05-11 00:57:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3ea593d-d708-404c-ad58-ebe4d65cad23] received 2024-05-11T00:57:01.083117623Z [2024-05-11 00:57:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08065b8c-8b6c-49dc-9134-8ce78ba8bd09] received 2024-05-11T00:57:01.087470337Z [2024-05-11 00:57:01,087: INFO/ForkPoolWorker-15] [1821dab8-b6ef-41ce-b986-8f02af9fcb2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:57:01.089606865Z [2024-05-11 00:57:01,089: INFO/ForkPoolWorker-1] [08065b8c-8b6c-49dc-9134-8ce78ba8bd09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:57:01.110211711Z [2024-05-11 00:57:01,107: INFO/ForkPoolWorker-16] [c3ea593d-d708-404c-ad58-ebe4d65cad23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:57:01.462580467Z [2024-05-11 00:57:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:57:01.468831581Z [2024-05-11 00:57:01,463: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:57:01.485983668Z [2024-05-11 00:57:01,482: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:57:01.629192202Z [2024-05-11 00:57:01,628: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T00:57:01.633298628Z [2024-05-11 00:57:01,632: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:57:01.658989064Z [2024-05-11 00:57:01,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:57:01.660252149Z [2024-05-11 00:57:01,660: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:57:01.660525292Z [2024-05-11 00:57:01,660: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:57:01.660665909Z [2024-05-11 00:57:01,660: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T00:57:01.660966837Z [2024-05-11 00:57:01,660: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:57:01.757973717Z [2024-05-11 00:57:01,757: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:57:02.440147043Z [2024-05-11 00:57:02,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1821dab8-b6ef-41ce-b986-8f02af9fcb2c] succeeded in 1.3610546520012576s: None 2024-05-11T00:57:02.660632091Z [2024-05-11 00:57:02,660: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:57:02.664191658Z [2024-05-11 00:57:02,663: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:57:02.697566654Z [2024-05-11 00:57:02,697: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T00:57:02.698589454Z [2024-05-11 00:57:02,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:57:02.700726881Z [2024-05-11 00:57:02,700: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:57:02.701027378Z [2024-05-11 00:57:02,700: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:57:02.701321042Z [2024-05-11 00:57:02,700: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:57:02.701334778Z [2024-05-11 00:57:02,700: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:57:02.701525761Z [2024-05-11 00:57:02,701: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:57:02.702101248Z [2024-05-11 00:57:02,701: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:57:02.702350634Z [2024-05-11 00:57:02,702: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:57:02.725351833Z [2024-05-11 00:57:02,724: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:57:02.727092851Z [2024-05-11 00:57:02,726: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:57:02.727112900Z [2024-05-11 00:57:02,726: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:57:02.727279409Z [2024-05-11 00:57:02,727: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:57:02.727305406Z [2024-05-11 00:57:02,727: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T00:57:02.727663748Z [2024-05-11 00:57:02,727: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:57:02.727676617Z [2024-05-11 00:57:02,727: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:57:02.814173518Z [2024-05-11 00:57:02,813: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:57:02.859393487Z [2024-05-11 00:57:02,859: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:57:04.926146383Z [2024-05-11 00:57:04,925: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08065b8c-8b6c-49dc-9134-8ce78ba8bd09] succeeded in 3.8421813459990517s: None 2024-05-11T00:57:04.931530928Z [2024-05-11 00:57:04,930: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3ea593d-d708-404c-ad58-ebe4d65cad23] succeeded in 3.8471240969993232s: None 2024-05-11T00:58:00.974649424Z [2024-05-11 00:58:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75ec72a4-4f02-4911-9346-ace2b1905dab] received 2024-05-11T00:58:00.988368255Z [2024-05-11 00:58:00,987: INFO/ForkPoolWorker-15] [75ec72a4-4f02-4911-9346-ace2b1905dab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:58:00.992277149Z [2024-05-11 00:58:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f82dced-67a9-4847-8699-2cb487244cd1] received 2024-05-11T00:58:00.994971042Z [2024-05-11 00:58:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70a06f73-f908-4159-9c30-4f97bdac9d7e] received 2024-05-11T00:58:01.000519172Z [2024-05-11 00:58:01,000: INFO/ForkPoolWorker-16] [8f82dced-67a9-4847-8699-2cb487244cd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T00:58:01.004352424Z [2024-05-11 00:58:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f38b030-ecfe-44d3-af26-e0a4d0119503] received 2024-05-11T00:58:01.005937114Z [2024-05-11 00:58:01,005: INFO/ForkPoolWorker-1] [70a06f73-f908-4159-9c30-4f97bdac9d7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:58:01.035730978Z [2024-05-11 00:58:01,028: INFO/ForkPoolWorker-2] [6f38b030-ecfe-44d3-af26-e0a4d0119503] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:58:01.419468230Z [2024-05-11 00:58:01,416: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:58:01.421377954Z [2024-05-11 00:58:01,416: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:58:01.450342755Z [2024-05-11 00:58:01,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T00:58:01.472698710Z [2024-05-11 00:58:01,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:58:01.586489995Z [2024-05-11 00:58:01,586: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:58:01.591144767Z [2024-05-11 00:58:01,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:58:01.646105751Z [2024-05-11 00:58:01,645: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:58:01.647087239Z [2024-05-11 00:58:01,646: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:58:01.647132578Z [2024-05-11 00:58:01,647: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:58:01.647195468Z [2024-05-11 00:58:01,647: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:58:01.647375201Z [2024-05-11 00:58:01,647: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:58:01.742844307Z [2024-05-11 00:58:01,742: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:58:01.794548030Z [2024-05-11 00:58:01,794: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:58:02.335694432Z [2024-05-11 00:58:02,335: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f82dced-67a9-4847-8699-2cb487244cd1] succeeded in 1.3415119149995007s: None 2024-05-11T00:58:02.423615450Z [2024-05-11 00:58:02,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70a06f73-f908-4159-9c30-4f97bdac9d7e] succeeded in 1.4269371450009203s: None 2024-05-11T00:58:02.634042707Z [2024-05-11 00:58:02,633: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T00:58:02.637196536Z [2024-05-11 00:58:02,636: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:58:02.660568966Z [2024-05-11 00:58:02,660: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T00:58:02.667207523Z [2024-05-11 00:58:02,666: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:58:02.667558133Z [2024-05-11 00:58:02,667: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:58:02.667854170Z [2024-05-11 00:58:02,667: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:58:02.668065302Z [2024-05-11 00:58:02,667: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T00:58:02.668547093Z [2024-05-11 00:58:02,668: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:58:02.669172464Z [2024-05-11 00:58:02,668: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:58:02.757842705Z [2024-05-11 00:58:02,757: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:58:02.808054655Z [2024-05-11 00:58:02,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:58:02.811762216Z [2024-05-11 00:58:02,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:58:02.829075855Z [2024-05-11 00:58:02,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:58:02.830077030Z [2024-05-11 00:58:02,829: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:58:02.830094852Z [2024-05-11 00:58:02,830: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:58:02.830194137Z [2024-05-11 00:58:02,830: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:58:02.830216395Z [2024-05-11 00:58:02,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:58:02.830416066Z [2024-05-11 00:58:02,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:58:02.830500254Z [2024-05-11 00:58:02,830: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:58:02.924486672Z [2024-05-11 00:58:02,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:58:04.884158424Z [2024-05-11 00:58:04,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75ec72a4-4f02-4911-9346-ace2b1905dab] succeeded in 3.9059494489993085s: None 2024-05-11T00:58:05.385103795Z [2024-05-11 00:58:05,384: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6f38b030-ecfe-44d3-af26-e0a4d0119503] succeeded in 4.372405393000008s: None 2024-05-11T00:59:00.836876340Z [2024-05-11 00:59:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ded10bf-00bd-4aaa-a091-abc6c4382a70] received 2024-05-11T00:59:00.848020608Z [2024-05-11 00:59:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b52954c8-c4d1-4dc2-aa81-699bf6e840ea] received 2024-05-11T00:59:00.848356656Z [2024-05-11 00:59:00,848: INFO/ForkPoolWorker-15] [4ded10bf-00bd-4aaa-a091-abc6c4382a70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T00:59:00.849614391Z [2024-05-11 00:59:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de0f2eeb-4743-4913-af88-3c20ea8b0937] received 2024-05-11T00:59:00.855977602Z [2024-05-11 00:59:00,855: INFO/ForkPoolWorker-16] [b52954c8-c4d1-4dc2-aa81-699bf6e840ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T00:59:00.858260811Z [2024-05-11 00:59:00,858: INFO/ForkPoolWorker-1] [de0f2eeb-4743-4913-af88-3c20ea8b0937] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T00:59:01.236120074Z [2024-05-11 00:59:01,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T00:59:01.248372445Z [2024-05-11 00:59:01,238: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T00:59:01.249457224Z [2024-05-11 00:59:01,245: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T00:59:01.411665047Z [2024-05-11 00:59:01,411: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T00:59:01.416527885Z [2024-05-11 00:59:01,416: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:59:01.446984919Z [2024-05-11 00:59:01,446: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T00:59:01.448627087Z [2024-05-11 00:59:01,448: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T00:59:01.448795117Z [2024-05-11 00:59:01,448: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T00:59:01.448909712Z [2024-05-11 00:59:01,448: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T00:59:01.449324742Z [2024-05-11 00:59:01,449: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T00:59:01.540008597Z [2024-05-11 00:59:01,539: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:59:02.158056326Z [2024-05-11 00:59:02,157: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de0f2eeb-4743-4913-af88-3c20ea8b0937] succeeded in 1.3054261680008494s: None 2024-05-11T00:59:02.382038836Z [2024-05-11 00:59:02,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T00:59:02.385382386Z [2024-05-11 00:59:02,384: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:59:02.404012080Z [2024-05-11 00:59:02,403: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T00:59:02.405191444Z [2024-05-11 00:59:02,404: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:59:02.405205280Z [2024-05-11 00:59:02,405: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:59:02.405406697Z [2024-05-11 00:59:02,405: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:59:02.405466399Z [2024-05-11 00:59:02,405: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T00:59:02.405753657Z [2024-05-11 00:59:02,405: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T00:59:02.406096082Z [2024-05-11 00:59:02,405: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:59:02.473115974Z [2024-05-11 00:59:02,472: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T00:59:02.476587154Z [2024-05-11 00:59:02,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T00:59:02.498499382Z [2024-05-11 00:59:02,498: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:59:02.507934324Z [2024-05-11 00:59:02,507: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T00:59:02.510048189Z [2024-05-11 00:59:02,509: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T00:59:02.510074298Z [2024-05-11 00:59:02,509: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T00:59:02.510260119Z [2024-05-11 00:59:02,510: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T00:59:02.510388388Z [2024-05-11 00:59:02,510: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T00:59:02.510899709Z [2024-05-11 00:59:02,510: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T00:59:02.511582879Z [2024-05-11 00:59:02,510: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T00:59:02.624357834Z [2024-05-11 00:59:02,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T00:59:04.077070970Z [2024-05-11 00:59:04,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b52954c8-c4d1-4dc2-aa81-699bf6e840ea] succeeded in 3.224776273000316s: None 2024-05-11T00:59:04.519428636Z [2024-05-11 00:59:04,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ded10bf-00bd-4aaa-a091-abc6c4382a70] succeeded in 3.680697824998788s: None 2024-05-11T01:00:00.760632436Z [2024-05-11 01:00:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ff885ef-9cd4-4b7c-9f4d-98201cf655ba] received 2024-05-11T01:00:00.765824297Z [2024-05-11 01:00:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ddcf0d7-7438-46fc-aebe-08981e674acd] received 2024-05-11T01:00:00.767858257Z [2024-05-11 01:00:00,767: INFO/ForkPoolWorker-15] [2ff885ef-9cd4-4b7c-9f4d-98201cf655ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:00:00.773222925Z [2024-05-11 01:00:00,772: INFO/ForkPoolWorker-16] [5ddcf0d7-7438-46fc-aebe-08981e674acd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:00:00.778307084Z [2024-05-11 01:00:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed7d0629-16ca-4bf5-9b89-02058dbe5efa] received 2024-05-11T01:00:00.781747376Z [2024-05-11 01:00:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6647f067-a084-4760-84c4-ab1202f10006] received 2024-05-11T01:00:00.785191283Z [2024-05-11 01:00:00,784: INFO/ForkPoolWorker-1] [ed7d0629-16ca-4bf5-9b89-02058dbe5efa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:00.788688536Z [2024-05-11 01:00:00,788: INFO/ForkPoolWorker-2] [6647f067-a084-4760-84c4-ab1202f10006] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:00:00.799856087Z [2024-05-11 01:00:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b04554c-6f2a-4797-90eb-e0edbf7de52b] received 2024-05-11T01:00:00.810005619Z [2024-05-11 01:00:00,809: INFO/ForkPoolWorker-3] [0b04554c-6f2a-4797-90eb-e0edbf7de52b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:00:01.246748060Z [2024-05-11 01:00:01,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:00:01.255973307Z [2024-05-11 01:00:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:00:01.299620897Z [2024-05-11 01:00:01,288: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:00:01.331024036Z [2024-05-11 01:00:01,328: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:00:01.377380625Z [2024-05-11 01:00:01,365: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:00:01.440188444Z [2024-05-11 01:00:01,439: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:00:01.465302733Z [2024-05-11 01:00:01,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:01.583085271Z [2024-05-11 01:00:01,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:00:01.585665262Z [2024-05-11 01:00:01,585: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:00:01.585948560Z [2024-05-11 01:00:01,585: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:00:01.586103975Z [2024-05-11 01:00:01,585: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:00:01.586415786Z [2024-05-11 01:00:01,586: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:00:01.756696849Z [2024-05-11 01:00:01,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:01.878140782Z [2024-05-11 01:00:01,877: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:02.510923247Z [2024-05-11 01:00:02,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ff885ef-9cd4-4b7c-9f4d-98201cf655ba] succeeded in 1.7480592600004456s: None 2024-05-11T01:00:02.549125770Z [2024-05-11 01:00:02,548: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6647f067-a084-4760-84c4-ab1202f10006] succeeded in 1.7659550389998913s: None 2024-05-11T01:00:02.671261387Z [2024-05-11 01:00:02,670: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:00:02.676096309Z [2024-05-11 01:00:02,675: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:02.706584874Z [2024-05-11 01:00:02,706: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:00:02.708864982Z [2024-05-11 01:00:02,708: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:02.709223738Z [2024-05-11 01:00:02,708: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:02.709664521Z [2024-05-11 01:00:02,709: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:02.710001590Z [2024-05-11 01:00:02,709: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:00:02.710551991Z [2024-05-11 01:00:02,710: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:00:02.710752156Z [2024-05-11 01:00:02,710: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:02.806873076Z [2024-05-11 01:00:02,806: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:02.890295492Z [2024-05-11 01:00:02,889: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:00:02.893622721Z [2024-05-11 01:00:02,893: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:02.926940724Z [2024-05-11 01:00:02,926: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:00:02.928439940Z [2024-05-11 01:00:02,928: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:02.928580182Z [2024-05-11 01:00:02,928: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:02.929308051Z [2024-05-11 01:00:02,928: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:02.929512435Z [2024-05-11 01:00:02,929: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:00:02.930057240Z [2024-05-11 01:00:02,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:00:02.930181905Z [2024-05-11 01:00:02,929: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:02.991630667Z [2024-05-11 01:00:02,991: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T01:00:02.995557371Z [2024-05-11 01:00:02,995: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:03.021206248Z [2024-05-11 01:00:03,021: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:00:03.022775994Z [2024-05-11 01:00:03,022: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:03.022944914Z [2024-05-11 01:00:03,022: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:03.023164549Z [2024-05-11 01:00:03,022: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:03.023294471Z [2024-05-11 01:00:03,023: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T01:00:03.023586651Z [2024-05-11 01:00:03,023: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:00:03.023722732Z [2024-05-11 01:00:03,023: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:03.024470834Z [2024-05-11 01:00:03,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:03.112528747Z [2024-05-11 01:00:03,112: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:03.474397306Z [2024-05-11 01:00:03,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59fb1527-bcb3-44a9-a984-c30b3df6a152] received 2024-05-11T01:00:03.493981053Z [2024-05-11 01:00:03,484: INFO/ForkPoolWorker-15] [59fb1527-bcb3-44a9-a984-c30b3df6a152] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:03.573678034Z [2024-05-11 01:00:03,573: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed7d0629-16ca-4bf5-9b89-02058dbe5efa] succeeded in 2.7933422530004464s: None 2024-05-11T01:00:03.834521372Z [2024-05-11 01:00:03,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:00:04.661989188Z [2024-05-11 01:00:04,661: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0b04554c-6f2a-4797-90eb-e0edbf7de52b] succeeded in 3.859954650999498s: None 2024-05-11T01:00:04.909743000Z [2024-05-11 01:00:04,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ddcf0d7-7438-46fc-aebe-08981e674acd] succeeded in 4.142204637000759s: None 2024-05-11T01:00:05.087038967Z [2024-05-11 01:00:05,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:00:05.090533425Z [2024-05-11 01:00:05,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:05.121805764Z [2024-05-11 01:00:05,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:00:05.123742766Z [2024-05-11 01:00:05,123: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:05.123900987Z [2024-05-11 01:00:05,123: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:05.124179518Z [2024-05-11 01:00:05,123: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:05.124298969Z [2024-05-11 01:00:05,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:00:05.124922389Z [2024-05-11 01:00:05,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:00:05.125092760Z [2024-05-11 01:00:05,124: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:05.256661140Z [2024-05-11 01:00:05,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:05.922821577Z [2024-05-11 01:00:05,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59fb1527-bcb3-44a9-a984-c30b3df6a152] succeeded in 2.445226969999567s: None 2024-05-11T01:00:06.565105465Z [2024-05-11 01:00:06,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[410c87e2-e258-402d-8944-0610fe27a8b4] received 2024-05-11T01:00:06.590347107Z [2024-05-11 01:00:06,589: INFO/ForkPoolWorker-15] [410c87e2-e258-402d-8944-0610fe27a8b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:00:06.960334683Z [2024-05-11 01:00:06,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:00:08.075678962Z [2024-05-11 01:00:08,075: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:00:08.079140248Z [2024-05-11 01:00:08,078: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:08.096954193Z [2024-05-11 01:00:08,096: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:00:08.098114972Z [2024-05-11 01:00:08,097: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:08.098234092Z [2024-05-11 01:00:08,098: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:08.098385706Z [2024-05-11 01:00:08,098: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:08.098439045Z [2024-05-11 01:00:08,098: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:00:08.098727087Z [2024-05-11 01:00:08,098: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:00:08.098868715Z [2024-05-11 01:00:08,098: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:08.194574311Z [2024-05-11 01:00:08,194: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:08.726958728Z [2024-05-11 01:00:08,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[410c87e2-e258-402d-8944-0610fe27a8b4] succeeded in 2.155721098999493s: None 2024-05-11T01:00:08.966096465Z [2024-05-11 01:00:08,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[924c2a56-50b6-4687-93e7-720cb1023a3f] received 2024-05-11T01:00:08.975412293Z [2024-05-11 01:00:08,975: INFO/ForkPoolWorker-15] [924c2a56-50b6-4687-93e7-720cb1023a3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:00:09.242817326Z [2024-05-11 01:00:09,239: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:00:10.369276325Z [2024-05-11 01:00:10,368: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:00:10.373444763Z [2024-05-11 01:00:10,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:00:10.388996064Z [2024-05-11 01:00:10,388: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:00:10.390148579Z [2024-05-11 01:00:10,389: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:00:10.390212073Z [2024-05-11 01:00:10,390: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:00:10.390351624Z [2024-05-11 01:00:10,390: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:00:10.390412062Z [2024-05-11 01:00:10,390: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:00:10.390648262Z [2024-05-11 01:00:10,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:00:10.390713418Z [2024-05-11 01:00:10,390: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:00:10.489839751Z [2024-05-11 01:00:10,489: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:00:11.138950386Z [2024-05-11 01:00:11,138: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[924c2a56-50b6-4687-93e7-720cb1023a3f] succeeded in 2.1715021220006747s: None 2024-05-11T01:01:00.270138434Z [2024-05-11 01:01:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21cdc0fe-dbbd-4c6e-9598-8c5061e84a34] received 2024-05-11T01:01:00.276720363Z [2024-05-11 01:01:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69aeb142-92b1-4f69-a6f0-85f94a14e1db] received 2024-05-11T01:01:00.280107849Z [2024-05-11 01:01:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff393d9-bfc2-4759-ac02-f4580ca8ff6f] received 2024-05-11T01:01:00.306851042Z [2024-05-11 01:01:00,306: INFO/ForkPoolWorker-16] [69aeb142-92b1-4f69-a6f0-85f94a14e1db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:01:00.310030503Z [2024-05-11 01:01:00,309: INFO/ForkPoolWorker-1] [7ff393d9-bfc2-4759-ac02-f4580ca8ff6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:01:00.313991729Z [2024-05-11 01:01:00,310: INFO/ForkPoolWorker-15] [21cdc0fe-dbbd-4c6e-9598-8c5061e84a34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:01:00.828338259Z [2024-05-11 01:01:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:01:00.961248049Z [2024-05-11 01:01:00,951: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:01:00.967825673Z [2024-05-11 01:01:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:01:00.998798725Z [2024-05-11 01:01:00,998: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:01:01.002930393Z [2024-05-11 01:01:01,002: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:01:01.121985796Z [2024-05-11 01:01:01,119: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:01:01.134039092Z [2024-05-11 01:01:01,130: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:01:01.134071486Z [2024-05-11 01:01:01,130: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:01:01.134077661Z [2024-05-11 01:01:01,130: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:01:01.134081395Z [2024-05-11 01:01:01,131: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:01:01.312399613Z [2024-05-11 01:01:01,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:01:02.087930350Z [2024-05-11 01:01:02,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21cdc0fe-dbbd-4c6e-9598-8c5061e84a34] succeeded in 1.8129696039995906s: None 2024-05-11T01:01:02.596709337Z [2024-05-11 01:01:02,596: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:01:02.605760371Z [2024-05-11 01:01:02,605: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:01:02.653399581Z [2024-05-11 01:01:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:01:02.655739166Z [2024-05-11 01:01:02,655: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:01:02.655780201Z [2024-05-11 01:01:02,655: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:01:02.656372160Z [2024-05-11 01:01:02,655: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:01:02.656681610Z [2024-05-11 01:01:02,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:01:02.657110857Z [2024-05-11 01:01:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:01:02.657286226Z [2024-05-11 01:01:02,657: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:01:02.708494909Z [2024-05-11 01:01:02,707: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:01:02.714994347Z [2024-05-11 01:01:02,714: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:01:02.742508695Z [2024-05-11 01:01:02,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:01:02.744453356Z [2024-05-11 01:01:02,744: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:01:02.744812735Z [2024-05-11 01:01:02,744: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:01:02.745341292Z [2024-05-11 01:01:02,744: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:01:02.745662321Z [2024-05-11 01:01:02,745: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:01:02.746301519Z [2024-05-11 01:01:02,746: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:01:02.746498833Z [2024-05-11 01:01:02,746: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:01:02.778573184Z [2024-05-11 01:01:02,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:01:02.853759888Z [2024-05-11 01:01:02,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:01:04.950661474Z [2024-05-11 01:01:04,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ff393d9-bfc2-4759-ac02-f4580ca8ff6f] succeeded in 4.668771370999821s: None 2024-05-11T01:01:05.292550629Z [2024-05-11 01:01:05,292: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69aeb142-92b1-4f69-a6f0-85f94a14e1db] succeeded in 4.996810205999282s: None 2024-05-11T01:02:00.786907808Z [2024-05-11 01:02:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7074ca4-65af-41a8-acbf-eb86070250aa] received 2024-05-11T01:02:00.790805342Z [2024-05-11 01:02:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fac0e6a2-2162-46b8-9822-864126fe5bd3] received 2024-05-11T01:02:00.792124383Z [2024-05-11 01:02:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f24719e0-24c0-4cd4-87d6-3bc1043d67a9] received 2024-05-11T01:02:00.793546315Z [2024-05-11 01:02:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e5ee293-399e-425d-b0fe-6a6d0d97e55a] received 2024-05-11T01:02:00.797415925Z [2024-05-11 01:02:00,797: INFO/ForkPoolWorker-15] [a7074ca4-65af-41a8-acbf-eb86070250aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:02:00.803139966Z [2024-05-11 01:02:00,802: INFO/ForkPoolWorker-2] [6e5ee293-399e-425d-b0fe-6a6d0d97e55a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:02:00.803722478Z [2024-05-11 01:02:00,803: INFO/ForkPoolWorker-1] [f24719e0-24c0-4cd4-87d6-3bc1043d67a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:02:00.810239915Z [2024-05-11 01:02:00,809: INFO/ForkPoolWorker-16] [fac0e6a2-2162-46b8-9822-864126fe5bd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:02:01.188075393Z [2024-05-11 01:02:01,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:02:01.244746835Z [2024-05-11 01:02:01,239: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:02:01.252325041Z [2024-05-11 01:02:01,248: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:02:01.347564064Z [2024-05-11 01:02:01,341: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:02:01.461502941Z [2024-05-11 01:02:01,460: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:02:01.466379609Z [2024-05-11 01:02:01,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:02:01.497676625Z [2024-05-11 01:02:01,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:02:01.499763673Z [2024-05-11 01:02:01,499: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:02:01.499909548Z [2024-05-11 01:02:01,499: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:02:01.500007705Z [2024-05-11 01:02:01,499: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:02:01.500257390Z [2024-05-11 01:02:01,500: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:02:01.564216121Z [2024-05-11 01:02:01,563: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:02:01.634548868Z [2024-05-11 01:02:01,634: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:02:02.147690129Z [2024-05-11 01:02:02,147: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f24719e0-24c0-4cd4-87d6-3bc1043d67a9] succeeded in 1.3527591390011366s: None 2024-05-11T01:02:02.369750214Z [2024-05-11 01:02:02,369: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fac0e6a2-2162-46b8-9822-864126fe5bd3] succeeded in 1.5776043810001283s: None 2024-05-11T01:02:02.648937538Z [2024-05-11 01:02:02,648: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:02:02.652682893Z [2024-05-11 01:02:02,652: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:02:02.672850913Z [2024-05-11 01:02:02,672: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:02:02.674253980Z [2024-05-11 01:02:02,673: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:02:02.674403647Z [2024-05-11 01:02:02,674: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:02:02.674591245Z [2024-05-11 01:02:02,674: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:02:02.674638166Z [2024-05-11 01:02:02,674: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:02:02.675426025Z [2024-05-11 01:02:02,675: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:02:02.675501425Z [2024-05-11 01:02:02,675: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:02:02.706227558Z [2024-05-11 01:02:02,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:02:02.709161227Z [2024-05-11 01:02:02,708: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:02:02.730942125Z [2024-05-11 01:02:02,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:02:02.731952913Z [2024-05-11 01:02:02,731: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:02:02.732074213Z [2024-05-11 01:02:02,731: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:02:02.732094082Z [2024-05-11 01:02:02,731: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:02:02.732102974Z [2024-05-11 01:02:02,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:02:02.732356757Z [2024-05-11 01:02:02,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:02:02.732390788Z [2024-05-11 01:02:02,732: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:02:02.765838455Z [2024-05-11 01:02:02,763: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:02:02.809040802Z [2024-05-11 01:02:02,808: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:02:04.314369044Z [2024-05-11 01:02:04,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7074ca4-65af-41a8-acbf-eb86070250aa] succeeded in 3.52502874899983s: None 2024-05-11T01:02:06.131758707Z [2024-05-11 01:02:06,131: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e5ee293-399e-425d-b0fe-6a6d0d97e55a] succeeded in 5.33672261799984s: None 2024-05-11T01:03:01.227564642Z [2024-05-11 01:03:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c957711-e6ec-4ad4-8918-75b19e2cbaae] received 2024-05-11T01:03:01.232084963Z [2024-05-11 01:03:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d8b5dd0-aa33-49af-9390-f4c429cd2039] received 2024-05-11T01:03:01.234822359Z [2024-05-11 01:03:01,234: INFO/ForkPoolWorker-15] [9c957711-e6ec-4ad4-8918-75b19e2cbaae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:03:01.242397920Z [2024-05-11 01:03:01,242: INFO/ForkPoolWorker-16] [4d8b5dd0-aa33-49af-9390-f4c429cd2039] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:03:01.246659723Z [2024-05-11 01:03:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea725833-7960-4fa0-97c1-12fee914b549] received 2024-05-11T01:03:01.253008800Z [2024-05-11 01:03:01,252: INFO/ForkPoolWorker-1] [ea725833-7960-4fa0-97c1-12fee914b549] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:03:01.497331929Z [2024-05-11 01:03:01,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:03:01.548421961Z [2024-05-11 01:03:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:03:01.587004231Z [2024-05-11 01:03:01,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:03:01.700793941Z [2024-05-11 01:03:01,700: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:03:01.705194688Z [2024-05-11 01:03:01,704: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:03:01.730726415Z [2024-05-11 01:03:01,730: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:03:01.731631418Z [2024-05-11 01:03:01,731: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:03:01.731763517Z [2024-05-11 01:03:01,731: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:03:01.731800073Z [2024-05-11 01:03:01,731: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:03:01.732050095Z [2024-05-11 01:03:01,731: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:03:01.812610767Z [2024-05-11 01:03:01,812: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:03:02.355803396Z [2024-05-11 01:03:02,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d8b5dd0-aa33-49af-9390-f4c429cd2039] succeeded in 1.1224007499986328s: None 2024-05-11T01:03:02.560975788Z [2024-05-11 01:03:02,560: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:03:02.564614712Z [2024-05-11 01:03:02,564: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:03:02.582575692Z [2024-05-11 01:03:02,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:03:02.583942000Z [2024-05-11 01:03:02,583: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:03:02.584116133Z [2024-05-11 01:03:02,583: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:03:02.584357090Z [2024-05-11 01:03:02,584: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:03:02.584427712Z [2024-05-11 01:03:02,584: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:03:02.584744028Z [2024-05-11 01:03:02,584: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:03:02.584826378Z [2024-05-11 01:03:02,584: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:03:02.702521311Z [2024-05-11 01:03:02,702: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:03:02.707905436Z [2024-05-11 01:03:02,707: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:03:02.711288463Z [2024-05-11 01:03:02,710: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:03:02.731329482Z [2024-05-11 01:03:02,731: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:03:02.732757851Z [2024-05-11 01:03:02,732: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:03:02.732934460Z [2024-05-11 01:03:02,732: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:03:02.733117436Z [2024-05-11 01:03:02,732: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:03:02.733183062Z [2024-05-11 01:03:02,733: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:03:02.733472010Z [2024-05-11 01:03:02,733: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:03:02.734010724Z [2024-05-11 01:03:02,733: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:03:02.812172942Z [2024-05-11 01:03:02,811: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:03:04.128584737Z [2024-05-11 01:03:04,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c957711-e6ec-4ad4-8918-75b19e2cbaae] succeeded in 2.899275383000713s: None 2024-05-11T01:03:04.633937447Z [2024-05-11 01:03:04,633: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea725833-7960-4fa0-97c1-12fee914b549] succeeded in 3.384885786999803s: None 2024-05-11T01:04:00.868836950Z [2024-05-11 01:04:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[367ca1ae-b3cc-4abe-9b93-03b9d33e1d7b] received 2024-05-11T01:04:00.873022238Z [2024-05-11 01:04:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad417cb-a17a-4da4-ad47-1181487d29f5] received 2024-05-11T01:04:00.875166571Z [2024-05-11 01:04:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08cb3996-a5af-44bd-96b7-6ce6801cd895] received 2024-05-11T01:04:00.879422890Z [2024-05-11 01:04:00,879: INFO/ForkPoolWorker-15] [367ca1ae-b3cc-4abe-9b93-03b9d33e1d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:04:00.879956650Z [2024-05-11 01:04:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bbfc9d4-87e1-4def-9730-17ad46a84a01] received 2024-05-11T01:04:00.882909074Z [2024-05-11 01:04:00,882: INFO/ForkPoolWorker-16] [5ad417cb-a17a-4da4-ad47-1181487d29f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:04:00.883396884Z [2024-05-11 01:04:00,883: INFO/ForkPoolWorker-1] [08cb3996-a5af-44bd-96b7-6ce6801cd895] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:04:00.892046457Z [2024-05-11 01:04:00,891: INFO/ForkPoolWorker-2] [5bbfc9d4-87e1-4def-9730-17ad46a84a01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:04:01.315258569Z [2024-05-11 01:04:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:04:01.323459492Z [2024-05-11 01:04:01,320: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:04:01.361663737Z [2024-05-11 01:04:01,357: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:04:01.401447834Z [2024-05-11 01:04:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:04:01.472300106Z [2024-05-11 01:04:01,471: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:04:01.475974472Z [2024-05-11 01:04:01,475: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:04:01.510469238Z [2024-05-11 01:04:01,509: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:04:01.511351787Z [2024-05-11 01:04:01,511: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:04:01.511430738Z [2024-05-11 01:04:01,511: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:04:01.511468863Z [2024-05-11 01:04:01,511: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:04:01.511656455Z [2024-05-11 01:04:01,511: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:04:01.589457385Z [2024-05-11 01:04:01,589: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:04:01.633338385Z [2024-05-11 01:04:01,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:04:02.190833363Z [2024-05-11 01:04:02,190: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[367ca1ae-b3cc-4abe-9b93-03b9d33e1d7b] succeeded in 1.320325059001334s: None 2024-05-11T01:04:02.253773348Z [2024-05-11 01:04:02,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5bbfc9d4-87e1-4def-9730-17ad46a84a01] succeeded in 1.3716113499995117s: None 2024-05-11T01:04:02.592965305Z [2024-05-11 01:04:02,592: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:04:02.596347666Z [2024-05-11 01:04:02,595: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:04:02.632421557Z [2024-05-11 01:04:02,632: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:04:02.635453681Z [2024-05-11 01:04:02,635: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:04:02.635553275Z [2024-05-11 01:04:02,635: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:04:02.635946399Z [2024-05-11 01:04:02,635: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:04:02.636477914Z [2024-05-11 01:04:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:04:02.636768223Z [2024-05-11 01:04:02,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:04:02.636917944Z [2024-05-11 01:04:02,636: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:04:02.696176228Z [2024-05-11 01:04:02,695: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:04:02.699577033Z [2024-05-11 01:04:02,699: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:04:02.724641101Z [2024-05-11 01:04:02,724: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:04:02.726466237Z [2024-05-11 01:04:02,726: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:04:02.728333500Z [2024-05-11 01:04:02,726: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:04:02.728639635Z [2024-05-11 01:04:02,728: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:04:02.728775063Z [2024-05-11 01:04:02,728: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:04:02.729122469Z [2024-05-11 01:04:02,728: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:04:02.729259981Z [2024-05-11 01:04:02,729: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:04:02.731270972Z [2024-05-11 01:04:02,731: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:04:02.807440685Z [2024-05-11 01:04:02,807: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:04:04.195502168Z [2024-05-11 01:04:04,195: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08cb3996-a5af-44bd-96b7-6ce6801cd895] succeeded in 3.31883924199974s: None 2024-05-11T01:04:04.653201396Z [2024-05-11 01:04:04,652: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ad417cb-a17a-4da4-ad47-1181487d29f5] succeeded in 3.7786840010012384s: None 2024-05-11T01:05:00.769434095Z [2024-05-11 01:05:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db9ff17c-6b95-418c-925d-e2801f4ad408] received 2024-05-11T01:05:00.774695793Z [2024-05-11 01:05:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05ee1ea0-5bfd-4380-a8cc-b4e438e923e2] received 2024-05-11T01:05:00.778106859Z [2024-05-11 01:05:00,777: INFO/ForkPoolWorker-15] [db9ff17c-6b95-418c-925d-e2801f4ad408] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:00.778996862Z [2024-05-11 01:05:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[472e0156-de08-4bd2-b1bf-feb075da2f41] received 2024-05-11T01:05:00.784170461Z [2024-05-11 01:05:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe57169d-9ca1-42df-b6ef-0b2adbd83775] received 2024-05-11T01:05:00.787674121Z [2024-05-11 01:05:00,787: INFO/ForkPoolWorker-1] [472e0156-de08-4bd2-b1bf-feb075da2f41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:05:00.790481208Z [2024-05-11 01:05:00,790: INFO/ForkPoolWorker-16] [05ee1ea0-5bfd-4380-a8cc-b4e438e923e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:05:00.799297929Z [2024-05-11 01:05:00,799: INFO/ForkPoolWorker-2] [fe57169d-9ca1-42df-b6ef-0b2adbd83775] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:05:01.123014932Z [2024-05-11 01:05:01,114: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:05:01.156012033Z [2024-05-11 01:05:01,152: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:05:01.189031228Z [2024-05-11 01:05:01,185: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:05:01.264163658Z [2024-05-11 01:05:01,260: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:05:01.428459209Z [2024-05-11 01:05:01,428: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:05:01.432363158Z [2024-05-11 01:05:01,431: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:01.476966642Z [2024-05-11 01:05:01,476: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:05:01.478704387Z [2024-05-11 01:05:01,478: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:05:01.478753014Z [2024-05-11 01:05:01,478: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:05:01.478803848Z [2024-05-11 01:05:01,478: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:05:01.478996345Z [2024-05-11 01:05:01,478: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:05:01.594780875Z [2024-05-11 01:05:01,594: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:02.171074516Z [2024-05-11 01:05:02,170: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe57169d-9ca1-42df-b6ef-0b2adbd83775] succeeded in 1.3825534820007306s: None 2024-05-11T01:05:02.384279221Z [2024-05-11 01:05:02,383: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:05:02.387482025Z [2024-05-11 01:05:02,387: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:02.410273330Z [2024-05-11 01:05:02,410: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:05:02.412393143Z [2024-05-11 01:05:02,412: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:02.412498246Z [2024-05-11 01:05:02,412: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:02.412768260Z [2024-05-11 01:05:02,412: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:02.412972943Z [2024-05-11 01:05:02,412: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:05:02.413781228Z [2024-05-11 01:05:02,413: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:05:02.414779578Z [2024-05-11 01:05:02,413: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:02.451021648Z [2024-05-11 01:05:02,450: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:05:02.454485630Z [2024-05-11 01:05:02,454: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:02.467327875Z [2024-05-11 01:05:02,467: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:05:02.470747520Z [2024-05-11 01:05:02,470: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:02.480234476Z [2024-05-11 01:05:02,479: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:05:02.483550837Z [2024-05-11 01:05:02,483: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:02.483564610Z [2024-05-11 01:05:02,483: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:02.483886622Z [2024-05-11 01:05:02,483: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:02.484029680Z [2024-05-11 01:05:02,483: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:05:02.484710749Z [2024-05-11 01:05:02,484: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:05:02.484827800Z [2024-05-11 01:05:02,484: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:02.491613832Z [2024-05-11 01:05:02,491: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:05:02.492733218Z [2024-05-11 01:05:02,492: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:02.492765518Z [2024-05-11 01:05:02,492: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:02.492870674Z [2024-05-11 01:05:02,492: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:02.492913461Z [2024-05-11 01:05:02,492: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:05:02.493130060Z [2024-05-11 01:05:02,493: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:05:02.493173392Z [2024-05-11 01:05:02,493: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:02.520842247Z [2024-05-11 01:05:02,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:02.562686741Z [2024-05-11 01:05:02,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:02.569139533Z [2024-05-11 01:05:02,568: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:03.111976130Z [2024-05-11 01:05:03,111: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db9ff17c-6b95-418c-925d-e2801f4ad408] succeeded in 2.340377771000931s: None 2024-05-11T01:05:03.786044670Z [2024-05-11 01:05:03,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fea503e-7f7e-4fa2-84a1-cdd0e945f5e6] received 2024-05-11T01:05:03.800448858Z [2024-05-11 01:05:03,800: INFO/ForkPoolWorker-15] [2fea503e-7f7e-4fa2-84a1-cdd0e945f5e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:04.125221609Z [2024-05-11 01:05:04,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[472e0156-de08-4bd2-b1bf-feb075da2f41] succeeded in 3.3445043510000687s: None 2024-05-11T01:05:04.130090905Z [2024-05-11 01:05:04,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:05:04.498470691Z [2024-05-11 01:05:04,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05ee1ea0-5bfd-4380-a8cc-b4e438e923e2] succeeded in 3.7206877110002097s: None 2024-05-11T01:05:05.237417261Z [2024-05-11 01:05:05,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:05:05.240810469Z [2024-05-11 01:05:05,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:05.258263521Z [2024-05-11 01:05:05,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:05:05.260958199Z [2024-05-11 01:05:05,260: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:05.260978315Z [2024-05-11 01:05:05,260: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:05.261052683Z [2024-05-11 01:05:05,260: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:05.261122206Z [2024-05-11 01:05:05,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:05:05.261361712Z [2024-05-11 01:05:05,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:05:05.261382430Z [2024-05-11 01:05:05,261: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:05.330875108Z [2024-05-11 01:05:05,330: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:05.835889093Z [2024-05-11 01:05:05,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5241ff30-eb45-4f46-93a9-b7009007cf75] received 2024-05-11T01:05:05.842909288Z [2024-05-11 01:05:05,842: INFO/ForkPoolWorker-16] [5241ff30-eb45-4f46-93a9-b7009007cf75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:05:05.893961784Z [2024-05-11 01:05:05,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fea503e-7f7e-4fa2-84a1-cdd0e945f5e6] succeeded in 2.099909803000628s: None 2024-05-11T01:05:06.122921491Z [2024-05-11 01:05:06,119: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:05:07.225664082Z [2024-05-11 01:05:07,225: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:05:07.229953965Z [2024-05-11 01:05:07,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:07.249391293Z [2024-05-11 01:05:07,249: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:05:07.250733790Z [2024-05-11 01:05:07,250: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:07.250855554Z [2024-05-11 01:05:07,250: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:07.251043599Z [2024-05-11 01:05:07,250: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:07.251136060Z [2024-05-11 01:05:07,250: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:05:07.251553797Z [2024-05-11 01:05:07,251: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:05:07.251679687Z [2024-05-11 01:05:07,251: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:07.340706996Z [2024-05-11 01:05:07,340: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:07.946375476Z [2024-05-11 01:05:07,944: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5241ff30-eb45-4f46-93a9-b7009007cf75] succeeded in 2.1064045319999423s: None 2024-05-11T01:05:08.207384374Z [2024-05-11 01:05:08,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7510dc96-ebc4-4c5d-880f-66c0e5acc1b4] received 2024-05-11T01:05:08.222503838Z [2024-05-11 01:05:08,222: INFO/ForkPoolWorker-15] [7510dc96-ebc4-4c5d-880f-66c0e5acc1b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:05:08.498817454Z [2024-05-11 01:05:08,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:05:09.581190016Z [2024-05-11 01:05:09,580: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:05:09.584669572Z [2024-05-11 01:05:09,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:05:09.605625769Z [2024-05-11 01:05:09,605: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:05:09.606860126Z [2024-05-11 01:05:09,606: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:05:09.606873065Z [2024-05-11 01:05:09,606: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:05:09.607027262Z [2024-05-11 01:05:09,606: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:05:09.607032392Z [2024-05-11 01:05:09,606: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:05:09.607353862Z [2024-05-11 01:05:09,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:05:09.607384000Z [2024-05-11 01:05:09,607: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:05:09.683754052Z [2024-05-11 01:05:09,683: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:05:10.271222470Z [2024-05-11 01:05:10,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7510dc96-ebc4-4c5d-880f-66c0e5acc1b4] succeeded in 2.0617665869995108s: None 2024-05-11T01:06:00.328418532Z [2024-05-11 01:06:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b03de4af-3cae-498a-9e39-021d151129d1] received 2024-05-11T01:06:00.328462683Z [2024-05-11 01:06:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fb8bf33-398c-4eaa-b043-3b332ba9932b] received 2024-05-11T01:06:00.328466399Z [2024-05-11 01:06:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c37c32c-e919-4c02-83f1-197e911dca0d] received 2024-05-11T01:06:00.330619723Z [2024-05-11 01:06:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2828e140-39b7-4d04-8091-27200819cf49] received 2024-05-11T01:06:00.330660447Z [2024-05-11 01:06:00,330: INFO/ForkPoolWorker-15] [b03de4af-3cae-498a-9e39-021d151129d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:06:00.351044460Z [2024-05-11 01:06:00,350: INFO/ForkPoolWorker-16] [3fb8bf33-398c-4eaa-b043-3b332ba9932b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:06:00.352411682Z [2024-05-11 01:06:00,352: INFO/ForkPoolWorker-2] [2828e140-39b7-4d04-8091-27200819cf49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:06:00.352935191Z [2024-05-11 01:06:00,352: INFO/ForkPoolWorker-1] [1c37c32c-e919-4c02-83f1-197e911dca0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:06:00.654357624Z [2024-05-11 01:06:00,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:06:00.692973407Z [2024-05-11 01:06:00,689: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:06:00.721637635Z [2024-05-11 01:06:00,718: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:06:00.772303753Z [2024-05-11 01:06:00,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:06:00.835491725Z [2024-05-11 01:06:00,835: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:06:00.839507092Z [2024-05-11 01:06:00,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:06:00.864407217Z [2024-05-11 01:06:00,864: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:06:00.865511371Z [2024-05-11 01:06:00,865: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:06:00.865619222Z [2024-05-11 01:06:00,865: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:06:00.865702505Z [2024-05-11 01:06:00,865: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:06:00.865812014Z [2024-05-11 01:06:00,865: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:06:00.945095679Z [2024-05-11 01:06:00,944: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:06:01.196099758Z [2024-05-11 01:06:01,195: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:06:01.530443701Z [2024-05-11 01:06:01,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fb8bf33-398c-4eaa-b043-3b332ba9932b] succeeded in 1.2067646680006874s: None 2024-05-11T01:06:01.828880896Z [2024-05-11 01:06:01,828: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c37c32c-e919-4c02-83f1-197e911dca0d] succeeded in 1.498023853999257s: None 2024-05-11T01:06:01.966183284Z [2024-05-11 01:06:01,965: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:06:01.969742970Z [2024-05-11 01:06:01,969: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:06:01.997930593Z [2024-05-11 01:06:01,997: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:06:01.999976971Z [2024-05-11 01:06:01,999: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:06:02.000526561Z [2024-05-11 01:06:02,000: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:06:02.003353156Z [2024-05-11 01:06:02,002: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:06:02.003704874Z [2024-05-11 01:06:02,003: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:06:02.004676709Z [2024-05-11 01:06:02,004: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:06:02.004953132Z [2024-05-11 01:06:02,004: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:06:02.044895980Z [2024-05-11 01:06:02,044: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:06:02.048923806Z [2024-05-11 01:06:02,048: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:06:02.068968651Z [2024-05-11 01:06:02,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:06:02.071245742Z [2024-05-11 01:06:02,070: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:06:02.071387057Z [2024-05-11 01:06:02,071: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:06:02.071512945Z [2024-05-11 01:06:02,071: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:06:02.071574376Z [2024-05-11 01:06:02,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:06:02.071972300Z [2024-05-11 01:06:02,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:06:02.072098959Z [2024-05-11 01:06:02,071: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:06:02.137474093Z [2024-05-11 01:06:02,137: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:06:02.161167325Z [2024-05-11 01:06:02,160: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:06:03.681702545Z [2024-05-11 01:06:03,681: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b03de4af-3cae-498a-9e39-021d151129d1] succeeded in 3.36052733500037s: None 2024-05-11T01:06:04.082053350Z [2024-05-11 01:06:04,080: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2828e140-39b7-4d04-8091-27200819cf49] succeeded in 3.7490824420001445s: None 2024-05-11T01:07:00.703363891Z [2024-05-11 01:07:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[625057c6-15b6-4a49-99b1-11614a6dc7b4] received 2024-05-11T01:07:00.711247292Z [2024-05-11 01:07:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6621179-5c83-4177-9290-2841767a1b4e] received 2024-05-11T01:07:00.712605072Z [2024-05-11 01:07:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7bcab44-1054-4cb2-aa28-9dee0b697631] received 2024-05-11T01:07:00.719178086Z [2024-05-11 01:07:00,718: INFO/ForkPoolWorker-15] [625057c6-15b6-4a49-99b1-11614a6dc7b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:07:00.725765529Z [2024-05-11 01:07:00,725: INFO/ForkPoolWorker-1] [c7bcab44-1054-4cb2-aa28-9dee0b697631] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:07:00.729996574Z [2024-05-11 01:07:00,729: INFO/ForkPoolWorker-16] [b6621179-5c83-4177-9290-2841767a1b4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:07:00.998699662Z [2024-05-11 01:07:00,995: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:07:01.006866780Z [2024-05-11 01:07:01,003: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:07:01.025990500Z [2024-05-11 01:07:01,022: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:07:01.230848110Z [2024-05-11 01:07:01,230: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:07:01.234751723Z [2024-05-11 01:07:01,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:07:01.258796242Z [2024-05-11 01:07:01,258: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:07:01.259735381Z [2024-05-11 01:07:01,259: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:07:01.259850269Z [2024-05-11 01:07:01,259: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:07:01.260029085Z [2024-05-11 01:07:01,259: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:07:01.260277973Z [2024-05-11 01:07:01,260: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:07:01.359097118Z [2024-05-11 01:07:01,358: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:07:02.044965511Z [2024-05-11 01:07:02,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7bcab44-1054-4cb2-aa28-9dee0b697631] succeeded in 1.3300942010009749s: None 2024-05-11T01:07:02.176583330Z [2024-05-11 01:07:02,176: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:07:02.179996643Z [2024-05-11 01:07:02,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:07:02.208714350Z [2024-05-11 01:07:02,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:07:02.210208135Z [2024-05-11 01:07:02,209: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:07:02.210371419Z [2024-05-11 01:07:02,210: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:07:02.210619870Z [2024-05-11 01:07:02,210: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:07:02.210827965Z [2024-05-11 01:07:02,210: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:07:02.211215474Z [2024-05-11 01:07:02,211: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:07:02.211401575Z [2024-05-11 01:07:02,211: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:07:02.301716204Z [2024-05-11 01:07:02,301: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:07:02.382037301Z [2024-05-11 01:07:02,381: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:07:02.385918834Z [2024-05-11 01:07:02,385: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:07:02.416364909Z [2024-05-11 01:07:02,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:07:02.418311622Z [2024-05-11 01:07:02,418: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:07:02.418409613Z [2024-05-11 01:07:02,418: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:07:02.418631116Z [2024-05-11 01:07:02,418: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:07:02.418687530Z [2024-05-11 01:07:02,418: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:07:02.419017336Z [2024-05-11 01:07:02,418: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:07:02.419471886Z [2024-05-11 01:07:02,419: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:07:02.531491497Z [2024-05-11 01:07:02,531: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:07:03.764717913Z [2024-05-11 01:07:03,763: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6621179-5c83-4177-9290-2841767a1b4e] succeeded in 3.051852094999049s: None 2024-05-11T01:07:04.303538228Z [2024-05-11 01:07:04,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[625057c6-15b6-4a49-99b1-11614a6dc7b4] succeeded in 3.5952937880010722s: None 2024-05-11T01:08:01.170731846Z [2024-05-11 01:08:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e155d097-09d8-4c70-b455-c4de002eed20] received 2024-05-11T01:08:01.172575169Z [2024-05-11 01:08:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96d1e998-b0e1-4d6a-b6f9-e6ee89af19f6] received 2024-05-11T01:08:01.181729807Z [2024-05-11 01:08:01,181: INFO/ForkPoolWorker-15] [e155d097-09d8-4c70-b455-c4de002eed20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:08:01.182818483Z [2024-05-11 01:08:01,182: INFO/ForkPoolWorker-16] [96d1e998-b0e1-4d6a-b6f9-e6ee89af19f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:08:01.183312886Z [2024-05-11 01:08:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a9548c8-2fd9-45d2-8a0d-012a22cc9fa7] received 2024-05-11T01:08:01.192589633Z [2024-05-11 01:08:01,192: INFO/ForkPoolWorker-1] [8a9548c8-2fd9-45d2-8a0d-012a22cc9fa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:08:01.196342357Z [2024-05-11 01:08:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb504209-4ba8-481d-b8b9-27d5eee9352d] received 2024-05-11T01:08:01.212249883Z [2024-05-11 01:08:01,211: INFO/ForkPoolWorker-2] [fb504209-4ba8-481d-b8b9-27d5eee9352d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:08:01.494573927Z [2024-05-11 01:08:01,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:08:01.496887005Z [2024-05-11 01:08:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:08:01.517256442Z [2024-05-11 01:08:01,513: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:08:01.572544631Z [2024-05-11 01:08:01,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:08:01.755193151Z [2024-05-11 01:08:01,754: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:08:01.759199671Z [2024-05-11 01:08:01,758: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:08:01.795007011Z [2024-05-11 01:08:01,794: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:08:01.799389338Z [2024-05-11 01:08:01,799: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:08:01.799929450Z [2024-05-11 01:08:01,799: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:08:01.800168762Z [2024-05-11 01:08:01,800: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:08:01.801314982Z [2024-05-11 01:08:01,800: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:08:01.853573140Z [2024-05-11 01:08:01,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:08:01.941673108Z [2024-05-11 01:08:01,941: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:08:02.497987555Z [2024-05-11 01:08:02,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a9548c8-2fd9-45d2-8a0d-012a22cc9fa7] succeeded in 1.3131844489998912s: None 2024-05-11T01:08:02.537927855Z [2024-05-11 01:08:02,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96d1e998-b0e1-4d6a-b6f9-e6ee89af19f6] succeeded in 1.3624163530002988s: None 2024-05-11T01:08:02.738362603Z [2024-05-11 01:08:02,737: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:08:02.741770564Z [2024-05-11 01:08:02,741: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:08:02.768107195Z [2024-05-11 01:08:02,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:08:02.769645026Z [2024-05-11 01:08:02,769: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:08:02.769727240Z [2024-05-11 01:08:02,769: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:08:02.769968928Z [2024-05-11 01:08:02,769: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:08:02.770045174Z [2024-05-11 01:08:02,769: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:08:02.770346585Z [2024-05-11 01:08:02,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:08:02.770456981Z [2024-05-11 01:08:02,770: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:08:02.801209657Z [2024-05-11 01:08:02,800: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:08:02.804238983Z [2024-05-11 01:08:02,803: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:08:02.827435882Z [2024-05-11 01:08:02,827: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:08:02.828618471Z [2024-05-11 01:08:02,828: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:08:02.828844345Z [2024-05-11 01:08:02,828: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:08:02.829123698Z [2024-05-11 01:08:02,828: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:08:02.829161909Z [2024-05-11 01:08:02,829: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:08:02.829559119Z [2024-05-11 01:08:02,829: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:08:02.829755108Z [2024-05-11 01:08:02,829: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:08:02.846813861Z [2024-05-11 01:08:02,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:08:02.927787313Z [2024-05-11 01:08:02,927: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:08:04.643270628Z [2024-05-11 01:08:04,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e155d097-09d8-4c70-b455-c4de002eed20] succeeded in 3.46913347500049s: None 2024-05-11T01:08:05.022346217Z [2024-05-11 01:08:05,021: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb504209-4ba8-481d-b8b9-27d5eee9352d] succeeded in 3.824166210999465s: None 2024-05-11T01:09:00.469954824Z [2024-05-11 01:09:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a56771c3-d59f-4f10-8092-c1bef8036c4c] received 2024-05-11T01:09:00.486008189Z [2024-05-11 01:09:00,481: INFO/ForkPoolWorker-15] [a56771c3-d59f-4f10-8092-c1bef8036c4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:09:00.497975347Z [2024-05-11 01:09:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d723398-75c5-4ca1-bafb-93b761000c2c] received 2024-05-11T01:09:00.498004605Z [2024-05-11 01:09:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f1f0e75-b4c9-47aa-9abe-190cb7c10780] received 2024-05-11T01:09:00.506013926Z [2024-05-11 01:09:00,504: INFO/ForkPoolWorker-16] [2d723398-75c5-4ca1-bafb-93b761000c2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:09:00.506038372Z [2024-05-11 01:09:00,505: INFO/ForkPoolWorker-1] [5f1f0e75-b4c9-47aa-9abe-190cb7c10780] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:09:00.991251095Z [2024-05-11 01:09:00,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:09:01.021552645Z [2024-05-11 01:09:01,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:09:01.132860554Z [2024-05-11 01:09:01,102: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:09:01.281602555Z [2024-05-11 01:09:01,281: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:09:01.287102790Z [2024-05-11 01:09:01,285: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:09:01.338098281Z [2024-05-11 01:09:01,337: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:09:01.342113258Z [2024-05-11 01:09:01,341: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:09:01.342497642Z [2024-05-11 01:09:01,342: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:09:01.343622756Z [2024-05-11 01:09:01,343: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:09:01.343820768Z [2024-05-11 01:09:01,343: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:09:01.434306514Z [2024-05-11 01:09:01,434: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:09:02.140107291Z [2024-05-11 01:09:02,139: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f1f0e75-b4c9-47aa-9abe-190cb7c10780] succeeded in 1.6405716159988515s: None 2024-05-11T01:09:02.479932396Z [2024-05-11 01:09:02,479: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:09:02.483782868Z [2024-05-11 01:09:02,483: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:09:02.499601578Z [2024-05-11 01:09:02,499: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:09:02.500693597Z [2024-05-11 01:09:02,500: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:09:02.500876068Z [2024-05-11 01:09:02,500: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:09:02.501089603Z [2024-05-11 01:09:02,500: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:09:02.501226780Z [2024-05-11 01:09:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:09:02.501638282Z [2024-05-11 01:09:02,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:09:02.501809188Z [2024-05-11 01:09:02,501: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:09:02.555425674Z [2024-05-11 01:09:02,555: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:09:02.558639626Z [2024-05-11 01:09:02,558: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:09:02.582451198Z [2024-05-11 01:09:02,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:09:02.582998733Z [2024-05-11 01:09:02,582: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:09:02.589072027Z [2024-05-11 01:09:02,588: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:09:02.589099531Z [2024-05-11 01:09:02,588: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:09:02.589298639Z [2024-05-11 01:09:02,589: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:09:02.589304177Z [2024-05-11 01:09:02,589: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:09:02.589533901Z [2024-05-11 01:09:02,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:09:02.589600416Z [2024-05-11 01:09:02,589: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:09:02.671672903Z [2024-05-11 01:09:02,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:09:04.420541646Z [2024-05-11 01:09:04,420: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d723398-75c5-4ca1-bafb-93b761000c2c] succeeded in 3.926519865000955s: None 2024-05-11T01:09:06.216252663Z [2024-05-11 01:09:06,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a56771c3-d59f-4f10-8092-c1bef8036c4c] succeeded in 5.747209825000027s: None 2024-05-11T01:10:00.952598404Z [2024-05-11 01:10:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41cebfd5-98c1-4da8-ae39-253263404ac7] received 2024-05-11T01:10:00.955183889Z [2024-05-11 01:10:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa7f27c1-05c1-4792-bb08-7b91808dea68] received 2024-05-11T01:10:00.958281135Z [2024-05-11 01:10:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1428d98b-a04a-4b11-9d67-c8b72f509a46] received 2024-05-11T01:10:00.964569335Z [2024-05-11 01:10:00,963: INFO/ForkPoolWorker-15] [41cebfd5-98c1-4da8-ae39-253263404ac7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:10:00.966049839Z [2024-05-11 01:10:00,965: INFO/ForkPoolWorker-16] [fa7f27c1-05c1-4792-bb08-7b91808dea68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:10:00.967346373Z [2024-05-11 01:10:00,967: INFO/ForkPoolWorker-1] [1428d98b-a04a-4b11-9d67-c8b72f509a46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:00.967361268Z [2024-05-11 01:10:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f881e98a-8963-478b-b23e-5938159779d8] received 2024-05-11T01:10:00.975657358Z [2024-05-11 01:10:00,975: INFO/ForkPoolWorker-2] [f881e98a-8963-478b-b23e-5938159779d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:10:00.977301989Z [2024-05-11 01:10:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6aced1b4-6839-409d-b209-609e40a6ad0d] received 2024-05-11T01:10:00.986657310Z [2024-05-11 01:10:00,986: INFO/ForkPoolWorker-3] [6aced1b4-6839-409d-b209-609e40a6ad0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:10:01.458974447Z [2024-05-11 01:10:01,434: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:10:01.482884007Z [2024-05-11 01:10:01,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:10:01.493282449Z [2024-05-11 01:10:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:10:01.637115029Z [2024-05-11 01:10:01,633: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:10:01.689604194Z [2024-05-11 01:10:01,686: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:10:01.907061883Z [2024-05-11 01:10:01,906: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-11T01:10:01.911342398Z [2024-05-11 01:10:01,910: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:01.918845166Z [2024-05-11 01:10:01,918: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:01.941944538Z [2024-05-11 01:10:01,941: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:10:01.943241645Z [2024-05-11 01:10:01,943: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:10:01.943960441Z [2024-05-11 01:10:01,943: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:10:01.944104071Z [2024-05-11 01:10:01,943: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-11T01:10:01.944383146Z [2024-05-11 01:10:01,944: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:10:02.128587176Z [2024-05-11 01:10:02,128: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:02.561817649Z [2024-05-11 01:10:02,561: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f881e98a-8963-478b-b23e-5938159779d8] succeeded in 1.5926980770000227s: None 2024-05-11T01:10:02.847918859Z [2024-05-11 01:10:02,847: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6aced1b4-6839-409d-b209-609e40a6ad0d] succeeded in 1.8686058309995133s: None 2024-05-11T01:10:02.854391700Z [2024-05-11 01:10:02,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:10:02.858081221Z [2024-05-11 01:10:02,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:02.923331963Z [2024-05-11 01:10:02,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:10:02.926364359Z [2024-05-11 01:10:02,926: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:02.928037390Z [2024-05-11 01:10:02,926: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:02.928185968Z [2024-05-11 01:10:02,928: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:02.928250293Z [2024-05-11 01:10:02,928: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:10:02.928534573Z [2024-05-11 01:10:02,928: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:10:02.928790375Z [2024-05-11 01:10:02,928: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:03.017803921Z [2024-05-11 01:10:03,017: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:03.023856703Z [2024-05-11 01:10:03,023: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:10:03.028948380Z [2024-05-11 01:10:03,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:03.059679422Z [2024-05-11 01:10:03,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:10:03.062845995Z [2024-05-11 01:10:03,062: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:03.062862777Z [2024-05-11 01:10:03,062: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:03.062964176Z [2024-05-11 01:10:03,062: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:03.062975373Z [2024-05-11 01:10:03,062: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:10:03.063220986Z [2024-05-11 01:10:03,063: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:10:03.063233463Z [2024-05-11 01:10:03,063: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:03.250789964Z [2024-05-11 01:10:03,250: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:03.594242019Z [2024-05-11 01:10:03,593: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:10:03.597599988Z [2024-05-11 01:10:03,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:03.626363689Z [2024-05-11 01:10:03,626: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:10:03.627929849Z [2024-05-11 01:10:03,627: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:03.628025929Z [2024-05-11 01:10:03,627: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:03.628165988Z [2024-05-11 01:10:03,628: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:03.628278006Z [2024-05-11 01:10:03,628: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:10:03.628996063Z [2024-05-11 01:10:03,628: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:10:03.629573956Z [2024-05-11 01:10:03,629: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:03.710758212Z [2024-05-11 01:10:03,710: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:04.279245311Z [2024-05-11 01:10:04,278: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1428d98b-a04a-4b11-9d67-c8b72f509a46] succeeded in 3.3186369039995043s: None 2024-05-11T01:10:04.762787817Z [2024-05-11 01:10:04,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b2e859b-8340-4b34-8744-57e47c9c2b4d] received 2024-05-11T01:10:04.770992174Z [2024-05-11 01:10:04,770: INFO/ForkPoolWorker-1] [4b2e859b-8340-4b34-8744-57e47c9c2b4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:05.086117374Z [2024-05-11 01:10:05,085: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa7f27c1-05c1-4792-bb08-7b91808dea68] succeeded in 4.126838095000494s: None 2024-05-11T01:10:05.092305617Z [2024-05-11 01:10:05,088: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:10:05.444895851Z [2024-05-11 01:10:05,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41cebfd5-98c1-4da8-ae39-253263404ac7] succeeded in 4.488245567001286s: None 2024-05-11T01:10:06.239453042Z [2024-05-11 01:10:06,239: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:10:06.242580657Z [2024-05-11 01:10:06,242: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:06.266498507Z [2024-05-11 01:10:06,266: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:10:06.267839712Z [2024-05-11 01:10:06,267: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:06.267980522Z [2024-05-11 01:10:06,267: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:06.268198849Z [2024-05-11 01:10:06,267: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:06.268335236Z [2024-05-11 01:10:06,268: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:10:06.268847369Z [2024-05-11 01:10:06,268: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:10:06.268899805Z [2024-05-11 01:10:06,268: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:06.378868310Z [2024-05-11 01:10:06,378: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:07.116275304Z [2024-05-11 01:10:07,115: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b2e859b-8340-4b34-8744-57e47c9c2b4d] succeeded in 2.3519426559996646s: None 2024-05-11T01:10:07.802583467Z [2024-05-11 01:10:07,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74be63c8-b77f-437e-a99a-af492bd023d0] received 2024-05-11T01:10:07.818705843Z [2024-05-11 01:10:07,817: INFO/ForkPoolWorker-15] [74be63c8-b77f-437e-a99a-af492bd023d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:10:08.122547354Z [2024-05-11 01:10:08,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:10:09.202705612Z [2024-05-11 01:10:09,202: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:10:09.205905822Z [2024-05-11 01:10:09,205: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:09.226545698Z [2024-05-11 01:10:09,226: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:10:09.228244782Z [2024-05-11 01:10:09,227: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:09.228258717Z [2024-05-11 01:10:09,228: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:09.228407751Z [2024-05-11 01:10:09,228: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:09.228473962Z [2024-05-11 01:10:09,228: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:10:09.228777214Z [2024-05-11 01:10:09,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:10:09.228789736Z [2024-05-11 01:10:09,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:09.328607425Z [2024-05-11 01:10:09,328: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:09.903109880Z [2024-05-11 01:10:09,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74be63c8-b77f-437e-a99a-af492bd023d0] succeeded in 2.096024517999467s: None 2024-05-11T01:10:09.910985412Z [2024-05-11 01:10:09,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[970604a0-8656-4b58-bb77-68f5c65fe2ae] received 2024-05-11T01:10:09.925053979Z [2024-05-11 01:10:09,923: INFO/ForkPoolWorker-15] [970604a0-8656-4b58-bb77-68f5c65fe2ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:10:10.186536432Z [2024-05-11 01:10:10,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:10:11.280969886Z [2024-05-11 01:10:11,280: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:10:11.284755703Z [2024-05-11 01:10:11,284: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:10:11.308250924Z [2024-05-11 01:10:11,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:10:11.310475609Z [2024-05-11 01:10:11,310: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:10:11.310492425Z [2024-05-11 01:10:11,310: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:10:11.310895516Z [2024-05-11 01:10:11,310: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:10:11.311092718Z [2024-05-11 01:10:11,310: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:10:11.311615345Z [2024-05-11 01:10:11,311: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:10:11.311804784Z [2024-05-11 01:10:11,311: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:10:11.422660289Z [2024-05-11 01:10:11,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:10:12.076297250Z [2024-05-11 01:10:12,075: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[970604a0-8656-4b58-bb77-68f5c65fe2ae] succeeded in 2.163519747000464s: None 2024-05-11T01:11:00.867565812Z [2024-05-11 01:11:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64d57fdf-bb02-4f3c-88c3-436076d52a03] received 2024-05-11T01:11:00.870327330Z [2024-05-11 01:11:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f62e8d2a-5595-46a2-84e5-9c20160ef246] received 2024-05-11T01:11:00.877688880Z [2024-05-11 01:11:00,877: INFO/ForkPoolWorker-15] [64d57fdf-bb02-4f3c-88c3-436076d52a03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:11:00.882998732Z [2024-05-11 01:11:00,882: INFO/ForkPoolWorker-16] [f62e8d2a-5595-46a2-84e5-9c20160ef246] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:11:00.897442541Z [2024-05-11 01:11:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b8d7f4-9350-4ea1-a1c7-3895f0882515] received 2024-05-11T01:11:00.910168898Z [2024-05-11 01:11:00,909: INFO/ForkPoolWorker-1] [b0b8d7f4-9350-4ea1-a1c7-3895f0882515] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:11:01.293923228Z [2024-05-11 01:11:01,290: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:11:01.344228954Z [2024-05-11 01:11:01,341: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:11:01.358932913Z [2024-05-11 01:11:01,354: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:11:01.507721022Z [2024-05-11 01:11:01,507: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:11:01.513121813Z [2024-05-11 01:11:01,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:11:01.559097392Z [2024-05-11 01:11:01,558: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:11:01.562857965Z [2024-05-11 01:11:01,562: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:11:01.562917703Z [2024-05-11 01:11:01,562: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:11:01.563055528Z [2024-05-11 01:11:01,562: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:11:01.563426288Z [2024-05-11 01:11:01,563: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:11:01.664396735Z [2024-05-11 01:11:01,664: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:11:02.330009684Z [2024-05-11 01:11:02,329: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0b8d7f4-9350-4ea1-a1c7-3895f0882515] succeeded in 1.4308247139997547s: None 2024-05-11T01:11:02.576434507Z [2024-05-11 01:11:02,576: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:11:02.579871061Z [2024-05-11 01:11:02,579: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:11:02.599219355Z [2024-05-11 01:11:02,599: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:11:02.600545918Z [2024-05-11 01:11:02,600: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:11:02.600565638Z [2024-05-11 01:11:02,600: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:11:02.600792938Z [2024-05-11 01:11:02,600: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:11:02.601075830Z [2024-05-11 01:11:02,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:11:02.601526880Z [2024-05-11 01:11:02,601: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:11:02.601585074Z [2024-05-11 01:11:02,601: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:11:02.638595672Z [2024-05-11 01:11:02,638: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:11:02.642500469Z [2024-05-11 01:11:02,642: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:11:02.666877667Z [2024-05-11 01:11:02,666: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:11:02.668853323Z [2024-05-11 01:11:02,668: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:11:02.668917413Z [2024-05-11 01:11:02,668: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:11:02.668930587Z [2024-05-11 01:11:02,668: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:11:02.668941521Z [2024-05-11 01:11:02,668: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:11:02.669339233Z [2024-05-11 01:11:02,669: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:11:02.669624220Z [2024-05-11 01:11:02,669: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:11:02.691936212Z [2024-05-11 01:11:02,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:11:02.763717067Z [2024-05-11 01:11:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:11:04.174566436Z [2024-05-11 01:11:04,174: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f62e8d2a-5595-46a2-84e5-9c20160ef246] succeeded in 3.3014108660008787s: None 2024-05-11T01:11:04.402887117Z [2024-05-11 01:11:04,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64d57fdf-bb02-4f3c-88c3-436076d52a03] succeeded in 3.53090775399869s: None 2024-05-11T01:12:00.541144548Z [2024-05-11 01:12:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcd542e1-01d4-4e7a-b98c-c94e632bc6fb] received 2024-05-11T01:12:00.544480163Z [2024-05-11 01:12:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29026fb3-ac9a-4538-8097-a378fe376d14] received 2024-05-11T01:12:00.546845184Z [2024-05-11 01:12:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d74937-ba4e-4c0d-b6be-06cb343ab952] received 2024-05-11T01:12:00.549666977Z [2024-05-11 01:12:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[884d279f-2b7d-477b-b9f4-38add936595a] received 2024-05-11T01:12:00.555724712Z [2024-05-11 01:12:00,554: INFO/ForkPoolWorker-15] [dcd542e1-01d4-4e7a-b98c-c94e632bc6fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:12:00.566248746Z [2024-05-11 01:12:00,565: INFO/ForkPoolWorker-16] [29026fb3-ac9a-4538-8097-a378fe376d14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:12:00.566476597Z [2024-05-11 01:12:00,566: INFO/ForkPoolWorker-1] [20d74937-ba4e-4c0d-b6be-06cb343ab952] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:12:00.571613118Z [2024-05-11 01:12:00,571: INFO/ForkPoolWorker-2] [884d279f-2b7d-477b-b9f4-38add936595a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:12:00.851334710Z [2024-05-11 01:12:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:12:00.873893343Z [2024-05-11 01:12:00,869: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:12:00.888028183Z [2024-05-11 01:12:00,884: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:12:00.912089289Z [2024-05-11 01:12:00,908: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:12:01.152708193Z [2024-05-11 01:12:01,152: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:12:01.157971763Z [2024-05-11 01:12:01,157: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:12:01.242094677Z [2024-05-11 01:12:01,241: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:12:01.258830793Z [2024-05-11 01:12:01,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:12:01.263486487Z [2024-05-11 01:12:01,263: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:12:01.265592745Z [2024-05-11 01:12:01,263: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:12:01.265800790Z [2024-05-11 01:12:01,265: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:12:01.268288013Z [2024-05-11 01:12:01,268: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:12:01.353634936Z [2024-05-11 01:12:01,353: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:12:01.758091815Z [2024-05-11 01:12:01,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dcd542e1-01d4-4e7a-b98c-c94e632bc6fb] succeeded in 1.214604144999612s: None 2024-05-11T01:12:01.953312761Z [2024-05-11 01:12:01,952: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[884d279f-2b7d-477b-b9f4-38add936595a] succeeded in 1.401072923999891s: None 2024-05-11T01:12:02.210281405Z [2024-05-11 01:12:02,209: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:12:02.213726881Z [2024-05-11 01:12:02,213: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:12:02.230991054Z [2024-05-11 01:12:02,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:12:02.232152260Z [2024-05-11 01:12:02,231: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:12:02.232451953Z [2024-05-11 01:12:02,232: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:12:02.232658998Z [2024-05-11 01:12:02,232: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:12:02.232738544Z [2024-05-11 01:12:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:12:02.233507959Z [2024-05-11 01:12:02,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:12:02.233854203Z [2024-05-11 01:12:02,233: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:12:02.271199690Z [2024-05-11 01:12:02,270: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:12:02.274631910Z [2024-05-11 01:12:02,274: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:12:02.297853680Z [2024-05-11 01:12:02,297: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:12:02.299309080Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:12:02.299407030Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:12:02.299588247Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:12:02.299690908Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:12:02.299941004Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:12:02.300053552Z [2024-05-11 01:12:02,299: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:12:02.321965810Z [2024-05-11 01:12:02,321: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:12:02.411256799Z [2024-05-11 01:12:02,410: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:12:05.115764186Z [2024-05-11 01:12:05,115: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20d74937-ba4e-4c0d-b6be-06cb343ab952] succeeded in 4.566504850001365s: None 2024-05-11T01:12:05.635495254Z [2024-05-11 01:12:05,634: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29026fb3-ac9a-4538-8097-a378fe376d14] succeeded in 5.089220619000116s: None 2024-05-11T01:13:00.757615847Z [2024-05-11 01:13:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f391f1e-f1a0-4a4a-b38a-06c6cf36303e] received 2024-05-11T01:13:00.766808299Z [2024-05-11 01:13:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f2cfb4-b1b0-434f-9be0-8ad36eff5ed2] received 2024-05-11T01:13:00.767641467Z [2024-05-11 01:13:00,767: INFO/ForkPoolWorker-15] [2f391f1e-f1a0-4a4a-b38a-06c6cf36303e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:13:00.770833644Z [2024-05-11 01:13:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95fcb288-27e0-4b8b-a7e2-b7f7e4b69043] received 2024-05-11T01:13:00.778324850Z [2024-05-11 01:13:00,778: INFO/ForkPoolWorker-1] [95fcb288-27e0-4b8b-a7e2-b7f7e4b69043] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:13:00.789929640Z [2024-05-11 01:13:00,789: INFO/ForkPoolWorker-16] [83f2cfb4-b1b0-434f-9be0-8ad36eff5ed2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:13:01.057396023Z [2024-05-11 01:13:01,053: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:13:01.058868238Z [2024-05-11 01:13:01,054: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:13:01.114441118Z [2024-05-11 01:13:01,101: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:13:01.356215588Z [2024-05-11 01:13:01,355: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:13:01.360583398Z [2024-05-11 01:13:01,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:13:01.390923278Z [2024-05-11 01:13:01,390: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:13:01.392347393Z [2024-05-11 01:13:01,392: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:13:01.392579440Z [2024-05-11 01:13:01,392: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:13:01.392775079Z [2024-05-11 01:13:01,392: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:13:01.393153995Z [2024-05-11 01:13:01,392: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:13:01.493091509Z [2024-05-11 01:13:01,492: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:13:02.060851412Z [2024-05-11 01:13:02,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95fcb288-27e0-4b8b-a7e2-b7f7e4b69043] succeeded in 1.2886642049998045s: None 2024-05-11T01:13:02.237936199Z [2024-05-11 01:13:02,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:13:02.241592732Z [2024-05-11 01:13:02,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:13:02.267009828Z [2024-05-11 01:13:02,266: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:13:02.268533595Z [2024-05-11 01:13:02,268: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:13:02.268650143Z [2024-05-11 01:13:02,268: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:13:02.268957799Z [2024-05-11 01:13:02,268: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:13:02.269043133Z [2024-05-11 01:13:02,268: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:13:02.269401246Z [2024-05-11 01:13:02,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:13:02.269509726Z [2024-05-11 01:13:02,269: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:13:02.306820423Z [2024-05-11 01:13:02,306: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:13:02.310569201Z [2024-05-11 01:13:02,310: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:13:02.335407752Z [2024-05-11 01:13:02,335: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:13:02.336996076Z [2024-05-11 01:13:02,336: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:13:02.337424891Z [2024-05-11 01:13:02,337: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:13:02.338133084Z [2024-05-11 01:13:02,337: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:13:02.338275969Z [2024-05-11 01:13:02,338: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:13:02.338947616Z [2024-05-11 01:13:02,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:13:02.339118125Z [2024-05-11 01:13:02,338: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:13:02.350272434Z [2024-05-11 01:13:02,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:13:02.444232246Z [2024-05-11 01:13:02,443: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:13:03.827349032Z [2024-05-11 01:13:03,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f391f1e-f1a0-4a4a-b38a-06c6cf36303e] succeeded in 3.0677057040011277s: None 2024-05-11T01:13:04.166466938Z [2024-05-11 01:13:04,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83f2cfb4-b1b0-434f-9be0-8ad36eff5ed2] succeeded in 3.397165345000758s: None 2024-05-11T01:14:00.672258259Z [2024-05-11 01:14:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4060cc72-fa16-4242-b83b-44275d7645b1] received 2024-05-11T01:14:00.676090161Z [2024-05-11 01:14:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55aa4b04-5f64-4112-b602-fc420fd8fd78] received 2024-05-11T01:14:00.684029244Z [2024-05-11 01:14:00,683: INFO/ForkPoolWorker-15] [4060cc72-fa16-4242-b83b-44275d7645b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:14:00.692059956Z [2024-05-11 01:14:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5179f41b-0849-4b22-ab1f-b338774d9a12] received 2024-05-11T01:14:00.695097258Z [2024-05-11 01:14:00,694: INFO/ForkPoolWorker-16] [55aa4b04-5f64-4112-b602-fc420fd8fd78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:14:00.695839088Z [2024-05-11 01:14:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16b5274a-bff4-4f96-83e2-62397987cfbe] received 2024-05-11T01:14:00.707462650Z [2024-05-11 01:14:00,707: INFO/ForkPoolWorker-2] [16b5274a-bff4-4f96-83e2-62397987cfbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:14:00.713014628Z [2024-05-11 01:14:00,712: INFO/ForkPoolWorker-1] [5179f41b-0849-4b22-ab1f-b338774d9a12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:14:01.062844698Z [2024-05-11 01:14:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:14:01.173504323Z [2024-05-11 01:14:01,169: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:14:01.200065703Z [2024-05-11 01:14:01,157: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:14:01.241699898Z [2024-05-11 01:14:01,222: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:14:01.416917260Z [2024-05-11 01:14:01,416: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:14:01.421195922Z [2024-05-11 01:14:01,420: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:14:01.443534648Z [2024-05-11 01:14:01,443: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:14:01.452237766Z [2024-05-11 01:14:01,451: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:14:01.453298141Z [2024-05-11 01:14:01,453: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:14:01.453473959Z [2024-05-11 01:14:01,453: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:14:01.453921382Z [2024-05-11 01:14:01,453: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:14:01.455028875Z [2024-05-11 01:14:01,454: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:14:01.634257414Z [2024-05-11 01:14:01,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:14:02.189219200Z [2024-05-11 01:14:02,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4060cc72-fa16-4242-b83b-44275d7645b1] succeeded in 1.5142165180004667s: None 2024-05-11T01:14:02.246181257Z [2024-05-11 01:14:02,245: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[16b5274a-bff4-4f96-83e2-62397987cfbe] succeeded in 1.5480800499990437s: None 2024-05-11T01:14:02.475295816Z [2024-05-11 01:14:02,474: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:14:02.478620256Z [2024-05-11 01:14:02,478: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:14:02.505751060Z [2024-05-11 01:14:02,505: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:14:02.507648187Z [2024-05-11 01:14:02,507: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:14:02.507857534Z [2024-05-11 01:14:02,507: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:14:02.508466423Z [2024-05-11 01:14:02,508: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:14:02.508673790Z [2024-05-11 01:14:02,508: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:14:02.509097500Z [2024-05-11 01:14:02,508: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:14:02.509299712Z [2024-05-11 01:14:02,509: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:14:02.599286931Z [2024-05-11 01:14:02,598: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:14:02.601513051Z [2024-05-11 01:14:02,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:14:02.605514198Z [2024-05-11 01:14:02,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:14:02.639502685Z [2024-05-11 01:14:02,639: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:14:02.641246240Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:14:02.641352093Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:14:02.641531169Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:14:02.641628439Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:14:02.641975905Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:14:02.642101268Z [2024-05-11 01:14:02,641: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:14:02.733395718Z [2024-05-11 01:14:02,733: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:14:04.335866436Z [2024-05-11 01:14:04,335: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5179f41b-0849-4b22-ab1f-b338774d9a12] succeeded in 3.6362772899992706s: None 2024-05-11T01:14:04.811494987Z [2024-05-11 01:14:04,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55aa4b04-5f64-4112-b602-fc420fd8fd78] succeeded in 4.1280072439985815s: None 2024-05-11T01:14:38.961954218Z [2024-05-11 01:14:38,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b99525b-c272-4fcf-9b31-c8108c0227eb] received 2024-05-11T01:14:38.982199739Z [2024-05-11 01:14:38,981: INFO/ForkPoolWorker-15] [8b99525b-c272-4fcf-9b31-c8108c0227eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240511011437_080449', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-11T01:14:39.245419535Z [2024-05-11 01:14:39,242: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-11T01:14:39.541498527Z [2024-05-11 01:14:39,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:14:40.169221744Z [2024-05-11 01:14:40,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b99525b-c272-4fcf-9b31-c8108c0227eb] succeeded in 1.204255104999902s: None 2024-05-11T01:15:00.783831033Z [2024-05-11 01:15:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46fa527a-fc43-4e0c-bd8d-4bae88a22a53] received 2024-05-11T01:15:00.786029622Z [2024-05-11 01:15:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf24e38c-dd03-478d-9d82-f328dc883304] received 2024-05-11T01:15:00.791091566Z [2024-05-11 01:15:00,790: INFO/ForkPoolWorker-15] [46fa527a-fc43-4e0c-bd8d-4bae88a22a53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:00.806802927Z [2024-05-11 01:15:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[def2b5dc-78c8-4d81-9ed7-9c19ca98a8f8] received 2024-05-11T01:15:00.807924039Z [2024-05-11 01:15:00,807: INFO/ForkPoolWorker-16] [bf24e38c-dd03-478d-9d82-f328dc883304] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:15:00.808280754Z [2024-05-11 01:15:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66dd838c-3409-4e47-acde-23151e24023f] received 2024-05-11T01:15:00.814459500Z [2024-05-11 01:15:00,814: INFO/ForkPoolWorker-2] [66dd838c-3409-4e47-acde-23151e24023f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:15:00.836553207Z [2024-05-11 01:15:00,836: INFO/ForkPoolWorker-1] [def2b5dc-78c8-4d81-9ed7-9c19ca98a8f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:15:01.231825486Z [2024-05-11 01:15:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:15:01.235692637Z [2024-05-11 01:15:01,232: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:15:01.335323618Z [2024-05-11 01:15:01,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:15:01.373798629Z [2024-05-11 01:15:01,370: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:15:01.533202725Z [2024-05-11 01:15:01,532: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:15:01.537039061Z [2024-05-11 01:15:01,536: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:01.572962566Z [2024-05-11 01:15:01,572: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:15:01.575827333Z [2024-05-11 01:15:01,575: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:15:01.575865371Z [2024-05-11 01:15:01,575: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:15:01.575933318Z [2024-05-11 01:15:01,575: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:15:01.576109000Z [2024-05-11 01:15:01,576: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:15:01.700461719Z [2024-05-11 01:15:01,700: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:02.278047109Z [2024-05-11 01:15:02,277: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[66dd838c-3409-4e47-acde-23151e24023f] succeeded in 1.4682308419996843s: None 2024-05-11T01:15:02.502746707Z [2024-05-11 01:15:02,502: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:15:02.506142339Z [2024-05-11 01:15:02,505: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:02.523515680Z [2024-05-11 01:15:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:15:02.524391378Z [2024-05-11 01:15:02,524: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:15:02.525590138Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:02.525605084Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:02.525743513Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:02.525754024Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:15:02.526009646Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:15:02.526038404Z [2024-05-11 01:15:02,525: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:02.527485764Z [2024-05-11 01:15:02,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:02.553638766Z [2024-05-11 01:15:02,553: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:15:02.555487222Z [2024-05-11 01:15:02,555: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:02.555680159Z [2024-05-11 01:15:02,555: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:02.555934672Z [2024-05-11 01:15:02,555: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:02.556105264Z [2024-05-11 01:15:02,555: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:15:02.556812790Z [2024-05-11 01:15:02,556: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:15:02.556952968Z [2024-05-11 01:15:02,556: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:02.609976213Z [2024-05-11 01:15:02,609: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:02.632135143Z [2024-05-11 01:15:02,631: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:02.666940336Z [2024-05-11 01:15:02,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:15:02.671125911Z [2024-05-11 01:15:02,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:02.722761030Z [2024-05-11 01:15:02,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:15:02.723933815Z [2024-05-11 01:15:02,723: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:02.724102692Z [2024-05-11 01:15:02,723: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:02.724285366Z [2024-05-11 01:15:02,724: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:02.724402726Z [2024-05-11 01:15:02,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:15:02.724721188Z [2024-05-11 01:15:02,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:15:02.724854735Z [2024-05-11 01:15:02,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:02.827232636Z [2024-05-11 01:15:02,826: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:03.427976997Z [2024-05-11 01:15:03,427: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46fa527a-fc43-4e0c-bd8d-4bae88a22a53] succeeded in 2.640892563998932s: None 2024-05-11T01:15:03.529069337Z [2024-05-11 01:15:03,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87bc128b-cfe0-42b4-ac47-bc8ca41077e5] received 2024-05-11T01:15:03.537309300Z [2024-05-11 01:15:03,536: INFO/ForkPoolWorker-15] [87bc128b-cfe0-42b4-ac47-bc8ca41077e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:03.828057578Z [2024-05-11 01:15:03,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:15:04.101953010Z [2024-05-11 01:15:04,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf24e38c-dd03-478d-9d82-f328dc883304] succeeded in 3.309488467999472s: None 2024-05-11T01:15:04.558605618Z [2024-05-11 01:15:04,558: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[def2b5dc-78c8-4d81-9ed7-9c19ca98a8f8] succeeded in 3.750442523001766s: None 2024-05-11T01:15:05.078338459Z [2024-05-11 01:15:05,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:15:05.081795014Z [2024-05-11 01:15:05,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:05.112064749Z [2024-05-11 01:15:05,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:15:05.113660546Z [2024-05-11 01:15:05,113: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:05.113934666Z [2024-05-11 01:15:05,113: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:05.114228960Z [2024-05-11 01:15:05,113: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:05.114436224Z [2024-05-11 01:15:05,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:15:05.114952221Z [2024-05-11 01:15:05,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:15:05.115118285Z [2024-05-11 01:15:05,114: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:05.224982678Z [2024-05-11 01:15:05,224: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:05.810614419Z [2024-05-11 01:15:05,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87bc128b-cfe0-42b4-ac47-bc8ca41077e5] succeeded in 2.2799979739993432s: None 2024-05-11T01:15:06.188996555Z [2024-05-11 01:15:06,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a3e2607-6145-4af6-bf6d-199c2ed3b1c9] received 2024-05-11T01:15:06.196796276Z [2024-05-11 01:15:06,196: INFO/ForkPoolWorker-15] [9a3e2607-6145-4af6-bf6d-199c2ed3b1c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:15:06.476404583Z [2024-05-11 01:15:06,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:15:07.697831867Z [2024-05-11 01:15:07,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:15:07.701253647Z [2024-05-11 01:15:07,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:07.729964865Z [2024-05-11 01:15:07,728: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:15:07.731156004Z [2024-05-11 01:15:07,730: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:07.733011736Z [2024-05-11 01:15:07,731: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:07.733555285Z [2024-05-11 01:15:07,732: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:07.734456705Z [2024-05-11 01:15:07,734: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:15:07.734922894Z [2024-05-11 01:15:07,734: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:15:07.735023469Z [2024-05-11 01:15:07,734: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:07.856998836Z [2024-05-11 01:15:07,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:08.352385584Z [2024-05-11 01:15:08,351: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a3e2607-6145-4af6-bf6d-199c2ed3b1c9] succeeded in 2.161001997999847s: None 2024-05-11T01:15:09.177828351Z [2024-05-11 01:15:09,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[703a983b-9343-4222-b549-ce61d8b4e265] received 2024-05-11T01:15:09.186758434Z [2024-05-11 01:15:09,186: INFO/ForkPoolWorker-15] [703a983b-9343-4222-b549-ce61d8b4e265] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:15:09.445899778Z [2024-05-11 01:15:09,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:15:10.598225515Z [2024-05-11 01:15:10,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:15:10.602133277Z [2024-05-11 01:15:10,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:15:10.624502337Z [2024-05-11 01:15:10,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:15:10.625995957Z [2024-05-11 01:15:10,625: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:15:10.626186212Z [2024-05-11 01:15:10,625: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:15:10.626431091Z [2024-05-11 01:15:10,626: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:15:10.626628376Z [2024-05-11 01:15:10,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:15:10.627048364Z [2024-05-11 01:15:10,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:15:10.627194672Z [2024-05-11 01:15:10,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:15:10.726722092Z [2024-05-11 01:15:10,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:15:11.312182173Z [2024-05-11 01:15:11,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[703a983b-9343-4222-b549-ce61d8b4e265] succeeded in 2.1324462379998295s: None 2024-05-11T01:16:00.482436230Z [2024-05-11 01:16:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61f8c9b0-79f3-405b-b426-c64c468a604c] received 2024-05-11T01:16:00.487612842Z [2024-05-11 01:16:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db5a265e-8cb4-4ef8-9bdf-415416db5b14] received 2024-05-11T01:16:00.493437927Z [2024-05-11 01:16:00,493: INFO/ForkPoolWorker-15] [61f8c9b0-79f3-405b-b426-c64c468a604c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:16:00.496580787Z [2024-05-11 01:16:00,496: INFO/ForkPoolWorker-16] [db5a265e-8cb4-4ef8-9bdf-415416db5b14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:16:00.507392662Z [2024-05-11 01:16:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df3e130c-3eb5-4c4c-ab2c-d338494668f4] received 2024-05-11T01:16:00.508942261Z [2024-05-11 01:16:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dad7a61-037e-4c14-82fd-6b25dfbfba57] received 2024-05-11T01:16:00.522757920Z [2024-05-11 01:16:00,522: INFO/ForkPoolWorker-1] [df3e130c-3eb5-4c4c-ab2c-d338494668f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:16:00.525011006Z [2024-05-11 01:16:00,522: INFO/ForkPoolWorker-2] [4dad7a61-037e-4c14-82fd-6b25dfbfba57] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:16:00.797232621Z [2024-05-11 01:16:00,794: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:16:00.812269450Z [2024-05-11 01:16:00,809: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:16:00.833976137Z [2024-05-11 01:16:00,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:16:00.853593995Z [2024-05-11 01:16:00,850: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:16:00.971243727Z [2024-05-11 01:16:00,969: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:16:00.979238949Z [2024-05-11 01:16:00,977: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:01.037707972Z [2024-05-11 01:16:01,037: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:16:01.049985056Z [2024-05-11 01:16:01,049: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:16:01.050008842Z [2024-05-11 01:16:01,049: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:16:01.050182749Z [2024-05-11 01:16:01,049: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:16:01.050679266Z [2024-05-11 01:16:01,050: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:16:01.223710909Z [2024-05-11 01:16:01,223: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:01.263058795Z [2024-05-11 01:16:01,262: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:01.742623787Z [2024-05-11 01:16:01,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61f8c9b0-79f3-405b-b426-c64c468a604c] succeeded in 1.2577881889992568s: None 2024-05-11T01:16:01.915109062Z [2024-05-11 01:16:01,914: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4dad7a61-037e-4c14-82fd-6b25dfbfba57] succeeded in 1.402939970999796s: None 2024-05-11T01:16:02.164048963Z [2024-05-11 01:16:02,163: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:16:02.167683440Z [2024-05-11 01:16:02,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:02.187529860Z [2024-05-11 01:16:02,187: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:16:02.188671409Z [2024-05-11 01:16:02,188: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:02.188818578Z [2024-05-11 01:16:02,188: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:02.188989525Z [2024-05-11 01:16:02,188: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:16:02.189079435Z [2024-05-11 01:16:02,188: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:16:02.189330725Z [2024-05-11 01:16:02,189: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:16:02.189438285Z [2024-05-11 01:16:02,189: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:02.213423981Z [2024-05-11 01:16:02,213: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:16:02.216833498Z [2024-05-11 01:16:02,216: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:02.252988014Z [2024-05-11 01:16:02,252: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:16:02.254901314Z [2024-05-11 01:16:02,254: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:02.255395321Z [2024-05-11 01:16:02,254: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:02.255706263Z [2024-05-11 01:16:02,255: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:16:02.255820730Z [2024-05-11 01:16:02,255: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:16:02.256282630Z [2024-05-11 01:16:02,256: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:16:02.256356250Z [2024-05-11 01:16:02,256: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:02.278975188Z [2024-05-11 01:16:02,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:02.360836709Z [2024-05-11 01:16:02,360: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:03.988482906Z [2024-05-11 01:16:03,987: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df3e130c-3eb5-4c4c-ab2c-d338494668f4] succeeded in 3.476177713000652s: None 2024-05-11T01:16:04.186990793Z [2024-05-11 01:16:04,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db5a265e-8cb4-4ef8-9bdf-415416db5b14] succeeded in 3.696668544000204s: None 2024-05-11T01:16:19.679073536Z [2024-05-11 01:16:19,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3e40fcf-5b7b-4b2b-8230-3db20a80b3e7] received 2024-05-11T01:16:19.691550739Z [2024-05-11 01:16:19,691: INFO/ForkPoolWorker-15] [a3e40fcf-5b7b-4b2b-8230-3db20a80b3e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:16:20.020036722Z [2024-05-11 01:16:20,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:16:21.058770741Z [2024-05-11 01:16:21,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:16:21.062615432Z [2024-05-11 01:16:21,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:21.095904005Z [2024-05-11 01:16:21,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:16:21.097207391Z [2024-05-11 01:16:21,097: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:21.097447470Z [2024-05-11 01:16:21,097: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:21.097674631Z [2024-05-11 01:16:21,097: INFO/ForkPoolWorker-15] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:21.098126144Z [2024-05-11 01:16:21,097: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:21.098409058Z [2024-05-11 01:16:21,098: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:16:21.099046717Z [2024-05-11 01:16:21,098: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:16:21.099358143Z [2024-05-11 01:16:21,099: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:21.105939352Z [2024-05-11 01:16:21,105: INFO/ForkPoolWorker-15] Creating DAG vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:21.185900833Z [2024-05-11 01:16:21,185: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:22.606896700Z [2024-05-11 01:16:22,606: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3e40fcf-5b7b-4b2b-8230-3db20a80b3e7] succeeded in 2.9245957620005356s: None 2024-05-11T01:16:24.566861467Z [2024-05-11 01:16:24,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[647eb952-62a7-43a5-a179-84be14808242] received 2024-05-11T01:16:24.579596990Z [2024-05-11 01:16:24,579: INFO/ForkPoolWorker-15] [647eb952-62a7-43a5-a179-84be14808242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:16:24.857041909Z [2024-05-11 01:16:24,853: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:16:25.825009306Z [2024-05-11 01:16:25,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0837d06-9f03-4300-94b5-43964b3ef5df] received 2024-05-11T01:16:25.842620110Z [2024-05-11 01:16:25,842: INFO/ForkPoolWorker-16] [c0837d06-9f03-4300-94b5-43964b3ef5df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:25.938526538Z [2024-05-11 01:16:25,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:16:25.942378300Z [2024-05-11 01:16:25,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:25.990924546Z [2024-05-11 01:16:25,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:16:25.992949233Z [2024-05-11 01:16:25,992: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:25.993089163Z [2024-05-11 01:16:25,992: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:25.993207871Z [2024-05-11 01:16:25,993: INFO/ForkPoolWorker-15] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:25.993384418Z [2024-05-11 01:16:25,993: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:25.993484307Z [2024-05-11 01:16:25,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:16:25.993765205Z [2024-05-11 01:16:25,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:16:25.993889168Z [2024-05-11 01:16:25,993: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:25.997949157Z [2024-05-11 01:16:25,997: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:26.099155007Z [2024-05-11 01:16:26,098: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:26.210252885Z [2024-05-11 01:16:26,207: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:16:27.251081542Z [2024-05-11 01:16:27,250: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:16:27.254346580Z [2024-05-11 01:16:27,253: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:27.269766812Z [2024-05-11 01:16:27,269: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:16:27.271184266Z [2024-05-11 01:16:27,270: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:27.271304331Z [2024-05-11 01:16:27,271: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:27.271436284Z [2024-05-11 01:16:27,271: INFO/ForkPoolWorker-16] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:27.271666985Z [2024-05-11 01:16:27,271: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:27.271800406Z [2024-05-11 01:16:27,271: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:16:27.272070088Z [2024-05-11 01:16:27,271: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:16:27.272188682Z [2024-05-11 01:16:27,272: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:27.277951380Z [2024-05-11 01:16:27,277: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:27.364241844Z [2024-05-11 01:16:27,363: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:27.785907303Z [2024-05-11 01:16:27,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[647eb952-62a7-43a5-a179-84be14808242] succeeded in 3.2147647999991023s: None 2024-05-11T01:16:27.939011362Z [2024-05-11 01:16:27,938: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0837d06-9f03-4300-94b5-43964b3ef5df] succeeded in 2.1124247449988616s: None 2024-05-11T01:16:28.806123130Z [2024-05-11 01:16:28,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a0eecbc-525c-4f9d-92b8-cdffc2087407] received 2024-05-11T01:16:28.817341237Z [2024-05-11 01:16:28,817: INFO/ForkPoolWorker-15] [8a0eecbc-525c-4f9d-92b8-cdffc2087407] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'split_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:29.136191163Z [2024-05-11 01:16:29,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:16:30.202269037Z [2024-05-11 01:16:30,201: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:16:30.205589308Z [2024-05-11 01:16:30,205: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:30.222280781Z [2024-05-11 01:16:30,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:16:30.223540891Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:30.223566238Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:30.223586699Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:30.223741310Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:30.223754577Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:16:30.223986308Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:16:30.224009168Z [2024-05-11 01:16:30,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:30.229224628Z [2024-05-11 01:16:30,229: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:30.309980598Z [2024-05-11 01:16:30,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:30.898172122Z [2024-05-11 01:16:30,897: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a0eecbc-525c-4f9d-92b8-cdffc2087407] succeeded in 2.0902411580009357s: None 2024-05-11T01:16:31.134065035Z [2024-05-11 01:16:31,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92e2821e-2a9d-4b80-98a4-317092d9b6e6] received 2024-05-11T01:16:31.141915614Z [2024-05-11 01:16:31,141: INFO/ForkPoolWorker-15] [92e2821e-2a9d-4b80-98a4-317092d9b6e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'collect_metrics', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:16:31.431595829Z [2024-05-11 01:16:31,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:16:32.505000666Z [2024-05-11 01:16:32,504: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:16:32.508004397Z [2024-05-11 01:16:32,507: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:32.527545991Z [2024-05-11 01:16:32,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:16:32.529385675Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:32.529420299Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:32.529472008Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:32.529673283Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:32.529694713Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:16:32.530011271Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:16:32.530043874Z [2024-05-11 01:16:32,529: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:32.536391278Z [2024-05-11 01:16:32,536: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:32.619583252Z [2024-05-11 01:16:32,619: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:33.206812154Z [2024-05-11 01:16:33,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92e2821e-2a9d-4b80-98a4-317092d9b6e6] succeeded in 2.069358453998575s: None 2024-05-11T01:16:33.876807550Z [2024-05-11 01:16:33,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cc0ad81-2f47-4295-be33-359c3d2a4b51] received 2024-05-11T01:16:33.885129590Z [2024-05-11 01:16:33,884: INFO/ForkPoolWorker-15] [0cc0ad81-2f47-4295-be33-359c3d2a4b51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'send_prometheus', 'scheduled__2024-05-11T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:16:34.175220120Z [2024-05-11 01:16:34,172: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:16:35.194313464Z [2024-05-11 01:16:35,193: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:16:35.197513223Z [2024-05-11 01:16:35,197: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:16:35.218003736Z [2024-05-11 01:16:35,217: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:16:35.219348450Z [2024-05-11 01:16:35,219: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:16:35.219487495Z [2024-05-11 01:16:35,219: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:16:35.219585227Z [2024-05-11 01:16:35,219: INFO/ForkPoolWorker-15] Read VIM d4d3f52b-45d2-421d-b46e-ab927a133246 (basic01_747216) 2024-05-11T01:16:35.219786311Z [2024-05-11 01:16:35,219: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd4d3f52b-45d2-421d-b46e-ab927a133246', 'name': 'basic01_747216', 'vim_type': 'openstack'}] 2024-05-11T01:16:35.219957418Z [2024-05-11 01:16:35,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:16:35.220173245Z [2024-05-11 01:16:35,220: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:16:35.220347311Z [2024-05-11 01:16:35,220: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:16:35.225640228Z [2024-05-11 01:16:35,225: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d4d3f52b-45d2-421d-b46e-ab927a133246 2024-05-11T01:16:35.305934422Z [2024-05-11 01:16:35,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:16:35.897051684Z [2024-05-11 01:16:35,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cc0ad81-2f47-4295-be33-359c3d2a4b51] succeeded in 2.0182859739998094s: None 2024-05-11T01:17:00.543157484Z [2024-05-11 01:17:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f1c21b5-a138-4807-bf41-840da5bf088f] received 2024-05-11T01:17:00.546077372Z [2024-05-11 01:17:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb7e95ad-dd40-4c0f-baa5-2fb9b8fdb78c] received 2024-05-11T01:17:00.552165219Z [2024-05-11 01:17:00,551: INFO/ForkPoolWorker-16] [fb7e95ad-dd40-4c0f-baa5-2fb9b8fdb78c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:00.555203193Z [2024-05-11 01:17:00,554: INFO/ForkPoolWorker-15] [4f1c21b5-a138-4807-bf41-840da5bf088f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:00.556843401Z [2024-05-11 01:17:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01cfa2ea-b7d5-4821-88cd-ea06f618dd90] received 2024-05-11T01:17:00.563014902Z [2024-05-11 01:17:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[775518a2-bae7-4c98-9540-46940cacaf79] received 2024-05-11T01:17:00.565929808Z [2024-05-11 01:17:00,565: INFO/ForkPoolWorker-1] [01cfa2ea-b7d5-4821-88cd-ea06f618dd90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:17:00.575294743Z [2024-05-11 01:17:00,574: INFO/ForkPoolWorker-2] [775518a2-bae7-4c98-9540-46940cacaf79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:00.585946953Z [2024-05-11 01:17:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[815deb00-39b1-48d8-af20-e1d4ac8c670d] received 2024-05-11T01:17:00.600240048Z [2024-05-11 01:17:00,599: INFO/ForkPoolWorker-3] [815deb00-39b1-48d8-af20-e1d4ac8c670d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:00.910514556Z [2024-05-11 01:17:00,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:00.923180306Z [2024-05-11 01:17:00,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:17:00.983206999Z [2024-05-11 01:17:00,979: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:01.090106649Z [2024-05-11 01:17:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:01.224070670Z [2024-05-11 01:17:01,220: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:01.359995041Z [2024-05-11 01:17:01,359: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:17:01.369458947Z [2024-05-11 01:17:01,368: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:01.431867824Z [2024-05-11 01:17:01,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:17:01.437975563Z [2024-05-11 01:17:01,437: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:17:01.438071340Z [2024-05-11 01:17:01,437: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:17:01.438076900Z [2024-05-11 01:17:01,437: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:17:01.438282698Z [2024-05-11 01:17:01,438: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:17:01.627288312Z [2024-05-11 01:17:01,626: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:17:02.427734397Z [2024-05-11 01:17:02,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01cfa2ea-b7d5-4821-88cd-ea06f618dd90] succeeded in 1.86847395499899s: None 2024-05-11T01:17:02.498667202Z [2024-05-11 01:17:02,498: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T01:17:02.502320607Z [2024-05-11 01:17:02,501: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:02.527952810Z [2024-05-11 01:17:02,527: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:17:02.530572483Z [2024-05-11 01:17:02,530: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:02.530732949Z [2024-05-11 01:17:02,530: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:02.530953128Z [2024-05-11 01:17:02,530: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:02.531058555Z [2024-05-11 01:17:02,530: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T01:17:02.531466764Z [2024-05-11 01:17:02,531: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:17:02.531797749Z [2024-05-11 01:17:02,531: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:02.616997282Z [2024-05-11 01:17:02,616: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:17:02.690483402Z [2024-05-11 01:17:02,690: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:17:02.694418207Z [2024-05-11 01:17:02,693: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:02.730037884Z [2024-05-11 01:17:02,729: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:17:02.731381167Z [2024-05-11 01:17:02,731: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:02.731619744Z [2024-05-11 01:17:02,731: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:02.731783674Z [2024-05-11 01:17:02,731: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:02.731870392Z [2024-05-11 01:17:02,731: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:17:02.734386947Z [2024-05-11 01:17:02,734: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:17:02.734454109Z [2024-05-11 01:17:02,734: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:02.795376194Z [2024-05-11 01:17:02,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:17:02.799333795Z [2024-05-11 01:17:02,798: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:02.807887327Z [2024-05-11 01:17:02,807: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:17:02.840390970Z [2024-05-11 01:17:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:17:02.841994771Z [2024-05-11 01:17:02,841: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:02.844402345Z [2024-05-11 01:17:02,844: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:02.844622326Z [2024-05-11 01:17:02,844: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:02.844804901Z [2024-05-11 01:17:02,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:17:02.845158238Z [2024-05-11 01:17:02,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:17:02.845361770Z [2024-05-11 01:17:02,845: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:02.852112452Z [2024-05-11 01:17:02,851: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:02.853850430Z [2024-05-11 01:17:02,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:02.854868223Z [2024-05-11 01:17:02,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:17:02.858305495Z [2024-05-11 01:17:02,858: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:02.874732107Z [2024-05-11 01:17:02,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:17:02.879119178Z [2024-05-11 01:17:02,878: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:02.879457102Z [2024-05-11 01:17:02,879: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:02.879698443Z [2024-05-11 01:17:02,879: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:02.879864516Z [2024-05-11 01:17:02,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:17:02.880216844Z [2024-05-11 01:17:02,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:17:02.880489074Z [2024-05-11 01:17:02,880: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:02.884541281Z [2024-05-11 01:17:02,883: ERROR/ForkPoolWorker-15] [4f1c21b5-a138-4807-bf41-840da5bf088f] Failed to execute task Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:17:02.884555097Z Traceback (most recent call last): 2024-05-11T01:17:02.884559477Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:17:02.884563845Z args.func(args) 2024-05-11T01:17:02.884568084Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:17:02.884572445Z return func(*args, **kwargs) 2024-05-11T01:17:02.884575748Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:17:02.884579087Z return f(*args, **kwargs) 2024-05-11T01:17:02.884582960Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:17:02.884586269Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:17:02.884589302Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:17:02.884592337Z raise AirflowException( 2024-05-11T01:17:02.884596336Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:17:02.927246784Z [2024-05-11 01:17:02,926: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f1c21b5-a138-4807-bf41-840da5bf088f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4f1c21b5-a138-4807-bf41-840da5bf088f') 2024-05-11T01:17:02.927288555Z Traceback (most recent call last): 2024-05-11T01:17:02.927293158Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:17:02.927296114Z R = retval = fun(*args, **kwargs) 2024-05-11T01:17:02.927299230Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:17:02.927302135Z return self.run(*args, **kwargs) 2024-05-11T01:17:02.927305916Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:17:02.927309629Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:17:02.927312710Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:17:02.927316532Z raise AirflowException(msg) 2024-05-11T01:17:02.927320843Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4f1c21b5-a138-4807-bf41-840da5bf088f 2024-05-11T01:17:02.975688981Z [2024-05-11 01:17:02,975: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:17:02.979683721Z [2024-05-11 01:17:02,979: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:03.003906767Z [2024-05-11 01:17:03,003: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:17:03.005457510Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:03.005516677Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:03.005707746Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:03.005719241Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:17:03.005986790Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:17:03.006012771Z [2024-05-11 01:17:03,005: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:03.014306706Z [2024-05-11 01:17:03,014: WARNING/ForkPoolWorker-2] Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:03.015202131Z [2024-05-11 01:17:03,014: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:03.018298551Z [2024-05-11 01:17:03,018: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:17:03.021015907Z [2024-05-11 01:17:03,020: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:03.043564526Z [2024-05-11 01:17:03,043: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:17:03.044902586Z [2024-05-11 01:17:03,044: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:03.045067356Z [2024-05-11 01:17:03,044: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:03.045260699Z [2024-05-11 01:17:03,045: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:03.045417502Z [2024-05-11 01:17:03,045: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:17:03.045685203Z [2024-05-11 01:17:03,045: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:17:03.045755515Z [2024-05-11 01:17:03,045: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:03.049639822Z [2024-05-11 01:17:03,049: ERROR/ForkPoolWorker-2] [775518a2-bae7-4c98-9540-46940cacaf79] Failed to execute task Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:17:03.049655381Z Traceback (most recent call last): 2024-05-11T01:17:03.049660150Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:17:03.049664278Z args.func(args) 2024-05-11T01:17:03.049667971Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:17:03.049672206Z return func(*args, **kwargs) 2024-05-11T01:17:03.049685042Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:17:03.049688449Z return f(*args, **kwargs) 2024-05-11T01:17:03.049691638Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:17:03.049695031Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:17:03.049698642Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:17:03.049701574Z raise AirflowException( 2024-05-11T01:17:03.049705530Z airflow.exceptions.AirflowException: Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:17:03.090295254Z [2024-05-11 01:17:03,089: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[775518a2-bae7-4c98-9540-46940cacaf79] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 775518a2-bae7-4c98-9540-46940cacaf79') 2024-05-11T01:17:03.090322789Z Traceback (most recent call last): 2024-05-11T01:17:03.090327214Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:17:03.090330419Z R = retval = fun(*args, **kwargs) 2024-05-11T01:17:03.090333588Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:17:03.090336584Z return self.run(*args, **kwargs) 2024-05-11T01:17:03.090340421Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:17:03.090344895Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:17:03.090347852Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:17:03.090351561Z raise AirflowException(msg) 2024-05-11T01:17:03.090355340Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 775518a2-bae7-4c98-9540-46940cacaf79 2024-05-11T01:17:04.301782207Z [2024-05-11 01:17:04,301: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[815deb00-39b1-48d8-af20-e1d4ac8c670d] succeeded in 3.713421214999471s: None 2024-05-11T01:17:05.369437167Z [2024-05-11 01:17:05,369: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb7e95ad-dd40-4c0f-baa5-2fb9b8fdb78c] succeeded in 4.821666316000119s: None 2024-05-11T01:17:13.548882311Z [2024-05-11 01:17:13,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5004a94-418c-442b-9750-0e7e9d7fefcb] received 2024-05-11T01:17:13.551775725Z [2024-05-11 01:17:13,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2edc8639-8bff-4c1e-a242-f932c50022bc] received 2024-05-11T01:17:13.561919870Z [2024-05-11 01:17:13,561: INFO/ForkPoolWorker-16] [2edc8639-8bff-4c1e-a242-f932c50022bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:17:13.562383581Z [2024-05-11 01:17:13,562: INFO/ForkPoolWorker-15] [f5004a94-418c-442b-9750-0e7e9d7fefcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:17:13.829772169Z [2024-05-11 01:17:13,826: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:13.864385027Z [2024-05-11 01:17:13,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:14.898660802Z [2024-05-11 01:17:14,898: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:17:14.902187390Z [2024-05-11 01:17:14,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:14.912349647Z [2024-05-11 01:17:14,911: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:17:14.915604372Z [2024-05-11 01:17:14,915: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:14.934670286Z [2024-05-11 01:17:14,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:17:14.935825750Z [2024-05-11 01:17:14,935: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:14.936070206Z [2024-05-11 01:17:14,935: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:14.936261918Z [2024-05-11 01:17:14,936: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:14.936408542Z [2024-05-11 01:17:14,936: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:17:14.936666218Z [2024-05-11 01:17:14,936: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:17:14.936746382Z [2024-05-11 01:17:14,936: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:14.943980695Z [2024-05-11 01:17:14,943: WARNING/ForkPoolWorker-16] Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:14.945562664Z [2024-05-11 01:17:14,944: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:17:14.946068661Z [2024-05-11 01:17:14,945: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:17:14.946402896Z [2024-05-11 01:17:14,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:17:14.947272286Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:14.947319080Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:14.947457135Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:14.947508259Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:17:14.947840149Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:17:14.947892355Z [2024-05-11 01:17:14,947: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:14.949309313Z [2024-05-11 01:17:14,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:14.954885242Z [2024-05-11 01:17:14,954: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:14.955628558Z [2024-05-11 01:17:14,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:17:14.956539092Z [2024-05-11 01:17:14,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:17:14.959718531Z [2024-05-11 01:17:14,959: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:17:14.963798458Z [2024-05-11 01:17:14,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:17:14.965265922Z [2024-05-11 01:17:14,965: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:14.965354085Z [2024-05-11 01:17:14,965: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:14.965752278Z [2024-05-11 01:17:14,965: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:14.965844582Z [2024-05-11 01:17:14,965: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:17:14.966136655Z [2024-05-11 01:17:14,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:17:14.966386862Z [2024-05-11 01:17:14,966: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:14.970868283Z [2024-05-11 01:17:14,969: ERROR/ForkPoolWorker-16] [2edc8639-8bff-4c1e-a242-f932c50022bc] Failed to execute task Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:17:14.970876585Z Traceback (most recent call last): 2024-05-11T01:17:14.970880306Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:17:14.970884713Z args.func(args) 2024-05-11T01:17:14.970888371Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:17:14.970895621Z return func(*args, **kwargs) 2024-05-11T01:17:14.970898818Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:17:14.970901726Z return f(*args, **kwargs) 2024-05-11T01:17:14.970904995Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:17:14.970922550Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:17:14.970926405Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:17:14.970929730Z raise AirflowException( 2024-05-11T01:17:14.970933230Z airflow.exceptions.AirflowException: Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:17:14.971336294Z [2024-05-11 01:17:14,971: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:17:14.978510656Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:17:14.978550685Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:17:14.978635847Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:17:14.978652653Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:17:14.978870208Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:17:14.978896637Z [2024-05-11 01:17:14,978: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:17:14.981977719Z [2024-05-11 01:17:14,981: ERROR/ForkPoolWorker-15] [f5004a94-418c-442b-9750-0e7e9d7fefcb] Failed to execute task Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:17:14.981989735Z Traceback (most recent call last): 2024-05-11T01:17:14.981993685Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:17:14.981997193Z args.func(args) 2024-05-11T01:17:14.982000512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:17:14.982004367Z return func(*args, **kwargs) 2024-05-11T01:17:14.982007871Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:17:14.982010824Z return f(*args, **kwargs) 2024-05-11T01:17:14.982027496Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:17:14.982053784Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:17:14.982057204Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:17:14.982060171Z raise AirflowException( 2024-05-11T01:17:14.982063646Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:17:15.010160839Z [2024-05-11 01:17:15,009: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2edc8639-8bff-4c1e-a242-f932c50022bc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2edc8639-8bff-4c1e-a242-f932c50022bc') 2024-05-11T01:17:15.010174108Z Traceback (most recent call last): 2024-05-11T01:17:15.010177880Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:17:15.010181479Z R = retval = fun(*args, **kwargs) 2024-05-11T01:17:15.010184893Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:17:15.010187967Z return self.run(*args, **kwargs) 2024-05-11T01:17:15.010191480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:17:15.010211917Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:17:15.010215304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:17:15.010218942Z raise AirflowException(msg) 2024-05-11T01:17:15.010222406Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2edc8639-8bff-4c1e-a242-f932c50022bc 2024-05-11T01:17:15.013291411Z [2024-05-11 01:17:15,012: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5004a94-418c-442b-9750-0e7e9d7fefcb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5004a94-418c-442b-9750-0e7e9d7fefcb') 2024-05-11T01:17:15.013299129Z Traceback (most recent call last): 2024-05-11T01:17:15.013302841Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:17:15.013305874Z R = retval = fun(*args, **kwargs) 2024-05-11T01:17:15.013308897Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:17:15.013311793Z return self.run(*args, **kwargs) 2024-05-11T01:17:15.013315247Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:17:15.013318652Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:17:15.013321692Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:17:15.013340498Z raise AirflowException(msg) 2024-05-11T01:17:15.013344408Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f5004a94-418c-442b-9750-0e7e9d7fefcb 2024-05-11T01:18:00.732566963Z [2024-05-11 01:18:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b0722e1-389e-4b70-8fa2-7ea1df226711] received 2024-05-11T01:18:00.734990646Z [2024-05-11 01:18:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9425c843-c5fd-4db6-a631-7dd206998dee] received 2024-05-11T01:18:00.738060265Z [2024-05-11 01:18:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[400c9a0b-fc65-4900-9f29-aa09effbdbbe] received 2024-05-11T01:18:00.739557767Z [2024-05-11 01:18:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbdc6a4e-b795-4fb5-a045-1861f315b90a] received 2024-05-11T01:18:00.740819769Z [2024-05-11 01:18:00,740: INFO/ForkPoolWorker-15] [9b0722e1-389e-4b70-8fa2-7ea1df226711] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:18:00.741134633Z [2024-05-11 01:18:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ae0f14c-b369-4188-b135-5ef72e12aa84] received 2024-05-11T01:18:00.743991930Z [2024-05-11 01:18:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f01ea25-7fbb-4759-92b6-5af7e864e9cf] received 2024-05-11T01:18:00.745767917Z [2024-05-11 01:18:00,745: INFO/ForkPoolWorker-1] [400c9a0b-fc65-4900-9f29-aa09effbdbbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:00.746802818Z [2024-05-11 01:18:00,746: INFO/ForkPoolWorker-16] [9425c843-c5fd-4db6-a631-7dd206998dee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:00.752217850Z [2024-05-11 01:18:00,751: INFO/ForkPoolWorker-2] [fbdc6a4e-b795-4fb5-a045-1861f315b90a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:00.752684434Z [2024-05-11 01:18:00,752: INFO/ForkPoolWorker-3] [0ae0f14c-b369-4188-b135-5ef72e12aa84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:18:00.757025154Z [2024-05-11 01:18:00,756: INFO/ForkPoolWorker-4] [1f01ea25-7fbb-4759-92b6-5af7e864e9cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:01.304915148Z [2024-05-11 01:18:01,287: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:01.308310357Z [2024-05-11 01:18:01,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:01.367872443Z [2024-05-11 01:18:01,364: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:01.379497906Z [2024-05-11 01:18:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:18:01.385470993Z [2024-05-11 01:18:01,382: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:18:01.556388218Z [2024-05-11 01:18:01,555: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-11T01:18:01.560231185Z [2024-05-11 01:18:01,559: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:01.567796490Z [2024-05-11 01:18:01,552: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:01.596409884Z [2024-05-11 01:18:01,596: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:18:01.599924866Z [2024-05-11 01:18:01,599: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:18:01.600096151Z [2024-05-11 01:18:01,599: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:18:01.600207825Z [2024-05-11 01:18:01,600: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-11T01:18:01.600471048Z [2024-05-11 01:18:01,600: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:18:01.667951915Z [2024-05-11 01:18:01,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:18:01.776770455Z [2024-05-11 01:18:01,776: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:18:02.426995692Z [2024-05-11 01:18:02,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b0722e1-389e-4b70-8fa2-7ea1df226711] succeeded in 1.6910489790006977s: None 2024-05-11T01:18:02.476191957Z [2024-05-11 01:18:02,475: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0ae0f14c-b369-4188-b135-5ef72e12aa84] succeeded in 1.7330271620012354s: None 2024-05-11T01:18:02.883212761Z [2024-05-11 01:18:02,882: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:18:02.886658515Z [2024-05-11 01:18:02,886: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:02.930459426Z [2024-05-11 01:18:02,929: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:18:02.933599851Z [2024-05-11 01:18:02,933: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:02.933745962Z [2024-05-11 01:18:02,933: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:02.933995559Z [2024-05-11 01:18:02,933: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:02.934314410Z [2024-05-11 01:18:02,934: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:18:02.935101207Z [2024-05-11 01:18:02,934: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:18:02.936279578Z [2024-05-11 01:18:02,936: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:02.962224391Z [2024-05-11 01:18:02,961: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:18:02.965558597Z [2024-05-11 01:18:02,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:03.012927727Z [2024-05-11 01:18:03,012: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:18:03.015465445Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:03.015534425Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:03.015651783Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:03.015750822Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:18:03.015986277Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:18:03.016020041Z [2024-05-11 01:18:03,015: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:03.040462136Z [2024-05-11 01:18:03,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:18:03.044006339Z [2024-05-11 01:18:03,043: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:03.057665475Z [2024-05-11 01:18:03,057: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:18:03.070424021Z [2024-05-11 01:18:03,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:18:03.074954187Z [2024-05-11 01:18:03,074: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:03.075514058Z [2024-05-11 01:18:03,075: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:03.075778516Z [2024-05-11 01:18:03,075: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:03.075917776Z [2024-05-11 01:18:03,075: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:18:03.076224143Z [2024-05-11 01:18:03,076: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:18:03.076408326Z [2024-05-11 01:18:03,076: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:03.082418455Z [2024-05-11 01:18:03,082: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:03.083287904Z [2024-05-11 01:18:03,082: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:03.084113428Z [2024-05-11 01:18:03,083: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:18:03.086948009Z [2024-05-11 01:18:03,086: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:03.104089699Z [2024-05-11 01:18:03,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:18:03.115184397Z [2024-05-11 01:18:03,114: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:18:03.116520327Z [2024-05-11 01:18:03,116: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:03.116711719Z [2024-05-11 01:18:03,116: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:03.116915820Z [2024-05-11 01:18:03,116: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:03.117031189Z [2024-05-11 01:18:03,116: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:18:03.117315959Z [2024-05-11 01:18:03,117: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:18:03.117544103Z [2024-05-11 01:18:03,117: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:03.121086772Z [2024-05-11 01:18:03,120: ERROR/ForkPoolWorker-16] [9425c843-c5fd-4db6-a631-7dd206998dee] Failed to execute task Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:18:03.121109164Z Traceback (most recent call last): 2024-05-11T01:18:03.121114617Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:18:03.121119308Z args.func(args) 2024-05-11T01:18:03.121124130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:18:03.121129009Z return func(*args, **kwargs) 2024-05-11T01:18:03.121133005Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:18:03.121136976Z return f(*args, **kwargs) 2024-05-11T01:18:03.121141021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:18:03.121161482Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:18:03.121166308Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:18:03.121170307Z raise AirflowException( 2024-05-11T01:18:03.121180488Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:18:03.155305309Z [2024-05-11 01:18:03,154: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9425c843-c5fd-4db6-a631-7dd206998dee] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9425c843-c5fd-4db6-a631-7dd206998dee') 2024-05-11T01:18:03.155328702Z Traceback (most recent call last): 2024-05-11T01:18:03.155333919Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:18:03.155337924Z R = retval = fun(*args, **kwargs) 2024-05-11T01:18:03.155342159Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:18:03.155346169Z return self.run(*args, **kwargs) 2024-05-11T01:18:03.155365334Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:18:03.155370245Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:18:03.155374641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:18:03.155379578Z raise AirflowException(msg) 2024-05-11T01:18:03.155384178Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9425c843-c5fd-4db6-a631-7dd206998dee 2024-05-11T01:18:03.244137722Z [2024-05-11 01:18:03,243: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-11T01:18:03.247388799Z [2024-05-11 01:18:03,246: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:03.268512353Z [2024-05-11 01:18:03,268: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-11T01:18:03.270813344Z [2024-05-11 01:18:03,270: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:03.270845332Z [2024-05-11 01:18:03,270: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:03.271118270Z [2024-05-11 01:18:03,270: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:03.271149500Z [2024-05-11 01:18:03,270: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-11T01:18:03.271677311Z [2024-05-11 01:18:03,271: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:18:03.271740173Z [2024-05-11 01:18:03,271: INFO/ForkPoolWorker-4] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:03.277664815Z [2024-05-11 01:18:03,277: WARNING/ForkPoolWorker-4] Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:03.278480667Z [2024-05-11 01:18:03,277: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:03.279276653Z [2024-05-11 01:18:03,279: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-11T01:18:03.281818708Z [2024-05-11 01:18:03,281: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:03.307348789Z [2024-05-11 01:18:03,307: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-11T01:18:03.308858688Z [2024-05-11 01:18:03,308: INFO/ForkPoolWorker-4] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:03.308876068Z [2024-05-11 01:18:03,308: INFO/ForkPoolWorker-4] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:03.308940513Z [2024-05-11 01:18:03,308: INFO/ForkPoolWorker-4] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:03.308960751Z [2024-05-11 01:18:03,308: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-11T01:18:03.309198719Z [2024-05-11 01:18:03,309: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:18:03.309207342Z [2024-05-11 01:18:03,309: INFO/ForkPoolWorker-4] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:03.312439570Z [2024-05-11 01:18:03,311: ERROR/ForkPoolWorker-4] [1f01ea25-7fbb-4759-92b6-5af7e864e9cf] Failed to execute task Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:18:03.312460942Z Traceback (most recent call last): 2024-05-11T01:18:03.312467698Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:18:03.312474016Z args.func(args) 2024-05-11T01:18:03.312479873Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:18:03.312485518Z return func(*args, **kwargs) 2024-05-11T01:18:03.312490660Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:18:03.312495834Z return f(*args, **kwargs) 2024-05-11T01:18:03.312501130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:18:03.312506280Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:18:03.312511375Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:18:03.312516575Z raise AirflowException( 2024-05-11T01:18:03.312522336Z airflow.exceptions.AirflowException: Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:18:03.342080903Z [2024-05-11 01:18:03,341: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[1f01ea25-7fbb-4759-92b6-5af7e864e9cf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f01ea25-7fbb-4759-92b6-5af7e864e9cf') 2024-05-11T01:18:03.342109377Z Traceback (most recent call last): 2024-05-11T01:18:03.342117119Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:18:03.342123205Z R = retval = fun(*args, **kwargs) 2024-05-11T01:18:03.342129128Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:18:03.342135712Z return self.run(*args, **kwargs) 2024-05-11T01:18:03.342142641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:18:03.342149116Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:18:03.342154862Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:18:03.342161347Z raise AirflowException(msg) 2024-05-11T01:18:03.342167816Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f01ea25-7fbb-4759-92b6-5af7e864e9cf 2024-05-11T01:18:05.295963776Z [2024-05-11 01:18:05,294: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[400c9a0b-fc65-4900-9f29-aa09effbdbbe] succeeded in 4.554761204000897s: None 2024-05-11T01:18:06.041834746Z [2024-05-11 01:18:06,033: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbdc6a4e-b795-4fb5-a045-1861f315b90a] succeeded in 5.291698970999278s: None 2024-05-11T01:18:14.716039481Z [2024-05-11 01:18:14,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[929845b1-34e1-4324-abac-f76e1b8a3974] received 2024-05-11T01:18:14.722113392Z [2024-05-11 01:18:14,721: INFO/ForkPoolWorker-15] [929845b1-34e1-4324-abac-f76e1b8a3974] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:18:14.724203216Z [2024-05-11 01:18:14,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[500bbe38-a84d-4eeb-a10d-241e3fd60aed] received 2024-05-11T01:18:14.734849516Z [2024-05-11 01:18:14,734: INFO/ForkPoolWorker-16] [500bbe38-a84d-4eeb-a10d-241e3fd60aed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:18:14.970931538Z [2024-05-11 01:18:14,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:15.003454241Z [2024-05-11 01:18:15,000: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:15.965367341Z [2024-05-11 01:18:15,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:18:15.968636039Z [2024-05-11 01:18:15,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:15.990308946Z [2024-05-11 01:18:15,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:18:15.991627777Z [2024-05-11 01:18:15,991: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:15.991830162Z [2024-05-11 01:18:15,991: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:15.992091414Z [2024-05-11 01:18:15,991: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:15.992426244Z [2024-05-11 01:18:15,992: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:18:15.992807460Z [2024-05-11 01:18:15,992: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:18:15.993014509Z [2024-05-11 01:18:15,992: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:15.999487810Z [2024-05-11 01:18:15,999: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:16.000211994Z [2024-05-11 01:18:15,999: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:18:16.001049339Z [2024-05-11 01:18:16,000: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:18:16.003981122Z [2024-05-11 01:18:16,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:16.015504963Z [2024-05-11 01:18:16,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:18:16.016659270Z [2024-05-11 01:18:16,016: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:16.016871517Z [2024-05-11 01:18:16,016: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:16.017083890Z [2024-05-11 01:18:16,016: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:16.017265062Z [2024-05-11 01:18:16,017: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:18:16.017541696Z [2024-05-11 01:18:16,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:18:16.017742752Z [2024-05-11 01:18:16,017: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:16.021121727Z [2024-05-11 01:18:16,020: ERROR/ForkPoolWorker-15] [929845b1-34e1-4324-abac-f76e1b8a3974] Failed to execute task Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:18:16.021144830Z Traceback (most recent call last): 2024-05-11T01:18:16.021152364Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:18:16.021160029Z args.func(args) 2024-05-11T01:18:16.021167198Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:18:16.021175738Z return func(*args, **kwargs) 2024-05-11T01:18:16.021184394Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:18:16.021195731Z return f(*args, **kwargs) 2024-05-11T01:18:16.021205406Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:18:16.021214841Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:18:16.021224876Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:18:16.021234603Z raise AirflowException( 2024-05-11T01:18:16.021246030Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:18:16.054651506Z [2024-05-11 01:18:16,054: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:18:16.057715818Z [2024-05-11 01:18:16,057: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:16.058219125Z [2024-05-11 01:18:16,057: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[929845b1-34e1-4324-abac-f76e1b8a3974] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 929845b1-34e1-4324-abac-f76e1b8a3974') 2024-05-11T01:18:16.058230968Z Traceback (most recent call last): 2024-05-11T01:18:16.058236160Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:18:16.058240075Z R = retval = fun(*args, **kwargs) 2024-05-11T01:18:16.058243878Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:18:16.058247624Z return self.run(*args, **kwargs) 2024-05-11T01:18:16.058266001Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:18:16.058270695Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:18:16.058274402Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:18:16.058278716Z raise AirflowException(msg) 2024-05-11T01:18:16.058282931Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 929845b1-34e1-4324-abac-f76e1b8a3974 2024-05-11T01:18:16.077413752Z [2024-05-11 01:18:16,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:18:16.078573772Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:16.078596087Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:16.078757877Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:16.078767820Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:18:16.079123637Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:18:16.079136636Z [2024-05-11 01:18:16,078: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:16.086147796Z [2024-05-11 01:18:16,085: WARNING/ForkPoolWorker-16] Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:16.086968152Z [2024-05-11 01:18:16,086: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:18:16.087847678Z [2024-05-11 01:18:16,087: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:18:16.090482250Z [2024-05-11 01:18:16,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:18:16.112198223Z [2024-05-11 01:18:16,111: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:18:16.113827605Z [2024-05-11 01:18:16,113: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:18:16.113846310Z [2024-05-11 01:18:16,113: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:18:16.113907029Z [2024-05-11 01:18:16,113: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:18:16.113936411Z [2024-05-11 01:18:16,113: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:18:16.114232097Z [2024-05-11 01:18:16,114: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:18:16.114742507Z [2024-05-11 01:18:16,114: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:18:16.120672328Z [2024-05-11 01:18:16,120: ERROR/ForkPoolWorker-16] [500bbe38-a84d-4eeb-a10d-241e3fd60aed] Failed to execute task Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse.. 2024-05-11T01:18:16.120742940Z Traceback (most recent call last): 2024-05-11T01:18:16.120752954Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-11T01:18:16.120761820Z args.func(args) 2024-05-11T01:18:16.120770136Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-11T01:18:16.120778226Z return func(*args, **kwargs) 2024-05-11T01:18:16.120785802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-11T01:18:16.120793220Z return f(*args, **kwargs) 2024-05-11T01:18:16.120800613Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-11T01:18:16.120808213Z dag = get_dag(args.subdir, args.dag_id) 2024-05-11T01:18:16.120815549Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-11T01:18:16.120822986Z raise AirflowException( 2024-05-11T01:18:16.120852865Z airflow.exceptions.AirflowException: Dag 'vim_status_d4d3f52b-45d2-421d-b46e-ab927a133246' could not be found; either it does not exist or it failed to parse. 2024-05-11T01:18:16.160735001Z [2024-05-11 01:18:16,160: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[500bbe38-a84d-4eeb-a10d-241e3fd60aed] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 500bbe38-a84d-4eeb-a10d-241e3fd60aed') 2024-05-11T01:18:16.160763771Z Traceback (most recent call last): 2024-05-11T01:18:16.160768606Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-11T01:18:16.160771904Z R = retval = fun(*args, **kwargs) 2024-05-11T01:18:16.160775053Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-11T01:18:16.160778371Z return self.run(*args, **kwargs) 2024-05-11T01:18:16.160782116Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-11T01:18:16.160785949Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-11T01:18:16.160789042Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-11T01:18:16.160793012Z raise AirflowException(msg) 2024-05-11T01:18:16.160796692Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 500bbe38-a84d-4eeb-a10d-241e3fd60aed 2024-05-11T01:18:39.094717493Z [2024-05-11 01:18:39,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9e27990-3fda-4b35-935d-f33443a2137f] received 2024-05-11T01:18:39.105610569Z [2024-05-11 01:18:39,105: INFO/ForkPoolWorker-15] [e9e27990-3fda-4b35-935d-f33443a2137f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240511011837_438975', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-11T01:18:39.370421760Z [2024-05-11 01:18:39,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-11T01:18:39.685441807Z [2024-05-11 01:18:39,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:18:40.321375857Z [2024-05-11 01:18:40,320: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9e27990-3fda-4b35-935d-f33443a2137f] succeeded in 1.2222458760006703s: None 2024-05-11T01:19:00.412040724Z [2024-05-11 01:19:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[163d90ea-235c-4ce2-92b3-85e49edc811e] received 2024-05-11T01:19:00.421457494Z [2024-05-11 01:19:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[192415e5-c1df-4e7d-9b64-19a59135c726] received 2024-05-11T01:19:00.428486262Z [2024-05-11 01:19:00,426: INFO/ForkPoolWorker-16] [192415e5-c1df-4e7d-9b64-19a59135c726] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:19:00.433735861Z [2024-05-11 01:19:00,430: INFO/ForkPoolWorker-15] [163d90ea-235c-4ce2-92b3-85e49edc811e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:19:00.435848663Z [2024-05-11 01:19:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36900695-4f07-4ef0-8fac-79891495a441] received 2024-05-11T01:19:00.481971898Z [2024-05-11 01:19:00,480: INFO/ForkPoolWorker-1] [36900695-4f07-4ef0-8fac-79891495a441] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:19:00.883630576Z [2024-05-11 01:19:00,880: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:19:00.905390854Z [2024-05-11 01:19:00,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:19:00.910340426Z [2024-05-11 01:19:00,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:19:01.073151480Z [2024-05-11 01:19:01,072: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:19:01.077147713Z [2024-05-11 01:19:01,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:19:01.191056974Z [2024-05-11 01:19:01,190: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:19:01.194731697Z [2024-05-11 01:19:01,194: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:19:01.195173125Z [2024-05-11 01:19:01,194: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:19:01.195411526Z [2024-05-11 01:19:01,195: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:19:01.195730685Z [2024-05-11 01:19:01,195: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:19:01.295581298Z [2024-05-11 01:19:01,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:19:01.877213506Z [2024-05-11 01:19:01,876: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[192415e5-c1df-4e7d-9b64-19a59135c726] succeeded in 1.457285853999565s: None 2024-05-11T01:19:02.138933210Z [2024-05-11 01:19:02,138: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:19:02.142088109Z [2024-05-11 01:19:02,141: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:19:02.143853250Z [2024-05-11 01:19:02,143: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:19:02.147134241Z [2024-05-11 01:19:02,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:19:02.169365522Z [2024-05-11 01:19:02,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:19:02.171254470Z [2024-05-11 01:19:02,170: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:19:02.171273226Z [2024-05-11 01:19:02,170: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:19:02.171314336Z [2024-05-11 01:19:02,171: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:19:02.171349563Z [2024-05-11 01:19:02,171: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:19:02.171380091Z [2024-05-11 01:19:02,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:19:02.171683021Z [2024-05-11 01:19:02,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:19:02.171714878Z [2024-05-11 01:19:02,171: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:19:02.174940510Z [2024-05-11 01:19:02,174: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:19:02.174959000Z [2024-05-11 01:19:02,174: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:19:02.175110778Z [2024-05-11 01:19:02,174: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:19:02.175166229Z [2024-05-11 01:19:02,175: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:19:02.175437909Z [2024-05-11 01:19:02,175: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:19:02.175474003Z [2024-05-11 01:19:02,175: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:19:02.283219877Z [2024-05-11 01:19:02,282: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:19:02.288303411Z [2024-05-11 01:19:02,288: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:19:03.983939988Z [2024-05-11 01:19:03,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36900695-4f07-4ef0-8fac-79891495a441] succeeded in 3.545149018000302s: None 2024-05-11T01:19:04.337444780Z [2024-05-11 01:19:04,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[163d90ea-235c-4ce2-92b3-85e49edc811e] succeeded in 3.923630528999638s: None 2024-05-11T01:20:00.903217953Z [2024-05-11 01:20:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddcd7745-2f4f-4486-8990-b576ba8bc3bb] received 2024-05-11T01:20:00.911276012Z [2024-05-11 01:20:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[573dbd8c-0e18-451a-9d86-264e80950eec] received 2024-05-11T01:20:00.914667576Z [2024-05-11 01:20:00,914: INFO/ForkPoolWorker-15] [ddcd7745-2f4f-4486-8990-b576ba8bc3bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:00.921779125Z [2024-05-11 01:20:00,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dec0f5b-1534-4f8f-834c-6150988b5ba3] received 2024-05-11T01:20:00.922540190Z [2024-05-11 01:20:00,922: INFO/ForkPoolWorker-16] [573dbd8c-0e18-451a-9d86-264e80950eec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:20:00.933483923Z [2024-05-11 01:20:00,932: INFO/ForkPoolWorker-1] [5dec0f5b-1534-4f8f-834c-6150988b5ba3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:20:00.938237575Z [2024-05-11 01:20:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f6f337e-a9e4-442d-8eba-18fbedf9afaa] received 2024-05-11T01:20:00.941432697Z [2024-05-11 01:20:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89809213-76f2-4ea4-a476-9bb22e74721f] received 2024-05-11T01:20:00.948410704Z [2024-05-11 01:20:00,947: INFO/ForkPoolWorker-2] [6f6f337e-a9e4-442d-8eba-18fbedf9afaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:20:00.960096404Z [2024-05-11 01:20:00,959: INFO/ForkPoolWorker-3] [89809213-76f2-4ea4-a476-9bb22e74721f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:20:01.504875906Z [2024-05-11 01:20:01,501: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:20:01.602582321Z [2024-05-11 01:20:01,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:20:01.603492074Z [2024-05-11 01:20:01,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:20:01.697273493Z [2024-05-11 01:20:01,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:20:01.931994949Z [2024-05-11 01:20:01,929: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:01.977256488Z [2024-05-11 01:20:01,976: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-11T01:20:01.986040217Z [2024-05-11 01:20:01,985: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:02.068777405Z [2024-05-11 01:20:02,068: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:20:02.078204063Z [2024-05-11 01:20:02,077: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:20:02.078480888Z [2024-05-11 01:20:02,078: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:20:02.078645230Z [2024-05-11 01:20:02,078: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-11T01:20:02.079069563Z [2024-05-11 01:20:02,078: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:20:02.096659389Z [2024-05-11 01:20:02,056: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:20:02.328624039Z [2024-05-11 01:20:02,328: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:02.772363968Z [2024-05-11 01:20:02,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[573dbd8c-0e18-451a-9d86-264e80950eec] succeeded in 1.8599763390011503s: None 2024-05-11T01:20:03.054059204Z [2024-05-11 01:20:03,053: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[89809213-76f2-4ea4-a476-9bb22e74721f] succeeded in 2.1102772079993883s: None 2024-05-11T01:20:03.268086266Z [2024-05-11 01:20:03,267: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:20:03.271443512Z [2024-05-11 01:20:03,271: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:03.301298379Z [2024-05-11 01:20:03,300: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:20:03.303834442Z [2024-05-11 01:20:03,303: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:03.304362318Z [2024-05-11 01:20:03,304: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:03.304953732Z [2024-05-11 01:20:03,304: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:03.305298245Z [2024-05-11 01:20:03,305: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:20:03.306053709Z [2024-05-11 01:20:03,305: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:20:03.306336707Z [2024-05-11 01:20:03,306: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:03.377618576Z [2024-05-11 01:20:03,377: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:20:03.380832288Z [2024-05-11 01:20:03,380: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:03.403581488Z [2024-05-11 01:20:03,403: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:03.404027940Z [2024-05-11 01:20:03,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:20:03.405255953Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:03.405321525Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:03.405461845Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:03.405533148Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:20:03.405765635Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:20:03.405830028Z [2024-05-11 01:20:03,405: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:03.506100906Z [2024-05-11 01:20:03,502: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:03.591476813Z [2024-05-11 01:20:03,591: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:20:03.594520156Z [2024-05-11 01:20:03,594: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:03.613213451Z [2024-05-11 01:20:03,613: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:20:03.614349759Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:03.614390035Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:03.614594134Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:03.614607434Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:20:03.614817888Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:20:03.614829981Z [2024-05-11 01:20:03,614: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:03.690827632Z [2024-05-11 01:20:03,690: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:04.082013255Z [2024-05-11 01:20:04,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddcd7745-2f4f-4486-8990-b576ba8bc3bb] succeeded in 3.17482199099868s: None 2024-05-11T01:20:04.154295548Z [2024-05-11 01:20:04,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36fd3052-7e0e-40db-9516-b025419066a4] received 2024-05-11T01:20:04.168015897Z [2024-05-11 01:20:04,167: INFO/ForkPoolWorker-15] [36fd3052-7e0e-40db-9516-b025419066a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:04.434298716Z [2024-05-11 01:20:04,431: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:20:05.073922583Z [2024-05-11 01:20:05,073: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6f6f337e-a9e4-442d-8eba-18fbedf9afaa] succeeded in 4.133115467999232s: None 2024-05-11T01:20:05.505029728Z [2024-05-11 01:20:05,504: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5dec0f5b-1534-4f8f-834c-6150988b5ba3] succeeded in 4.577396750000844s: None 2024-05-11T01:20:05.690980008Z [2024-05-11 01:20:05,690: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:20:05.694438548Z [2024-05-11 01:20:05,694: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:05.723316549Z [2024-05-11 01:20:05,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:20:05.727202337Z [2024-05-11 01:20:05,726: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:05.727385523Z [2024-05-11 01:20:05,727: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:05.727625785Z [2024-05-11 01:20:05,727: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:05.727777229Z [2024-05-11 01:20:05,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:20:05.728153805Z [2024-05-11 01:20:05,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:20:05.728315354Z [2024-05-11 01:20:05,728: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:05.814116747Z [2024-05-11 01:20:05,813: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:06.578815111Z [2024-05-11 01:20:06,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36fd3052-7e0e-40db-9516-b025419066a4] succeeded in 2.4200033849992906s: None 2024-05-11T01:20:07.569252657Z [2024-05-11 01:20:07,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8c3aab2-ad92-44bc-8300-dec35dbd11cf] received 2024-05-11T01:20:07.577751901Z [2024-05-11 01:20:07,577: INFO/ForkPoolWorker-15] [b8c3aab2-ad92-44bc-8300-dec35dbd11cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:20:07.904378926Z [2024-05-11 01:20:07,901: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:20:08.945232074Z [2024-05-11 01:20:08,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:20:08.948638515Z [2024-05-11 01:20:08,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:08.968407695Z [2024-05-11 01:20:08,968: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:20:08.969713960Z [2024-05-11 01:20:08,969: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:08.969954570Z [2024-05-11 01:20:08,969: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:08.970164680Z [2024-05-11 01:20:08,969: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:08.970321419Z [2024-05-11 01:20:08,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:20:08.970647850Z [2024-05-11 01:20:08,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:20:08.970835287Z [2024-05-11 01:20:08,970: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:09.054769402Z [2024-05-11 01:20:09,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:09.529811036Z [2024-05-11 01:20:09,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[758397ef-226d-4285-8374-1b897f89e073] received 2024-05-11T01:20:09.545713482Z [2024-05-11 01:20:09,545: INFO/ForkPoolWorker-16] [758397ef-226d-4285-8374-1b897f89e073] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:20:09.608430216Z [2024-05-11 01:20:09,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8c3aab2-ad92-44bc-8300-dec35dbd11cf] succeeded in 2.0371308620015043s: None 2024-05-11T01:20:09.861029146Z [2024-05-11 01:20:09,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:20:10.997080474Z [2024-05-11 01:20:10,996: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:20:11.000130505Z [2024-05-11 01:20:10,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:20:11.045648424Z [2024-05-11 01:20:11,044: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:20:11.047248266Z [2024-05-11 01:20:11,045: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:20:11.047262754Z [2024-05-11 01:20:11,045: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:20:11.047270591Z [2024-05-11 01:20:11,046: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:20:11.047274976Z [2024-05-11 01:20:11,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:20:11.047277979Z [2024-05-11 01:20:11,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:20:11.047280983Z [2024-05-11 01:20:11,046: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:20:11.161378278Z [2024-05-11 01:20:11,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:20:11.766826742Z [2024-05-11 01:20:11,766: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[758397ef-226d-4285-8374-1b897f89e073] succeeded in 2.23469918200135s: None 2024-05-11T01:21:00.539179850Z [2024-05-11 01:21:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3375184a-77fc-4841-b72b-0db8ea6466d1] received 2024-05-11T01:21:00.547000790Z [2024-05-11 01:21:00,546: INFO/ForkPoolWorker-15] [3375184a-77fc-4841-b72b-0db8ea6466d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:21:00.561068179Z [2024-05-11 01:21:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43b03ce9-3add-4010-a0c2-4cfe6f1037cc] received 2024-05-11T01:21:00.563076145Z [2024-05-11 01:21:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d61917-9754-4ddb-99e1-af888f051cd2] received 2024-05-11T01:21:00.570558035Z [2024-05-11 01:21:00,570: INFO/ForkPoolWorker-1] [39d61917-9754-4ddb-99e1-af888f051cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:21:00.575596888Z [2024-05-11 01:21:00,575: INFO/ForkPoolWorker-16] [43b03ce9-3add-4010-a0c2-4cfe6f1037cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:21:00.820616903Z [2024-05-11 01:21:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:21:00.900106054Z [2024-05-11 01:21:00,896: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:21:00.914012050Z [2024-05-11 01:21:00,909: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:21:01.153955795Z [2024-05-11 01:21:01,143: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:21:01.153989011Z [2024-05-11 01:21:01,148: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:21:01.188407301Z [2024-05-11 01:21:01,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:21:01.190727050Z [2024-05-11 01:21:01,190: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:21:01.191019307Z [2024-05-11 01:21:01,190: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:21:01.191083950Z [2024-05-11 01:21:01,190: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:21:01.191562337Z [2024-05-11 01:21:01,191: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:21:01.283467802Z [2024-05-11 01:21:01,283: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:21:01.814156437Z [2024-05-11 01:21:01,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43b03ce9-3add-4010-a0c2-4cfe6f1037cc] succeeded in 1.2503261140009272s: None 2024-05-11T01:21:02.101532291Z [2024-05-11 01:21:02,101: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:21:02.104916367Z [2024-05-11 01:21:02,104: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:21:02.110255298Z [2024-05-11 01:21:02,109: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:21:02.113372802Z [2024-05-11 01:21:02,112: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:21:02.125287021Z [2024-05-11 01:21:02,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:21:02.127457555Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:21:02.127495918Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:21:02.127559604Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:21:02.127641916Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:21:02.127926572Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:21:02.127993314Z [2024-05-11 01:21:02,127: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:21:02.142027172Z [2024-05-11 01:21:02,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:21:02.152046109Z [2024-05-11 01:21:02,151: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:21:02.152106377Z [2024-05-11 01:21:02,151: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:21:02.152129011Z [2024-05-11 01:21:02,151: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:21:02.152137108Z [2024-05-11 01:21:02,152: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:21:02.152336234Z [2024-05-11 01:21:02,152: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:21:02.152376216Z [2024-05-11 01:21:02,152: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:21:02.215044462Z [2024-05-11 01:21:02,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:21:02.222155479Z [2024-05-11 01:21:02,221: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:21:03.767084815Z [2024-05-11 01:21:03,766: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39d61917-9754-4ddb-99e1-af888f051cd2] succeeded in 3.2006384129999788s: None 2024-05-11T01:21:04.021130564Z [2024-05-11 01:21:04,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3375184a-77fc-4841-b72b-0db8ea6466d1] succeeded in 3.4803233290003845s: None 2024-05-11T01:22:00.501258275Z [2024-05-11 01:22:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[522aeedb-07dc-4e99-8b73-d6c4452dee30] received 2024-05-11T01:22:00.510121649Z [2024-05-11 01:22:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e61e7dc-118f-45d0-965d-13fe593aaa80] received 2024-05-11T01:22:00.510594759Z [2024-05-11 01:22:00,510: INFO/ForkPoolWorker-15] [522aeedb-07dc-4e99-8b73-d6c4452dee30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:22:00.518741648Z [2024-05-11 01:22:00,518: INFO/ForkPoolWorker-16] [3e61e7dc-118f-45d0-965d-13fe593aaa80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:22:00.522828889Z [2024-05-11 01:22:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9b795af-4ebc-4e48-a0f9-d9282fa04b10] received 2024-05-11T01:22:00.525578074Z [2024-05-11 01:22:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ca0f3b6-1cc1-49e5-8f17-a118805b2cc9] received 2024-05-11T01:22:00.531028638Z [2024-05-11 01:22:00,530: INFO/ForkPoolWorker-1] [c9b795af-4ebc-4e48-a0f9-d9282fa04b10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:22:00.534905306Z [2024-05-11 01:22:00,534: INFO/ForkPoolWorker-2] [7ca0f3b6-1cc1-49e5-8f17-a118805b2cc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:22:00.842918690Z [2024-05-11 01:22:00,840: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:22:00.861380762Z [2024-05-11 01:22:00,857: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:22:00.862231195Z [2024-05-11 01:22:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:22:00.924511056Z [2024-05-11 01:22:00,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:22:01.050737774Z [2024-05-11 01:22:01,050: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:22:01.055281708Z [2024-05-11 01:22:01,054: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:22:01.188045670Z [2024-05-11 01:22:01,187: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:22:01.191169343Z [2024-05-11 01:22:01,190: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:22:01.191230714Z [2024-05-11 01:22:01,191: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:22:01.191295966Z [2024-05-11 01:22:01,191: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:22:01.191551531Z [2024-05-11 01:22:01,191: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:22:01.325675671Z [2024-05-11 01:22:01,325: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:22:01.337024962Z [2024-05-11 01:22:01,336: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:22:01.961012982Z [2024-05-11 01:22:01,960: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ca0f3b6-1cc1-49e5-8f17-a118805b2cc9] succeeded in 1.4337707440008671s: None 2024-05-11T01:22:01.966940193Z [2024-05-11 01:22:01,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[522aeedb-07dc-4e99-8b73-d6c4452dee30] succeeded in 1.4633323449997988s: None 2024-05-11T01:22:02.217991334Z [2024-05-11 01:22:02,217: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:22:02.221086108Z [2024-05-11 01:22:02,220: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:22:02.248747920Z [2024-05-11 01:22:02,248: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:22:02.250605058Z [2024-05-11 01:22:02,250: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:22:02.250691488Z [2024-05-11 01:22:02,250: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:22:02.250906340Z [2024-05-11 01:22:02,250: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:22:02.250996000Z [2024-05-11 01:22:02,250: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:22:02.251334141Z [2024-05-11 01:22:02,251: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:22:02.251394102Z [2024-05-11 01:22:02,251: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:22:02.293723222Z [2024-05-11 01:22:02,293: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:22:02.296851742Z [2024-05-11 01:22:02,296: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:22:02.329062225Z [2024-05-11 01:22:02,328: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:22:02.332541130Z [2024-05-11 01:22:02,332: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:22:02.332579119Z [2024-05-11 01:22:02,332: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:22:02.334315980Z [2024-05-11 01:22:02,332: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:22:02.334950614Z [2024-05-11 01:22:02,334: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:22:02.336427425Z [2024-05-11 01:22:02,336: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:22:02.336464863Z [2024-05-11 01:22:02,336: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:22:02.369991988Z [2024-05-11 01:22:02,369: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:22:02.442143843Z [2024-05-11 01:22:02,441: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:22:04.025641945Z [2024-05-11 01:22:04,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c9b795af-4ebc-4e48-a0f9-d9282fa04b10] succeeded in 3.500811910998891s: None 2024-05-11T01:22:04.575666062Z [2024-05-11 01:22:04,574: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e61e7dc-118f-45d0-965d-13fe593aaa80] succeeded in 4.061316419998548s: None 2024-05-11T01:23:00.364498790Z [2024-05-11 01:23:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a8554a3-90a6-4c77-9322-eb1a10c7c8c1] received 2024-05-11T01:23:00.370015001Z [2024-05-11 01:23:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c2e857f-eeaa-4a8d-a121-10e0bea1e870] received 2024-05-11T01:23:00.376705645Z [2024-05-11 01:23:00,376: INFO/ForkPoolWorker-15] [5a8554a3-90a6-4c77-9322-eb1a10c7c8c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:23:00.381363662Z [2024-05-11 01:23:00,380: INFO/ForkPoolWorker-16] [7c2e857f-eeaa-4a8d-a121-10e0bea1e870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:23:00.385802969Z [2024-05-11 01:23:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81c2597f-daa1-4c4f-8c06-1f3452b84c5d] received 2024-05-11T01:23:00.411064785Z [2024-05-11 01:23:00,410: INFO/ForkPoolWorker-1] [81c2597f-daa1-4c4f-8c06-1f3452b84c5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:23:00.691823754Z [2024-05-11 01:23:00,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:23:00.733527516Z [2024-05-11 01:23:00,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:23:00.756236915Z [2024-05-11 01:23:00,752: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:23:00.901441291Z [2024-05-11 01:23:00,901: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:23:00.905439275Z [2024-05-11 01:23:00,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:23:00.933341289Z [2024-05-11 01:23:00,933: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:23:00.934784807Z [2024-05-11 01:23:00,934: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:23:00.935042357Z [2024-05-11 01:23:00,934: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:23:00.935230767Z [2024-05-11 01:23:00,935: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:23:00.935672506Z [2024-05-11 01:23:00,935: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:23:01.034704350Z [2024-05-11 01:23:01,034: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:23:01.640042542Z [2024-05-11 01:23:01,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81c2597f-daa1-4c4f-8c06-1f3452b84c5d] succeeded in 1.252526749000026s: None 2024-05-11T01:23:01.987554545Z [2024-05-11 01:23:01,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:23:01.990941208Z [2024-05-11 01:23:01,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:23:02.019991873Z [2024-05-11 01:23:02,019: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:23:02.020311669Z [2024-05-11 01:23:02,020: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:23:02.021798892Z [2024-05-11 01:23:02,021: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:23:02.021814597Z [2024-05-11 01:23:02,021: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:23:02.022000414Z [2024-05-11 01:23:02,021: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:23:02.022010681Z [2024-05-11 01:23:02,021: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:23:02.022280686Z [2024-05-11 01:23:02,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:23:02.022304014Z [2024-05-11 01:23:02,022: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:23:02.023200401Z [2024-05-11 01:23:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:23:02.048171955Z [2024-05-11 01:23:02,047: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:23:02.050823067Z [2024-05-11 01:23:02,050: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:23:02.050892104Z [2024-05-11 01:23:02,050: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:23:02.050956351Z [2024-05-11 01:23:02,050: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:23:02.051009610Z [2024-05-11 01:23:02,050: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:23:02.051286510Z [2024-05-11 01:23:02,051: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:23:02.051330321Z [2024-05-11 01:23:02,051: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:23:02.126288853Z [2024-05-11 01:23:02,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:23:02.149684517Z [2024-05-11 01:23:02,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:23:04.370750858Z [2024-05-11 01:23:04,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a8554a3-90a6-4c77-9322-eb1a10c7c8c1] succeeded in 4.003802713999903s: None 2024-05-11T01:23:05.510939119Z [2024-05-11 01:23:05,510: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c2e857f-eeaa-4a8d-a121-10e0bea1e870] succeeded in 5.1366376070000115s: None 2024-05-11T01:24:00.517088560Z [2024-05-11 01:24:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[097e0e23-c69a-41f5-ade3-58947aef7e81] received 2024-05-11T01:24:00.519199014Z [2024-05-11 01:24:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be24165d-5665-40f6-b69a-4bdf27071c9b] received 2024-05-11T01:24:00.527505713Z [2024-05-11 01:24:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80dab729-b82f-4a9f-988a-e16f95715786] received 2024-05-11T01:24:00.538640879Z [2024-05-11 01:24:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc53c40a-e566-4ef8-9a7b-198cb71a3a72] received 2024-05-11T01:24:00.550397662Z [2024-05-11 01:24:00,550: INFO/ForkPoolWorker-16] [be24165d-5665-40f6-b69a-4bdf27071c9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:24:00.550479237Z [2024-05-11 01:24:00,550: INFO/ForkPoolWorker-2] [dc53c40a-e566-4ef8-9a7b-198cb71a3a72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:24:00.562595735Z [2024-05-11 01:24:00,562: INFO/ForkPoolWorker-15] [097e0e23-c69a-41f5-ade3-58947aef7e81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:24:00.562872043Z [2024-05-11 01:24:00,562: INFO/ForkPoolWorker-1] [80dab729-b82f-4a9f-988a-e16f95715786] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:24:00.975532284Z [2024-05-11 01:24:00,971: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:24:01.038200176Z [2024-05-11 01:24:01,024: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:24:01.062389464Z [2024-05-11 01:24:01,051: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:24:01.099728327Z [2024-05-11 01:24:01,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:24:01.483765004Z [2024-05-11 01:24:01,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:24:01.504339052Z [2024-05-11 01:24:01,503: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:24:01.508990865Z [2024-05-11 01:24:01,508: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:24:01.533967594Z [2024-05-11 01:24:01,533: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:24:01.535203450Z [2024-05-11 01:24:01,534: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:24:01.535416677Z [2024-05-11 01:24:01,535: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:24:01.535599810Z [2024-05-11 01:24:01,535: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:24:01.536622673Z [2024-05-11 01:24:01,536: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:24:01.652995774Z [2024-05-11 01:24:01,652: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:24:02.193749148Z [2024-05-11 01:24:02,193: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[80dab729-b82f-4a9f-988a-e16f95715786] succeeded in 1.663860034001118s: None 2024-05-11T01:24:02.394342416Z [2024-05-11 01:24:02,393: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be24165d-5665-40f6-b69a-4bdf27071c9b] succeeded in 1.87121546599883s: None 2024-05-11T01:24:02.702802512Z [2024-05-11 01:24:02,702: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:24:02.707255341Z [2024-05-11 01:24:02,706: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:24:02.749617597Z [2024-05-11 01:24:02,749: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:24:02.751398706Z [2024-05-11 01:24:02,751: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:24:02.751433007Z [2024-05-11 01:24:02,751: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:24:02.751705241Z [2024-05-11 01:24:02,751: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:24:02.751909640Z [2024-05-11 01:24:02,751: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:24:02.752347357Z [2024-05-11 01:24:02,752: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:24:02.752535337Z [2024-05-11 01:24:02,752: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:24:02.758731459Z [2024-05-11 01:24:02,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:24:02.762145058Z [2024-05-11 01:24:02,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:24:02.795485908Z [2024-05-11 01:24:02,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:24:02.797539747Z [2024-05-11 01:24:02,797: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:24:02.797702594Z [2024-05-11 01:24:02,797: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:24:02.798101366Z [2024-05-11 01:24:02,797: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:24:02.798315912Z [2024-05-11 01:24:02,798: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:24:02.799207214Z [2024-05-11 01:24:02,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:24:02.799273370Z [2024-05-11 01:24:02,799: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:24:02.873076122Z [2024-05-11 01:24:02,872: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:24:02.916018761Z [2024-05-11 01:24:02,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:24:05.010987041Z [2024-05-11 01:24:05,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[097e0e23-c69a-41f5-ade3-58947aef7e81] succeeded in 4.489739380998799s: None 2024-05-11T01:24:05.570509802Z [2024-05-11 01:24:05,570: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dc53c40a-e566-4ef8-9a7b-198cb71a3a72] succeeded in 5.029758946000584s: None 2024-05-11T01:25:00.652450765Z [2024-05-11 01:25:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58e31518-96fc-49d9-a212-a98a581308c1] received 2024-05-11T01:25:00.656176244Z [2024-05-11 01:25:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81110e8c-3bfa-47e7-8e89-98f0754f216d] received 2024-05-11T01:25:00.666195660Z [2024-05-11 01:25:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34bccea2-114a-433c-b850-c70c15703610] received 2024-05-11T01:25:00.667719827Z [2024-05-11 01:25:00,667: INFO/ForkPoolWorker-16] [81110e8c-3bfa-47e7-8e89-98f0754f216d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:25:00.669365225Z [2024-05-11 01:25:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bb14636-c961-4acd-9072-9618469e79a9] received 2024-05-11T01:25:00.673838632Z [2024-05-11 01:25:00,673: INFO/ForkPoolWorker-15] [58e31518-96fc-49d9-a212-a98a581308c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:00.674685133Z [2024-05-11 01:25:00,674: INFO/ForkPoolWorker-1] [34bccea2-114a-433c-b850-c70c15703610] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:25:00.679230559Z [2024-05-11 01:25:00,678: INFO/ForkPoolWorker-2] [1bb14636-c961-4acd-9072-9618469e79a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:25:01.187749684Z [2024-05-11 01:25:01,179: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:25:01.257783014Z [2024-05-11 01:25:01,254: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:25:01.264015415Z [2024-05-11 01:25:01,260: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:25:01.362707504Z [2024-05-11 01:25:01,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:25:01.568857947Z [2024-05-11 01:25:01,568: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:25:01.573784461Z [2024-05-11 01:25:01,573: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:01.617310199Z [2024-05-11 01:25:01,617: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:25:01.622496019Z [2024-05-11 01:25:01,622: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:25:01.622690026Z [2024-05-11 01:25:01,622: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:25:01.622807504Z [2024-05-11 01:25:01,622: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:25:01.623142691Z [2024-05-11 01:25:01,622: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:25:01.771028406Z [2024-05-11 01:25:01,770: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:02.490368339Z [2024-05-11 01:25:02,489: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1bb14636-c961-4acd-9072-9618469e79a9] succeeded in 1.8192063020014757s: None 2024-05-11T01:25:02.672199469Z [2024-05-11 01:25:02,671: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:25:02.675498867Z [2024-05-11 01:25:02,675: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:02.704521120Z [2024-05-11 01:25:02,704: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:25:02.706833814Z [2024-05-11 01:25:02,706: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:02.707067683Z [2024-05-11 01:25:02,706: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:02.707351526Z [2024-05-11 01:25:02,707: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:02.707546574Z [2024-05-11 01:25:02,707: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:25:02.707968989Z [2024-05-11 01:25:02,707: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:25:02.708186552Z [2024-05-11 01:25:02,708: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:02.832738956Z [2024-05-11 01:25:02,832: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:02.878454868Z [2024-05-11 01:25:02,878: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:25:02.881776410Z [2024-05-11 01:25:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:02.912750294Z [2024-05-11 01:25:02,912: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:25:02.915688127Z [2024-05-11 01:25:02,915: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:02.915883495Z [2024-05-11 01:25:02,915: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:02.916184874Z [2024-05-11 01:25:02,915: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:02.916378700Z [2024-05-11 01:25:02,916: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:25:02.916947345Z [2024-05-11 01:25:02,916: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:25:02.917496750Z [2024-05-11 01:25:02,917: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:02.994110214Z [2024-05-11 01:25:02,993: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:25:03.008933211Z [2024-05-11 01:25:03,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:03.012059243Z [2024-05-11 01:25:03,011: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:03.043223087Z [2024-05-11 01:25:03,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:25:03.044521431Z [2024-05-11 01:25:03,044: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:03.044553499Z [2024-05-11 01:25:03,044: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:03.044662797Z [2024-05-11 01:25:03,044: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:03.044669811Z [2024-05-11 01:25:03,044: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:25:03.045185687Z [2024-05-11 01:25:03,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:25:03.045191885Z [2024-05-11 01:25:03,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:03.194735720Z [2024-05-11 01:25:03,194: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:03.904926035Z [2024-05-11 01:25:03,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58e31518-96fc-49d9-a212-a98a581308c1] succeeded in 3.2443649350007036s: None 2024-05-11T01:25:04.331896500Z [2024-05-11 01:25:04,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b377368c-4b11-447c-87ca-0b1bb76586db] received 2024-05-11T01:25:04.339985354Z [2024-05-11 01:25:04,339: INFO/ForkPoolWorker-15] [b377368c-4b11-447c-87ca-0b1bb76586db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:04.626281350Z [2024-05-11 01:25:04,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:25:04.654422807Z [2024-05-11 01:25:04,654: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34bccea2-114a-433c-b850-c70c15703610] succeeded in 3.9866847220000636s: None 2024-05-11T01:25:04.711028056Z [2024-05-11 01:25:04,710: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81110e8c-3bfa-47e7-8e89-98f0754f216d] succeeded in 4.052567463999367s: None 2024-05-11T01:25:05.846653115Z [2024-05-11 01:25:05,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:25:05.849805639Z [2024-05-11 01:25:05,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:05.867920476Z [2024-05-11 01:25:05,867: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:25:05.869134258Z [2024-05-11 01:25:05,868: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:05.869141631Z [2024-05-11 01:25:05,869: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:05.869301074Z [2024-05-11 01:25:05,869: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:05.869310182Z [2024-05-11 01:25:05,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:25:05.869697405Z [2024-05-11 01:25:05,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:25:05.869726152Z [2024-05-11 01:25:05,869: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:05.953661047Z [2024-05-11 01:25:05,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:06.601584545Z [2024-05-11 01:25:06,601: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b377368c-4b11-447c-87ca-0b1bb76586db] succeeded in 2.266710662999685s: None 2024-05-11T01:25:06.744930472Z [2024-05-11 01:25:06,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f16e00a5-e5c5-45c8-88ae-96398b6ba21e] received 2024-05-11T01:25:06.756995888Z [2024-05-11 01:25:06,754: INFO/ForkPoolWorker-15] [f16e00a5-e5c5-45c8-88ae-96398b6ba21e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:25:07.139800500Z [2024-05-11 01:25:07,135: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:25:08.322228875Z [2024-05-11 01:25:08,321: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:25:08.325175739Z [2024-05-11 01:25:08,324: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:08.352711889Z [2024-05-11 01:25:08,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:25:08.354401216Z [2024-05-11 01:25:08,354: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:08.354592413Z [2024-05-11 01:25:08,354: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:08.354898934Z [2024-05-11 01:25:08,354: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:08.355001195Z [2024-05-11 01:25:08,354: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:25:08.355564999Z [2024-05-11 01:25:08,355: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:25:08.355667571Z [2024-05-11 01:25:08,355: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:08.445204193Z [2024-05-11 01:25:08,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:08.937853860Z [2024-05-11 01:25:08,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f16e00a5-e5c5-45c8-88ae-96398b6ba21e] succeeded in 2.1894055980010307s: None 2024-05-11T01:25:09.508485367Z [2024-05-11 01:25:09,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28950ab8-c4de-451a-a031-deaee5cfc00a] received 2024-05-11T01:25:09.519092510Z [2024-05-11 01:25:09,518: INFO/ForkPoolWorker-15] [28950ab8-c4de-451a-a031-deaee5cfc00a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:25:09.818468553Z [2024-05-11 01:25:09,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:25:10.910719880Z [2024-05-11 01:25:10,910: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:25:10.913805758Z [2024-05-11 01:25:10,913: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:25:10.933255604Z [2024-05-11 01:25:10,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:25:10.934664543Z [2024-05-11 01:25:10,934: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:25:10.934728654Z [2024-05-11 01:25:10,934: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:25:10.934871353Z [2024-05-11 01:25:10,934: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:25:10.934905786Z [2024-05-11 01:25:10,934: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:25:10.935209190Z [2024-05-11 01:25:10,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:25:10.935241109Z [2024-05-11 01:25:10,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:25:11.034954198Z [2024-05-11 01:25:11,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:25:11.654783013Z [2024-05-11 01:25:11,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28950ab8-c4de-451a-a031-deaee5cfc00a] succeeded in 2.1412338509999245s: None 2024-05-11T01:26:00.970962572Z [2024-05-11 01:26:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd94bcd-fa58-4958-b3d1-728c113a5c81] received 2024-05-11T01:26:00.975333673Z [2024-05-11 01:26:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e438c3fd-7fac-4b2e-bba1-536b8c6bf8a5] received 2024-05-11T01:26:00.980720461Z [2024-05-11 01:26:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb954b38-0412-466e-8cf4-9e163cef677c] received 2024-05-11T01:26:00.983811736Z [2024-05-11 01:26:00,983: INFO/ForkPoolWorker-15] [afd94bcd-fa58-4958-b3d1-728c113a5c81] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:26:00.985584112Z [2024-05-11 01:26:00,985: INFO/ForkPoolWorker-16] [e438c3fd-7fac-4b2e-bba1-536b8c6bf8a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:26:00.993625160Z [2024-05-11 01:26:00,993: INFO/ForkPoolWorker-1] [cb954b38-0412-466e-8cf4-9e163cef677c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:26:01.015152885Z [2024-05-11 01:26:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89b81d57-f869-4c22-8452-14ee0aac183d] received 2024-05-11T01:26:01.025762925Z [2024-05-11 01:26:01,024: INFO/ForkPoolWorker-2] [89b81d57-f869-4c22-8452-14ee0aac183d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:26:01.383752737Z [2024-05-11 01:26:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:26:01.424820115Z [2024-05-11 01:26:01,421: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:26:01.438855730Z [2024-05-11 01:26:01,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:26:01.454620659Z [2024-05-11 01:26:01,451: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:26:01.580351079Z [2024-05-11 01:26:01,579: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:26:01.585012741Z [2024-05-11 01:26:01,584: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:26:01.630048021Z [2024-05-11 01:26:01,629: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:26:01.632323818Z [2024-05-11 01:26:01,632: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:26:01.632458451Z [2024-05-11 01:26:01,632: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:26:01.632686142Z [2024-05-11 01:26:01,632: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:26:01.632990637Z [2024-05-11 01:26:01,632: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:26:01.723905112Z [2024-05-11 01:26:01,723: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:26:01.773272248Z [2024-05-11 01:26:01,772: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:26:02.322216293Z [2024-05-11 01:26:02,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afd94bcd-fa58-4958-b3d1-728c113a5c81] succeeded in 1.3495661359993392s: None 2024-05-11T01:26:02.344223258Z [2024-05-11 01:26:02,343: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb954b38-0412-466e-8cf4-9e163cef677c] succeeded in 1.360670129999562s: None 2024-05-11T01:26:02.751803818Z [2024-05-11 01:26:02,751: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:26:02.752107694Z [2024-05-11 01:26:02,751: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:26:02.755034864Z [2024-05-11 01:26:02,754: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:26:02.755686594Z [2024-05-11 01:26:02,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:26:02.779001994Z [2024-05-11 01:26:02,778: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:26:02.780258192Z [2024-05-11 01:26:02,780: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:26:02.780363082Z [2024-05-11 01:26:02,780: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:26:02.780601071Z [2024-05-11 01:26:02,780: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:26:02.780737285Z [2024-05-11 01:26:02,780: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:26:02.781090275Z [2024-05-11 01:26:02,780: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:26:02.781251076Z [2024-05-11 01:26:02,781: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:26:02.782580164Z [2024-05-11 01:26:02,782: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:26:02.784172401Z [2024-05-11 01:26:02,783: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:26:02.784553237Z [2024-05-11 01:26:02,784: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:26:02.784758882Z [2024-05-11 01:26:02,784: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:26:02.784896146Z [2024-05-11 01:26:02,784: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:26:02.785188332Z [2024-05-11 01:26:02,785: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:26:02.785346464Z [2024-05-11 01:26:02,785: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:26:02.872321608Z [2024-05-11 01:26:02,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:26:02.877849859Z [2024-05-11 01:26:02,877: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:26:04.795674259Z [2024-05-11 01:26:04,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e438c3fd-7fac-4b2e-bba1-536b8c6bf8a5] succeeded in 3.8166897720002453s: None 2024-05-11T01:26:05.075520479Z [2024-05-11 01:26:05,074: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89b81d57-f869-4c22-8452-14ee0aac183d] succeeded in 4.057744752000872s: None 2024-05-11T01:27:00.344494599Z [2024-05-11 01:27:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2adf912d-62a5-453b-9d08-844a600ebb5f] received 2024-05-11T01:27:00.351260323Z [2024-05-11 01:27:00,351: INFO/ForkPoolWorker-15] [2adf912d-62a5-453b-9d08-844a600ebb5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:27:00.358246101Z [2024-05-11 01:27:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5298cba3-f849-44f1-a8de-e80b1898975e] received 2024-05-11T01:27:00.360913258Z [2024-05-11 01:27:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[952ca6c5-9c80-4efb-8054-6fe92ab32847] received 2024-05-11T01:27:00.364240670Z [2024-05-11 01:27:00,364: INFO/ForkPoolWorker-16] [5298cba3-f849-44f1-a8de-e80b1898975e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:27:00.374369220Z [2024-05-11 01:27:00,374: INFO/ForkPoolWorker-1] [952ca6c5-9c80-4efb-8054-6fe92ab32847] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:27:00.632777911Z [2024-05-11 01:27:00,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:27:00.692131449Z [2024-05-11 01:27:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:27:00.700060933Z [2024-05-11 01:27:00,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:27:00.884331612Z [2024-05-11 01:27:00,883: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:27:00.888723526Z [2024-05-11 01:27:00,888: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:27:00.928593196Z [2024-05-11 01:27:00,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:27:00.932585298Z [2024-05-11 01:27:00,932: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:27:00.932725439Z [2024-05-11 01:27:00,932: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:27:00.932798049Z [2024-05-11 01:27:00,932: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:27:00.933070031Z [2024-05-11 01:27:00,932: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:27:01.222952713Z [2024-05-11 01:27:01,222: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:27:01.839919004Z [2024-05-11 01:27:01,839: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:27:01.843198369Z [2024-05-11 01:27:01,842: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:27:01.873512342Z [2024-05-11 01:27:01,873: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:27:01.873531424Z [2024-05-11 01:27:01,873: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[952ca6c5-9c80-4efb-8054-6fe92ab32847] succeeded in 1.5100680849991477s: None 2024-05-11T01:27:01.876312690Z [2024-05-11 01:27:01,875: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:27:01.876750878Z [2024-05-11 01:27:01,876: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:27:01.877164741Z [2024-05-11 01:27:01,876: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:27:01.877427597Z [2024-05-11 01:27:01,877: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:27:01.878164766Z [2024-05-11 01:27:01,877: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:27:01.878393302Z [2024-05-11 01:27:01,878: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:27:01.988595443Z [2024-05-11 01:27:01,988: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:27:02.004267922Z [2024-05-11 01:27:02,003: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:27:02.007621239Z [2024-05-11 01:27:02,007: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:27:02.028866630Z [2024-05-11 01:27:02,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:27:02.034140282Z [2024-05-11 01:27:02,033: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:27:02.034949635Z [2024-05-11 01:27:02,034: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:27:02.035142874Z [2024-05-11 01:27:02,034: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:27:02.035919543Z [2024-05-11 01:27:02,035: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:27:02.036478690Z [2024-05-11 01:27:02,036: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:27:02.037866460Z [2024-05-11 01:27:02,037: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:27:02.137520557Z [2024-05-11 01:27:02,137: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:27:03.451649504Z [2024-05-11 01:27:03,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2adf912d-62a5-453b-9d08-844a600ebb5f] succeeded in 3.107145288000538s: None 2024-05-11T01:27:03.993229886Z [2024-05-11 01:27:03,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5298cba3-f849-44f1-a8de-e80b1898975e] succeeded in 3.6333403200005705s: None 2024-05-11T01:28:00.848407442Z [2024-05-11 01:28:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b44cc6d-b55b-49dd-b936-8b012ec37f8b] received 2024-05-11T01:28:00.850072522Z [2024-05-11 01:28:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fe63fb4-f5f1-4b00-a286-de14f1a8e26b] received 2024-05-11T01:28:00.853668827Z [2024-05-11 01:28:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d358310-1fef-41f1-b088-9f2eba8257d8] received 2024-05-11T01:28:00.859289385Z [2024-05-11 01:28:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca5fa002-7942-491c-b779-c225a7c7e876] received 2024-05-11T01:28:00.861618143Z [2024-05-11 01:28:00,861: INFO/ForkPoolWorker-1] [6d358310-1fef-41f1-b088-9f2eba8257d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:28:00.866504121Z [2024-05-11 01:28:00,866: INFO/ForkPoolWorker-16] [1fe63fb4-f5f1-4b00-a286-de14f1a8e26b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:28:00.866808640Z [2024-05-11 01:28:00,865: INFO/ForkPoolWorker-15] [6b44cc6d-b55b-49dd-b936-8b012ec37f8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:28:00.877946756Z [2024-05-11 01:28:00,877: INFO/ForkPoolWorker-2] [ca5fa002-7942-491c-b779-c225a7c7e876] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:28:01.226987213Z [2024-05-11 01:28:01,221: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:28:01.306446429Z [2024-05-11 01:28:01,303: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:28:01.332716848Z [2024-05-11 01:28:01,329: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:28:01.366716756Z [2024-05-11 01:28:01,363: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:28:01.528336934Z [2024-05-11 01:28:01,527: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:28:01.532325274Z [2024-05-11 01:28:01,531: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:28:01.592473507Z [2024-05-11 01:28:01,592: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:28:01.593574530Z [2024-05-11 01:28:01,593: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:28:01.593602806Z [2024-05-11 01:28:01,593: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:28:01.593616272Z [2024-05-11 01:28:01,593: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:28:01.593824887Z [2024-05-11 01:28:01,593: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:28:01.603383938Z [2024-05-11 01:28:01,603: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:28:01.706723587Z [2024-05-11 01:28:01,706: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:28:02.131375608Z [2024-05-11 01:28:02,130: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fe63fb4-f5f1-4b00-a286-de14f1a8e26b] succeeded in 1.2771696290001273s: None 2024-05-11T01:28:02.302420532Z [2024-05-11 01:28:02,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d358310-1fef-41f1-b088-9f2eba8257d8] succeeded in 1.4468162590001157s: None 2024-05-11T01:28:02.524571384Z [2024-05-11 01:28:02,524: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:28:02.527911173Z [2024-05-11 01:28:02,527: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:28:02.549561415Z [2024-05-11 01:28:02,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:28:02.551242895Z [2024-05-11 01:28:02,551: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:28:02.551446462Z [2024-05-11 01:28:02,551: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:28:02.551680421Z [2024-05-11 01:28:02,551: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:28:02.551839580Z [2024-05-11 01:28:02,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:28:02.552181981Z [2024-05-11 01:28:02,552: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:28:02.552709976Z [2024-05-11 01:28:02,552: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:28:02.626782414Z [2024-05-11 01:28:02,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:28:02.731676237Z [2024-05-11 01:28:02,731: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:28:02.735123770Z [2024-05-11 01:28:02,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:28:02.754324550Z [2024-05-11 01:28:02,754: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:28:02.757620387Z [2024-05-11 01:28:02,757: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:28:02.757724426Z [2024-05-11 01:28:02,757: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:28:02.758023458Z [2024-05-11 01:28:02,757: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:28:02.758131790Z [2024-05-11 01:28:02,758: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:28:02.758432186Z [2024-05-11 01:28:02,758: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:28:02.758513388Z [2024-05-11 01:28:02,758: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:28:02.844647870Z [2024-05-11 01:28:02,844: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:28:04.290079487Z [2024-05-11 01:28:04,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b44cc6d-b55b-49dd-b936-8b012ec37f8b] succeeded in 3.438517557000523s: None 2024-05-11T01:28:04.913989524Z [2024-05-11 01:28:04,913: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca5fa002-7942-491c-b779-c225a7c7e876] succeeded in 4.047790036000151s: None 2024-05-11T01:29:00.607006562Z [2024-05-11 01:29:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c05a467b-a553-42c7-a9e2-ea398949ca8a] received 2024-05-11T01:29:00.612366217Z [2024-05-11 01:29:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b7e0872-43e7-4c67-bd8c-ae00195a8c93] received 2024-05-11T01:29:00.615221082Z [2024-05-11 01:29:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aee52e56-2f32-4c49-8359-d1217275a4a7] received 2024-05-11T01:29:00.615509706Z [2024-05-11 01:29:00,615: INFO/ForkPoolWorker-15] [c05a467b-a553-42c7-a9e2-ea398949ca8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:29:00.624811670Z [2024-05-11 01:29:00,624: INFO/ForkPoolWorker-16] [4b7e0872-43e7-4c67-bd8c-ae00195a8c93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:29:00.626654246Z [2024-05-11 01:29:00,626: INFO/ForkPoolWorker-1] [aee52e56-2f32-4c49-8359-d1217275a4a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:29:00.950011179Z [2024-05-11 01:29:00,946: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:29:01.148184042Z [2024-05-11 01:29:01,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:29:01.181683582Z [2024-05-11 01:29:01,177: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:29:01.320640648Z [2024-05-11 01:29:01,320: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:29:01.324690818Z [2024-05-11 01:29:01,324: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:29:01.358951356Z [2024-05-11 01:29:01,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:29:01.360217145Z [2024-05-11 01:29:01,360: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:29:01.360233534Z [2024-05-11 01:29:01,360: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:29:01.360303757Z [2024-05-11 01:29:01,360: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:29:01.361347578Z [2024-05-11 01:29:01,361: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:29:01.464844292Z [2024-05-11 01:29:01,464: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:29:02.143507210Z [2024-05-11 01:29:02,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c05a467b-a553-42c7-a9e2-ea398949ca8a] succeeded in 1.5345023120007681s: None 2024-05-11T01:29:02.521077259Z [2024-05-11 01:29:02,520: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:29:02.522799832Z [2024-05-11 01:29:02,522: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:29:02.524556030Z [2024-05-11 01:29:02,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:29:02.526058334Z [2024-05-11 01:29:02,525: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:29:02.542174573Z [2024-05-11 01:29:02,541: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:29:02.543207430Z [2024-05-11 01:29:02,542: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:29:02.543218289Z [2024-05-11 01:29:02,543: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:29:02.543315821Z [2024-05-11 01:29:02,543: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:29:02.543322062Z [2024-05-11 01:29:02,543: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:29:02.543877716Z [2024-05-11 01:29:02,543: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:29:02.543885373Z [2024-05-11 01:29:02,543: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:29:02.552543527Z [2024-05-11 01:29:02,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:29:02.553811503Z [2024-05-11 01:29:02,553: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:29:02.553829159Z [2024-05-11 01:29:02,553: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:29:02.554034253Z [2024-05-11 01:29:02,553: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:29:02.554071512Z [2024-05-11 01:29:02,553: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:29:02.554353877Z [2024-05-11 01:29:02,554: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:29:02.554390022Z [2024-05-11 01:29:02,554: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:29:02.628762652Z [2024-05-11 01:29:02,628: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:29:02.637250512Z [2024-05-11 01:29:02,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:29:04.527061574Z [2024-05-11 01:29:04,526: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b7e0872-43e7-4c67-bd8c-ae00195a8c93] succeeded in 3.908882899000673s: None 2024-05-11T01:29:05.463394821Z [2024-05-11 01:29:05,462: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aee52e56-2f32-4c49-8359-d1217275a4a7] succeeded in 4.844157659999837s: None 2024-05-11T01:30:00.570026563Z [2024-05-11 01:30:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b67ea7f8-9913-493f-a28f-0a2b7c24fe1a] received 2024-05-11T01:30:00.571875900Z [2024-05-11 01:30:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8be4849-1a45-4600-86b7-64cceab78db3] received 2024-05-11T01:30:00.574793405Z [2024-05-11 01:30:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2206febc-e978-41fe-a2c4-9c4077767f24] received 2024-05-11T01:30:00.577439813Z [2024-05-11 01:30:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64675038-c4c1-4b80-a4f5-2580c919114a] received 2024-05-11T01:30:00.578824627Z [2024-05-11 01:30:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d738b1ea-8fbd-461c-b65e-dfded7ca66a9] received 2024-05-11T01:30:00.581822381Z [2024-05-11 01:30:00,581: INFO/ForkPoolWorker-16] [c8be4849-1a45-4600-86b7-64cceab78db3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:30:00.587929497Z [2024-05-11 01:30:00,587: INFO/ForkPoolWorker-2] [64675038-c4c1-4b80-a4f5-2580c919114a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:30:00.591428791Z [2024-05-11 01:30:00,591: INFO/ForkPoolWorker-1] [2206febc-e978-41fe-a2c4-9c4077767f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:00.593814761Z [2024-05-11 01:30:00,590: INFO/ForkPoolWorker-3] [d738b1ea-8fbd-461c-b65e-dfded7ca66a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:30:00.594637428Z [2024-05-11 01:30:00,594: INFO/ForkPoolWorker-15] [b67ea7f8-9913-493f-a28f-0a2b7c24fe1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:30:00.937629419Z [2024-05-11 01:30:00,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:30:00.944681272Z [2024-05-11 01:30:00,937: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:30:00.987333813Z [2024-05-11 01:30:00,979: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:30:01.017535119Z [2024-05-11 01:30:01,008: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:30:01.150308094Z [2024-05-11 01:30:01,141: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:30:01.444194248Z [2024-05-11 01:30:01,443: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:30:01.454125165Z [2024-05-11 01:30:01,453: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:01.513273897Z [2024-05-11 01:30:01,513: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:30:01.519105494Z [2024-05-11 01:30:01,518: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:30:01.519425428Z [2024-05-11 01:30:01,519: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:30:01.519601431Z [2024-05-11 01:30:01,519: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:30:01.519914043Z [2024-05-11 01:30:01,519: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:30:01.630944667Z [2024-05-11 01:30:01,630: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:01.674703049Z [2024-05-11 01:30:01,674: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:02.477827010Z [2024-05-11 01:30:02,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8be4849-1a45-4600-86b7-64cceab78db3] succeeded in 1.9037341359999118s: None 2024-05-11T01:30:02.516196529Z [2024-05-11 01:30:02,515: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d738b1ea-8fbd-461c-b65e-dfded7ca66a9] succeeded in 1.934801856001286s: None 2024-05-11T01:30:02.843565626Z [2024-05-11 01:30:02,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:30:02.847123164Z [2024-05-11 01:30:02,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:02.874838569Z [2024-05-11 01:30:02,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:30:02.879009255Z [2024-05-11 01:30:02,878: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:02.879300852Z [2024-05-11 01:30:02,879: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:02.879552514Z [2024-05-11 01:30:02,879: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:02.879761046Z [2024-05-11 01:30:02,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:30:02.880192741Z [2024-05-11 01:30:02,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:30:02.880535115Z [2024-05-11 01:30:02,880: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:02.898063319Z [2024-05-11 01:30:02,897: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:30:02.902012737Z [2024-05-11 01:30:02,901: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:02.930447756Z [2024-05-11 01:30:02,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:30:02.932461936Z [2024-05-11 01:30:02,932: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:30:02.932870647Z [2024-05-11 01:30:02,932: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:02.933016028Z [2024-05-11 01:30:02,932: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:02.933269754Z [2024-05-11 01:30:02,932: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:02.933430486Z [2024-05-11 01:30:02,933: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:30:02.933836594Z [2024-05-11 01:30:02,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:30:02.934038635Z [2024-05-11 01:30:02,933: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:02.935793084Z [2024-05-11 01:30:02,935: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:02.966583550Z [2024-05-11 01:30:02,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:02.987294899Z [2024-05-11 01:30:02,987: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:30:02.994377842Z [2024-05-11 01:30:02,994: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:02.994401458Z [2024-05-11 01:30:02,994: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:02.995690861Z [2024-05-11 01:30:02,994: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:02.995823081Z [2024-05-11 01:30:02,995: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:30:02.996143190Z [2024-05-11 01:30:02,995: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:30:02.996252617Z [2024-05-11 01:30:02,996: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:03.030835249Z [2024-05-11 01:30:03,030: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:03.084158357Z [2024-05-11 01:30:03,083: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:03.708375280Z [2024-05-11 01:30:03,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2206febc-e978-41fe-a2c4-9c4077767f24] succeeded in 3.131372306999765s: None 2024-05-11T01:30:04.267486736Z [2024-05-11 01:30:04,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80e24d19-954d-4d2d-9267-abd2838ece15] received 2024-05-11T01:30:04.278252899Z [2024-05-11 01:30:04,277: INFO/ForkPoolWorker-16] [80e24d19-954d-4d2d-9267-abd2838ece15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:04.564041797Z [2024-05-11 01:30:04,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:30:04.860345716Z [2024-05-11 01:30:04,859: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[64675038-c4c1-4b80-a4f5-2580c919114a] succeeded in 4.281393044000652s: None 2024-05-11T01:30:05.034936284Z [2024-05-11 01:30:05,034: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b67ea7f8-9913-493f-a28f-0a2b7c24fe1a] succeeded in 4.462320088001434s: None 2024-05-11T01:30:05.806396108Z [2024-05-11 01:30:05,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:30:05.809758737Z [2024-05-11 01:30:05,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:05.828908725Z [2024-05-11 01:30:05,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:30:05.830040207Z [2024-05-11 01:30:05,829: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:05.830134779Z [2024-05-11 01:30:05,829: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:05.830143110Z [2024-05-11 01:30:05,830: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:05.830197301Z [2024-05-11 01:30:05,830: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:30:05.830394099Z [2024-05-11 01:30:05,830: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:30:05.830448163Z [2024-05-11 01:30:05,830: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:05.918111331Z [2024-05-11 01:30:05,917: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:06.530989038Z [2024-05-11 01:30:06,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80e24d19-954d-4d2d-9267-abd2838ece15] succeeded in 2.2610149350002757s: None 2024-05-11T01:30:06.696536004Z [2024-05-11 01:30:06,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81d6d3f0-6eae-4cdd-93d7-bc78f18afc01] received 2024-05-11T01:30:06.712063965Z [2024-05-11 01:30:06,711: INFO/ForkPoolWorker-15] [81d6d3f0-6eae-4cdd-93d7-bc78f18afc01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:30:07.079837418Z [2024-05-11 01:30:07,076: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:30:08.227984281Z [2024-05-11 01:30:08,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:30:08.231228329Z [2024-05-11 01:30:08,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:08.249292032Z [2024-05-11 01:30:08,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:30:08.250596080Z [2024-05-11 01:30:08,250: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:08.250713376Z [2024-05-11 01:30:08,250: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:08.250903548Z [2024-05-11 01:30:08,250: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:08.251011163Z [2024-05-11 01:30:08,250: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:30:08.251356403Z [2024-05-11 01:30:08,251: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:30:08.251476614Z [2024-05-11 01:30:08,251: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:08.332440383Z [2024-05-11 01:30:08,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:08.856467838Z [2024-05-11 01:30:08,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81d6d3f0-6eae-4cdd-93d7-bc78f18afc01] succeeded in 2.1573630530001537s: None 2024-05-11T01:30:09.210393952Z [2024-05-11 01:30:09,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[697aa064-2f6e-485b-9397-ddc56d5fb631] received 2024-05-11T01:30:09.218492991Z [2024-05-11 01:30:09,218: INFO/ForkPoolWorker-15] [697aa064-2f6e-485b-9397-ddc56d5fb631] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:30:09.491647275Z [2024-05-11 01:30:09,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:30:10.585383096Z [2024-05-11 01:30:10,585: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:30:10.588674800Z [2024-05-11 01:30:10,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:30:10.614933096Z [2024-05-11 01:30:10,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:30:10.616556399Z [2024-05-11 01:30:10,616: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:30:10.616700566Z [2024-05-11 01:30:10,616: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:30:10.616923032Z [2024-05-11 01:30:10,616: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:30:10.617050410Z [2024-05-11 01:30:10,616: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:30:10.617367553Z [2024-05-11 01:30:10,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:30:10.617506338Z [2024-05-11 01:30:10,617: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:30:10.694492071Z [2024-05-11 01:30:10,694: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:30:11.357105467Z [2024-05-11 01:30:11,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[697aa064-2f6e-485b-9397-ddc56d5fb631] succeeded in 2.1446599570008402s: None 2024-05-11T01:31:01.015150682Z [2024-05-11 01:31:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5553e8a5-77fc-4b86-b95d-39706251565f] received 2024-05-11T01:31:01.028644966Z [2024-05-11 01:31:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72a1dc0e-7dfa-433a-badc-d36635e71822] received 2024-05-11T01:31:01.029977571Z [2024-05-11 01:31:01,025: INFO/ForkPoolWorker-15] [5553e8a5-77fc-4b86-b95d-39706251565f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:31:01.036286713Z [2024-05-11 01:31:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ab3b24f-24d8-4958-b74c-c0acb65a8d39] received 2024-05-11T01:31:01.049283190Z [2024-05-11 01:31:01,048: INFO/ForkPoolWorker-1] [5ab3b24f-24d8-4958-b74c-c0acb65a8d39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:31:01.054253279Z [2024-05-11 01:31:01,051: INFO/ForkPoolWorker-16] [72a1dc0e-7dfa-433a-badc-d36635e71822] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:31:01.403302245Z [2024-05-11 01:31:01,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:31:01.421597011Z [2024-05-11 01:31:01,418: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:31:01.452946756Z [2024-05-11 01:31:01,449: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:31:01.614457576Z [2024-05-11 01:31:01,614: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:31:01.619061358Z [2024-05-11 01:31:01,618: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:31:01.650391290Z [2024-05-11 01:31:01,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:31:01.654949403Z [2024-05-11 01:31:01,654: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:31:01.655886483Z [2024-05-11 01:31:01,655: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:31:01.656961595Z [2024-05-11 01:31:01,656: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:31:01.658044740Z [2024-05-11 01:31:01,657: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:31:01.740490395Z [2024-05-11 01:31:01,740: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:31:02.395622359Z [2024-05-11 01:31:02,391: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ab3b24f-24d8-4958-b74c-c0acb65a8d39] succeeded in 1.3476644919992395s: None 2024-05-11T01:31:02.598872343Z [2024-05-11 01:31:02,598: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:31:02.602361464Z [2024-05-11 01:31:02,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:31:02.622196736Z [2024-05-11 01:31:02,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:31:02.625802567Z [2024-05-11 01:31:02,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:31:02.631918715Z [2024-05-11 01:31:02,631: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:31:02.634394311Z [2024-05-11 01:31:02,633: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:31:02.634549314Z [2024-05-11 01:31:02,634: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:31:02.634710187Z [2024-05-11 01:31:02,634: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:31:02.634750737Z [2024-05-11 01:31:02,634: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:31:02.635066599Z [2024-05-11 01:31:02,634: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:31:02.635126056Z [2024-05-11 01:31:02,635: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:31:02.646929311Z [2024-05-11 01:31:02,646: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:31:02.648274086Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:31:02.648366461Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:31:02.648504883Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:31:02.648556556Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:31:02.648857813Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:31:02.648937611Z [2024-05-11 01:31:02,648: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:31:02.712802659Z [2024-05-11 01:31:02,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:31:02.721581895Z [2024-05-11 01:31:02,721: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:31:04.266807302Z [2024-05-11 01:31:04,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72a1dc0e-7dfa-433a-badc-d36635e71822] succeeded in 3.239923365999857s: None 2024-05-11T01:31:05.222520307Z [2024-05-11 01:31:05,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5553e8a5-77fc-4b86-b95d-39706251565f] succeeded in 4.203706000000238s: None 2024-05-11T01:32:00.909367353Z [2024-05-11 01:32:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3de35689-cae3-450b-b599-eb1830d09a48] received 2024-05-11T01:32:00.916113379Z [2024-05-11 01:32:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c07750a5-c84c-415e-8023-caafa057fde2] received 2024-05-11T01:32:00.923685503Z [2024-05-11 01:32:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2c82821-02a7-4711-b85a-897b1389a335] received 2024-05-11T01:32:00.926061190Z [2024-05-11 01:32:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8a8a5e6-1c0a-414a-872f-788e437be86b] received 2024-05-11T01:32:00.929381300Z [2024-05-11 01:32:00,928: INFO/ForkPoolWorker-16] [c07750a5-c84c-415e-8023-caafa057fde2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:32:00.934432069Z [2024-05-11 01:32:00,933: INFO/ForkPoolWorker-15] [3de35689-cae3-450b-b599-eb1830d09a48] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:32:00.935107558Z [2024-05-11 01:32:00,934: INFO/ForkPoolWorker-2] [c8a8a5e6-1c0a-414a-872f-788e437be86b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:32:00.935981929Z [2024-05-11 01:32:00,935: INFO/ForkPoolWorker-1] [f2c82821-02a7-4711-b85a-897b1389a335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:32:01.310959858Z [2024-05-11 01:32:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:32:01.443061301Z [2024-05-11 01:32:01,439: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:32:01.444278345Z [2024-05-11 01:32:01,441: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:32:01.490037980Z [2024-05-11 01:32:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:32:01.614930563Z [2024-05-11 01:32:01,614: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:32:01.619645184Z [2024-05-11 01:32:01,619: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:32:01.652090536Z [2024-05-11 01:32:01,651: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:32:01.653332786Z [2024-05-11 01:32:01,653: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:32:01.653476517Z [2024-05-11 01:32:01,653: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:32:01.653576932Z [2024-05-11 01:32:01,653: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:32:01.653827158Z [2024-05-11 01:32:01,653: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:32:01.761153547Z [2024-05-11 01:32:01,760: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:32:01.788193055Z [2024-05-11 01:32:01,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:32:02.436766738Z [2024-05-11 01:32:02,436: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3de35689-cae3-450b-b599-eb1830d09a48] succeeded in 1.5233074799998576s: None 2024-05-11T01:32:02.451237096Z [2024-05-11 01:32:02,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c8a8a5e6-1c0a-414a-872f-788e437be86b] succeeded in 1.5228900210004213s: None 2024-05-11T01:32:02.647529190Z [2024-05-11 01:32:02,647: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:32:02.653561556Z [2024-05-11 01:32:02,652: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:32:02.679436856Z [2024-05-11 01:32:02,679: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:32:02.681306523Z [2024-05-11 01:32:02,681: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:32:02.681480159Z [2024-05-11 01:32:02,681: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:32:02.681772130Z [2024-05-11 01:32:02,681: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:32:02.682045658Z [2024-05-11 01:32:02,681: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:32:02.682581973Z [2024-05-11 01:32:02,682: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:32:02.682770864Z [2024-05-11 01:32:02,682: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:32:02.779192294Z [2024-05-11 01:32:02,778: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:32:02.851512193Z [2024-05-11 01:32:02,851: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:32:02.854826595Z [2024-05-11 01:32:02,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:32:02.873780646Z [2024-05-11 01:32:02,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:32:02.875456631Z [2024-05-11 01:32:02,875: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:32:02.875639519Z [2024-05-11 01:32:02,875: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:32:02.875916924Z [2024-05-11 01:32:02,875: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:32:02.876068589Z [2024-05-11 01:32:02,875: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:32:02.876476047Z [2024-05-11 01:32:02,876: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:32:02.876716296Z [2024-05-11 01:32:02,876: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:32:02.964674371Z [2024-05-11 01:32:02,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:32:04.970170453Z [2024-05-11 01:32:04,969: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2c82821-02a7-4711-b85a-897b1389a335] succeeded in 4.044839912001407s: None 2024-05-11T01:32:06.928871890Z [2024-05-11 01:32:06,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c07750a5-c84c-415e-8023-caafa057fde2] succeeded in 6.010088282000652s: None 2024-05-11T01:33:00.686472313Z [2024-05-11 01:33:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3ca245a-cdc4-4c8f-b6e5-8b3de70ec2b5] received 2024-05-11T01:33:00.696394730Z [2024-05-11 01:33:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[367e0b4e-ccde-4261-98a7-d134b60ee5cd] received 2024-05-11T01:33:00.696829638Z [2024-05-11 01:33:00,696: INFO/ForkPoolWorker-15] [f3ca245a-cdc4-4c8f-b6e5-8b3de70ec2b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:33:00.702461775Z [2024-05-11 01:33:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4f8da22-48d0-4fd0-b7ab-968692b5a7b4] received 2024-05-11T01:33:00.703853097Z [2024-05-11 01:33:00,703: INFO/ForkPoolWorker-16] [367e0b4e-ccde-4261-98a7-d134b60ee5cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:33:00.709943259Z [2024-05-11 01:33:00,709: INFO/ForkPoolWorker-1] [d4f8da22-48d0-4fd0-b7ab-968692b5a7b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:33:01.040143239Z [2024-05-11 01:33:01,025: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:33:01.049967979Z [2024-05-11 01:33:01,043: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:33:01.066052963Z [2024-05-11 01:33:01,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:33:01.295106263Z [2024-05-11 01:33:01,294: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:33:01.299214097Z [2024-05-11 01:33:01,298: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:33:01.326829582Z [2024-05-11 01:33:01,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:33:01.330733210Z [2024-05-11 01:33:01,330: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:33:01.330985333Z [2024-05-11 01:33:01,330: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:33:01.331082980Z [2024-05-11 01:33:01,330: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:33:01.331615229Z [2024-05-11 01:33:01,331: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:33:01.440528111Z [2024-05-11 01:33:01,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:33:02.026833031Z [2024-05-11 01:33:02,026: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4f8da22-48d0-4fd0-b7ab-968692b5a7b4] succeeded in 1.3216637539990188s: None 2024-05-11T01:33:02.234795349Z [2024-05-11 01:33:02,234: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:33:02.237993937Z [2024-05-11 01:33:02,237: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:33:02.256013231Z [2024-05-11 01:33:02,255: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:33:02.257328635Z [2024-05-11 01:33:02,257: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:33:02.257471221Z [2024-05-11 01:33:02,257: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:33:02.257603615Z [2024-05-11 01:33:02,257: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:33:02.257668703Z [2024-05-11 01:33:02,257: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:33:02.258055333Z [2024-05-11 01:33:02,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:33:02.258395804Z [2024-05-11 01:33:02,258: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:33:02.344880156Z [2024-05-11 01:33:02,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:33:02.348076791Z [2024-05-11 01:33:02,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:33:02.362235084Z [2024-05-11 01:33:02,361: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:33:02.364845110Z [2024-05-11 01:33:02,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:33:02.366039127Z [2024-05-11 01:33:02,365: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:33:02.366064755Z [2024-05-11 01:33:02,365: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:33:02.366248579Z [2024-05-11 01:33:02,366: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:33:02.366295716Z [2024-05-11 01:33:02,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:33:02.366582844Z [2024-05-11 01:33:02,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:33:02.366590875Z [2024-05-11 01:33:02,366: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:33:02.454731654Z [2024-05-11 01:33:02,454: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:33:03.994866331Z [2024-05-11 01:33:03,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[367e0b4e-ccde-4261-98a7-d134b60ee5cd] succeeded in 3.296835597999234s: None 2024-05-11T01:33:04.391975788Z [2024-05-11 01:33:04,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3ca245a-cdc4-4c8f-b6e5-8b3de70ec2b5] succeeded in 3.7034712439999566s: None 2024-05-11T01:34:00.542830430Z [2024-05-11 01:34:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d67e3202-dbb4-431a-a791-8089b586959b] received 2024-05-11T01:34:00.545030162Z [2024-05-11 01:34:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f827d439-4898-4b5b-9dab-05b6bdb73d2d] received 2024-05-11T01:34:00.552576077Z [2024-05-11 01:34:00,552: INFO/ForkPoolWorker-16] [f827d439-4898-4b5b-9dab-05b6bdb73d2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:34:00.554790254Z [2024-05-11 01:34:00,554: INFO/ForkPoolWorker-15] [d67e3202-dbb4-431a-a791-8089b586959b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:34:00.568194422Z [2024-05-11 01:34:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03164278-903c-4c11-a52c-52c33be3cf0c] received 2024-05-11T01:34:00.571985084Z [2024-05-11 01:34:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb16bc66-64dd-49c4-ac98-4bf82f53dd24] received 2024-05-11T01:34:00.577811840Z [2024-05-11 01:34:00,577: INFO/ForkPoolWorker-1] [03164278-903c-4c11-a52c-52c33be3cf0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:34:00.592498500Z [2024-05-11 01:34:00,592: INFO/ForkPoolWorker-2] [eb16bc66-64dd-49c4-ac98-4bf82f53dd24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:34:00.869665305Z [2024-05-11 01:34:00,866: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:34:00.894070416Z [2024-05-11 01:34:00,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:34:01.013111881Z [2024-05-11 01:34:01,009: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:34:01.026084701Z [2024-05-11 01:34:01,009: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:34:01.216567112Z [2024-05-11 01:34:01,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:34:01.344760690Z [2024-05-11 01:34:01,344: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:34:01.353126076Z [2024-05-11 01:34:01,352: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:34:01.409729251Z [2024-05-11 01:34:01,409: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:34:01.413977583Z [2024-05-11 01:34:01,413: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:34:01.414115281Z [2024-05-11 01:34:01,413: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:34:01.414191195Z [2024-05-11 01:34:01,414: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:34:01.414445732Z [2024-05-11 01:34:01,414: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:34:01.522728026Z [2024-05-11 01:34:01,522: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:34:01.822959371Z [2024-05-11 01:34:01,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d67e3202-dbb4-431a-a791-8089b586959b] succeeded in 1.2772881830005645s: None 2024-05-11T01:34:02.134755904Z [2024-05-11 01:34:02,134: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb16bc66-64dd-49c4-ac98-4bf82f53dd24] succeeded in 1.5552535059996444s: None 2024-05-11T01:34:02.383419759Z [2024-05-11 01:34:02,383: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:34:02.386715269Z [2024-05-11 01:34:02,386: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:34:02.406350214Z [2024-05-11 01:34:02,406: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:34:02.407620023Z [2024-05-11 01:34:02,407: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:34:02.407741605Z [2024-05-11 01:34:02,407: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:34:02.407915821Z [2024-05-11 01:34:02,407: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:34:02.408034749Z [2024-05-11 01:34:02,407: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:34:02.408329104Z [2024-05-11 01:34:02,408: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:34:02.408467449Z [2024-05-11 01:34:02,408: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:34:02.496915779Z [2024-05-11 01:34:02,496: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:34:02.504829255Z [2024-05-11 01:34:02,504: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:34:02.508700754Z [2024-05-11 01:34:02,508: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:34:02.526660091Z [2024-05-11 01:34:02,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:34:02.527793069Z [2024-05-11 01:34:02,527: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:34:02.527855539Z [2024-05-11 01:34:02,527: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:34:02.528036099Z [2024-05-11 01:34:02,527: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:34:02.528084352Z [2024-05-11 01:34:02,528: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:34:02.528366199Z [2024-05-11 01:34:02,528: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:34:02.528452017Z [2024-05-11 01:34:02,528: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:34:02.612085015Z [2024-05-11 01:34:02,611: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:34:05.222169686Z [2024-05-11 01:34:05,221: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03164278-903c-4c11-a52c-52c33be3cf0c] succeeded in 4.652269424001133s: None 2024-05-11T01:34:05.668175777Z [2024-05-11 01:34:05,667: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f827d439-4898-4b5b-9dab-05b6bdb73d2d] succeeded in 5.120899416000611s: None 2024-05-11T01:35:00.517328920Z [2024-05-11 01:35:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb4033a6-9db0-400b-81a4-3302e2d15eef] received 2024-05-11T01:35:00.518779622Z [2024-05-11 01:35:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[461836cf-b7ea-481d-8470-f5600e44fc08] received 2024-05-11T01:35:00.524375630Z [2024-05-11 01:35:00,524: INFO/ForkPoolWorker-15] [bb4033a6-9db0-400b-81a4-3302e2d15eef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:00.525821277Z [2024-05-11 01:35:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57d9abaf-d768-4bce-bf87-4ab03b5efb3f] received 2024-05-11T01:35:00.528671407Z [2024-05-11 01:35:00,528: INFO/ForkPoolWorker-16] [461836cf-b7ea-481d-8470-f5600e44fc08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:35:00.529336246Z [2024-05-11 01:35:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f6b643f-4f3d-4f5a-8d0d-872239d0decf] received 2024-05-11T01:35:00.537110625Z [2024-05-11 01:35:00,536: INFO/ForkPoolWorker-2] [5f6b643f-4f3d-4f5a-8d0d-872239d0decf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:35:00.541649664Z [2024-05-11 01:35:00,541: INFO/ForkPoolWorker-1] [57d9abaf-d768-4bce-bf87-4ab03b5efb3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:35:00.862949213Z [2024-05-11 01:35:00,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:35:00.869468935Z [2024-05-11 01:35:00,866: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:35:00.944340068Z [2024-05-11 01:35:00,940: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:35:00.963796869Z [2024-05-11 01:35:00,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:35:01.129589945Z [2024-05-11 01:35:01,129: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:35:01.133536355Z [2024-05-11 01:35:01,133: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:01.220328724Z [2024-05-11 01:35:01,220: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:35:01.221656177Z [2024-05-11 01:35:01,221: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:35:01.221802058Z [2024-05-11 01:35:01,221: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:35:01.221843150Z [2024-05-11 01:35:01,221: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:35:01.222104437Z [2024-05-11 01:35:01,221: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:35:01.319162415Z [2024-05-11 01:35:01,318: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:01.924103509Z [2024-05-11 01:35:01,923: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57d9abaf-d768-4bce-bf87-4ab03b5efb3f] succeeded in 1.3948086759992293s: None 2024-05-11T01:35:02.349853781Z [2024-05-11 01:35:02,349: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:35:02.353734151Z [2024-05-11 01:35:02,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:02.377847128Z [2024-05-11 01:35:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:35:02.383000630Z [2024-05-11 01:35:02,382: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:02.383222112Z [2024-05-11 01:35:02,383: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:02.383355244Z [2024-05-11 01:35:02,383: INFO/ForkPoolWorker-16] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:02.383571470Z [2024-05-11 01:35:02,383: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:02.383706805Z [2024-05-11 01:35:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:35:02.384097981Z [2024-05-11 01:35:02,383: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:35:02.384259551Z [2024-05-11 01:35:02,384: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:02.389365921Z [2024-05-11 01:35:02,389: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:35:02.395395895Z [2024-05-11 01:35:02,395: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:35:02.398860177Z [2024-05-11 01:35:02,398: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:02.419546688Z [2024-05-11 01:35:02,419: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:35:02.420999522Z [2024-05-11 01:35:02,420: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:02.421055870Z [2024-05-11 01:35:02,420: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:02.421228901Z [2024-05-11 01:35:02,421: INFO/ForkPoolWorker-2] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:02.421401743Z [2024-05-11 01:35:02,421: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:02.421463275Z [2024-05-11 01:35:02,421: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:35:02.422418625Z [2024-05-11 01:35:02,422: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:35:02.422469713Z [2024-05-11 01:35:02,422: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:02.427062079Z [2024-05-11 01:35:02,426: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:35:02.506521190Z [2024-05-11 01:35:02,506: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:02.517795877Z [2024-05-11 01:35:02,517: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:02.528863208Z [2024-05-11 01:35:02,528: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:35:02.532790731Z [2024-05-11 01:35:02,532: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:02.553448936Z [2024-05-11 01:35:02,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:35:02.555201577Z [2024-05-11 01:35:02,554: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:02.555218853Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:02.555239603Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:02.555414733Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:02.555465950Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:35:02.555728389Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:02.555791397Z [2024-05-11 01:35:02,555: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:02.563883115Z [2024-05-11 01:35:02,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:02.671844336Z [2024-05-11 01:35:02,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:03.258353779Z [2024-05-11 01:35:03,257: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb4033a6-9db0-400b-81a4-3302e2d15eef] succeeded in 2.738043502000437s: None 2024-05-11T01:35:03.376447674Z [2024-05-11 01:35:03,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77ac1bc1-fee5-48bb-ae5b-6820005ed131] received 2024-05-11T01:35:03.390509495Z [2024-05-11 01:35:03,390: INFO/ForkPoolWorker-15] [77ac1bc1-fee5-48bb-ae5b-6820005ed131] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:03.711218729Z [2024-05-11 01:35:03,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:35:04.810111232Z [2024-05-11 01:35:04,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:35:04.813133368Z [2024-05-11 01:35:04,812: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:04.837224946Z [2024-05-11 01:35:04,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:35:04.838531733Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:04.838547993Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:04.838596057Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:04.838690466Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:04.838772631Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:35:04.838980007Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:04.838994947Z [2024-05-11 01:35:04,838: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:04.844855715Z [2024-05-11 01:35:04,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:04.932963788Z [2024-05-11 01:35:04,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:05.057827092Z [2024-05-11 01:35:05,057: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[461836cf-b7ea-481d-8470-f5600e44fc08] succeeded in 4.5350838269987435s: None 2024-05-11T01:35:05.594381715Z [2024-05-11 01:35:05,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77ac1bc1-fee5-48bb-ae5b-6820005ed131] succeeded in 2.2101820850002696s: None 2024-05-11T01:35:05.804454727Z [2024-05-11 01:35:05,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e3679a0-4d79-4fe4-846b-d46ec886f0c5] received 2024-05-11T01:35:05.815159649Z [2024-05-11 01:35:05,810: INFO/ForkPoolWorker-15] [4e3679a0-4d79-4fe4-846b-d46ec886f0c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:35:06.114464056Z [2024-05-11 01:35:06,111: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:35:06.343236772Z [2024-05-11 01:35:06,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5f6b643f-4f3d-4f5a-8d0d-872239d0decf] succeeded in 5.81209914899955s: None 2024-05-11T01:35:07.317364640Z [2024-05-11 01:35:07,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:35:07.320670013Z [2024-05-11 01:35:07,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:07.341417540Z [2024-05-11 01:35:07,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:35:07.343372067Z [2024-05-11 01:35:07,343: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:07.343568929Z [2024-05-11 01:35:07,343: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:07.343701012Z [2024-05-11 01:35:07,343: INFO/ForkPoolWorker-15] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:07.343956257Z [2024-05-11 01:35:07,343: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:07.344302653Z [2024-05-11 01:35:07,344: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:35:07.344974756Z [2024-05-11 01:35:07,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:07.345349828Z [2024-05-11 01:35:07,345: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:07.352312207Z [2024-05-11 01:35:07,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:07.417431534Z [2024-05-11 01:35:07,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:07.967894430Z [2024-05-11 01:35:07,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7e66de0-9411-40b2-a8ce-1883043f6794] received 2024-05-11T01:35:07.974852155Z [2024-05-11 01:35:07,974: INFO/ForkPoolWorker-16] [f7e66de0-9411-40b2-a8ce-1883043f6794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:35:08.077790996Z [2024-05-11 01:35:08,077: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e3679a0-4d79-4fe4-846b-d46ec886f0c5] succeeded in 2.2716503480005485s: None 2024-05-11T01:35:08.273046409Z [2024-05-11 01:35:08,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:35:09.418834355Z [2024-05-11 01:35:09,418: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:35:09.422232319Z [2024-05-11 01:35:09,421: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:35:09.448025069Z [2024-05-11 01:35:09,447: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:35:09.450917913Z [2024-05-11 01:35:09,450: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:35:09.451234864Z [2024-05-11 01:35:09,450: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:35:09.451494856Z [2024-05-11 01:35:09,451: INFO/ForkPoolWorker-16] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:35:09.452032718Z [2024-05-11 01:35:09,451: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:35:09.452552233Z [2024-05-11 01:35:09,452: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:35:09.453501724Z [2024-05-11 01:35:09,453: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:09.453929650Z [2024-05-11 01:35:09,453: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:35:09.466848528Z [2024-05-11 01:35:09,466: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:35:09.556440325Z [2024-05-11 01:35:09,556: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:35:10.261682183Z [2024-05-11 01:35:10,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7e66de0-9411-40b2-a8ce-1883043f6794] succeeded in 2.291192748998583s: None 2024-05-11T01:36:01.046084193Z [2024-05-11 01:36:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15a566e1-bed9-46f2-bd02-83c0c9015afd] received 2024-05-11T01:36:01.054250378Z [2024-05-11 01:36:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa222b34-3a69-412c-91fa-2aa460b16c19] received 2024-05-11T01:36:01.070986129Z [2024-05-11 01:36:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[399e6d50-cfd8-4dce-ae8f-5a6189d1f209] received 2024-05-11T01:36:01.080885653Z [2024-05-11 01:36:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9101584-eb97-4cf4-a799-bf98a5d8bbc1] received 2024-05-11T01:36:01.081478967Z [2024-05-11 01:36:01,071: INFO/ForkPoolWorker-1] [399e6d50-cfd8-4dce-ae8f-5a6189d1f209] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:36:01.081487643Z [2024-05-11 01:36:01,072: INFO/ForkPoolWorker-16] [fa222b34-3a69-412c-91fa-2aa460b16c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:36:01.081491518Z [2024-05-11 01:36:01,074: INFO/ForkPoolWorker-15] [15a566e1-bed9-46f2-bd02-83c0c9015afd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:36:01.092581596Z [2024-05-11 01:36:01,090: INFO/ForkPoolWorker-2] [e9101584-eb97-4cf4-a799-bf98a5d8bbc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:36:01.421794440Z [2024-05-11 01:36:01,418: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:36:01.537902527Z [2024-05-11 01:36:01,532: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:36:01.552639940Z [2024-05-11 01:36:01,549: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:36:01.593121470Z [2024-05-11 01:36:01,592: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:36:01.597205381Z [2024-05-11 01:36:01,596: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:36:01.622268592Z [2024-05-11 01:36:01,621: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:36:01.623129167Z [2024-05-11 01:36:01,622: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:36:01.623242237Z [2024-05-11 01:36:01,623: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:36:01.623312215Z [2024-05-11 01:36:01,623: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:36:01.623549531Z [2024-05-11 01:36:01,623: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:36:01.711202265Z [2024-05-11 01:36:01,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:36:01.728334779Z [2024-05-11 01:36:01,728: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:36:01.949374690Z [2024-05-11 01:36:01,948: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:36:02.363752673Z [2024-05-11 01:36:02,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa222b34-3a69-412c-91fa-2aa460b16c19] succeeded in 1.3082341359986458s: None 2024-05-11T01:36:02.603904611Z [2024-05-11 01:36:02,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[399e6d50-cfd8-4dce-ae8f-5a6189d1f209] succeeded in 1.538143970999954s: None 2024-05-11T01:36:02.949249555Z [2024-05-11 01:36:02,948: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:36:02.952646553Z [2024-05-11 01:36:02,952: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:36:02.980410198Z [2024-05-11 01:36:02,980: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:36:02.981845203Z [2024-05-11 01:36:02,981: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:36:02.982073958Z [2024-05-11 01:36:02,981: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:36:02.982244988Z [2024-05-11 01:36:02,982: INFO/ForkPoolWorker-2] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:36:02.982468974Z [2024-05-11 01:36:02,982: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:36:02.982665906Z [2024-05-11 01:36:02,982: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:36:02.982998102Z [2024-05-11 01:36:02,982: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:36:02.983498025Z [2024-05-11 01:36:02,983: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:36:02.988028255Z [2024-05-11 01:36:02,987: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:36:03.014232821Z [2024-05-11 01:36:03,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:36:03.017327933Z [2024-05-11 01:36:03,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:36:03.044519208Z [2024-05-11 01:36:03,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:36:03.045620775Z [2024-05-11 01:36:03,045: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:36:03.045764680Z [2024-05-11 01:36:03,045: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:36:03.045850052Z [2024-05-11 01:36:03,045: INFO/ForkPoolWorker-15] Read VIM 809d4a7a-16ea-42bb-9a2e-fab57c28ea6c (k8s07_dummy) 2024-05-11T01:36:03.046116683Z [2024-05-11 01:36:03,045: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '809d4a7a-16ea-42bb-9a2e-fab57c28ea6c', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-11T01:36:03.046255009Z [2024-05-11 01:36:03,046: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:36:03.046548977Z [2024-05-11 01:36:03,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:36:03.046704465Z [2024-05-11 01:36:03,046: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:36:03.051927581Z [2024-05-11 01:36:03,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:36:03.077971974Z [2024-05-11 01:36:03,077: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:36:03.121117659Z [2024-05-11 01:36:03,120: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:36:04.840947205Z [2024-05-11 01:36:04,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15a566e1-bed9-46f2-bd02-83c0c9015afd] succeeded in 3.7760772980000183s: None 2024-05-11T01:36:05.361023763Z [2024-05-11 01:36:05,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9101584-eb97-4cf4-a799-bf98a5d8bbc1] succeeded in 4.285350392001419s: None 2024-05-11T01:37:01.039390137Z [2024-05-11 01:37:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[726fdcd0-7a6d-4492-b138-612c3d4cfd27] received 2024-05-11T01:37:01.045999469Z [2024-05-11 01:37:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef0b37c1-e06e-4c77-8879-37f270925587] received 2024-05-11T01:37:01.046023431Z [2024-05-11 01:37:01,042: INFO/ForkPoolWorker-15] [726fdcd0-7a6d-4492-b138-612c3d4cfd27] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:37:01.048774238Z [2024-05-11 01:37:01,047: INFO/ForkPoolWorker-16] [ef0b37c1-e06e-4c77-8879-37f270925587] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:37:01.048811598Z [2024-05-11 01:37:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ece501d6-72c0-43e8-a921-20256c6fb39c] received 2024-05-11T01:37:01.053605868Z [2024-05-11 01:37:01,053: INFO/ForkPoolWorker-1] [ece501d6-72c0-43e8-a921-20256c6fb39c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:37:01.414382815Z [2024-05-11 01:37:01,409: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:37:01.422273468Z [2024-05-11 01:37:01,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:37:01.424533144Z [2024-05-11 01:37:01,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:37:01.606305528Z [2024-05-11 01:37:01,605: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:37:01.610445384Z [2024-05-11 01:37:01,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:37:01.630177115Z [2024-05-11 01:37:01,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:37:01.631236666Z [2024-05-11 01:37:01,631: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:37:01.631286492Z [2024-05-11 01:37:01,631: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:37:01.631351312Z [2024-05-11 01:37:01,631: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:37:01.631810229Z [2024-05-11 01:37:01,631: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:37:01.765755744Z [2024-05-11 01:37:01,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:37:02.387544061Z [2024-05-11 01:37:02,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[726fdcd0-7a6d-4492-b138-612c3d4cfd27] succeeded in 1.350959839999632s: None 2024-05-11T01:37:02.552838991Z [2024-05-11 01:37:02,552: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:37:02.559543350Z [2024-05-11 01:37:02,559: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:37:02.610556392Z [2024-05-11 01:37:02,610: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:37:02.614200121Z [2024-05-11 01:37:02,613: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:37:02.614224456Z [2024-05-11 01:37:02,614: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:37:02.614377859Z [2024-05-11 01:37:02,614: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:37:02.614494456Z [2024-05-11 01:37:02,614: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:37:02.614780744Z [2024-05-11 01:37:02,614: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:37:02.614840744Z [2024-05-11 01:37:02,614: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:37:02.647375227Z [2024-05-11 01:37:02,647: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:37:02.650810360Z [2024-05-11 01:37:02,650: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:37:02.683198927Z [2024-05-11 01:37:02,682: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:37:02.684767475Z [2024-05-11 01:37:02,684: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:37:02.684808479Z [2024-05-11 01:37:02,684: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:37:02.685033493Z [2024-05-11 01:37:02,684: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:37:02.685073495Z [2024-05-11 01:37:02,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:37:02.685467860Z [2024-05-11 01:37:02,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:37:02.685482280Z [2024-05-11 01:37:02,685: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:37:02.723588769Z [2024-05-11 01:37:02,723: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:37:02.803843727Z [2024-05-11 01:37:02,803: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:37:04.666872183Z [2024-05-11 01:37:04,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ece501d6-72c0-43e8-a921-20256c6fb39c] succeeded in 3.6175620879985217s: None 2024-05-11T01:37:04.977560927Z [2024-05-11 01:37:04,977: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef0b37c1-e06e-4c77-8879-37f270925587] succeeded in 3.934379681999417s: None 2024-05-11T01:38:01.148882073Z [2024-05-11 01:38:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af7e9dfb-190e-4d3e-8a34-a3a0b40f53a6] received 2024-05-11T01:38:01.167801277Z [2024-05-11 01:38:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e860f01c-0215-42fb-9dae-496bbb9244de] received 2024-05-11T01:38:01.172580149Z [2024-05-11 01:38:01,172: INFO/ForkPoolWorker-15] [af7e9dfb-190e-4d3e-8a34-a3a0b40f53a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:38:01.175527402Z [2024-05-11 01:38:01,175: INFO/ForkPoolWorker-16] [e860f01c-0215-42fb-9dae-496bbb9244de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:38:01.183851076Z [2024-05-11 01:38:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cab38248-06fa-442d-8040-03f3cebac247] received 2024-05-11T01:38:01.186486064Z [2024-05-11 01:38:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b74adfb4-f261-4522-b98f-1c725e080f83] received 2024-05-11T01:38:01.195875720Z [2024-05-11 01:38:01,195: INFO/ForkPoolWorker-2] [b74adfb4-f261-4522-b98f-1c725e080f83] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:38:01.218864341Z [2024-05-11 01:38:01,218: INFO/ForkPoolWorker-1] [cab38248-06fa-442d-8040-03f3cebac247] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:38:01.515220036Z [2024-05-11 01:38:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:38:01.536025787Z [2024-05-11 01:38:01,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:38:01.661690307Z [2024-05-11 01:38:01,657: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:38:01.681453568Z [2024-05-11 01:38:01,681: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:38:01.685379845Z [2024-05-11 01:38:01,684: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:38:01.691413494Z [2024-05-11 01:38:01,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:38:01.705006995Z [2024-05-11 01:38:01,704: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:38:01.706130096Z [2024-05-11 01:38:01,705: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:38:01.706186413Z [2024-05-11 01:38:01,706: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:38:01.706252298Z [2024-05-11 01:38:01,706: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:38:01.706403650Z [2024-05-11 01:38:01,706: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:38:01.805231955Z [2024-05-11 01:38:01,804: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:38:01.959768573Z [2024-05-11 01:38:01,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:38:02.398101601Z [2024-05-11 01:38:02,397: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b74adfb4-f261-4522-b98f-1c725e080f83] succeeded in 1.2098834900007205s: None 2024-05-11T01:38:02.557558752Z [2024-05-11 01:38:02,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af7e9dfb-190e-4d3e-8a34-a3a0b40f53a6] succeeded in 1.3946841489996586s: None 2024-05-11T01:38:02.759670588Z [2024-05-11 01:38:02,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:38:02.763096865Z [2024-05-11 01:38:02,762: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:38:02.797049236Z [2024-05-11 01:38:02,796: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:38:02.802301930Z [2024-05-11 01:38:02,802: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:38:02.802343882Z [2024-05-11 01:38:02,802: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:38:02.802733316Z [2024-05-11 01:38:02,802: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:38:02.802799950Z [2024-05-11 01:38:02,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:38:02.803073027Z [2024-05-11 01:38:02,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:38:02.803135666Z [2024-05-11 01:38:02,803: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:38:02.883302623Z [2024-05-11 01:38:02,883: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:38:02.933477332Z [2024-05-11 01:38:02,933: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:38:02.936649036Z [2024-05-11 01:38:02,936: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:38:02.954740182Z [2024-05-11 01:38:02,954: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:38:02.956034642Z [2024-05-11 01:38:02,955: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:38:02.956195204Z [2024-05-11 01:38:02,955: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:38:02.956443223Z [2024-05-11 01:38:02,956: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:38:02.956454600Z [2024-05-11 01:38:02,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:38:02.956995797Z [2024-05-11 01:38:02,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:38:02.957172214Z [2024-05-11 01:38:02,956: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:38:03.055863695Z [2024-05-11 01:38:03,055: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:38:05.106151851Z [2024-05-11 01:38:05,105: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cab38248-06fa-442d-8040-03f3cebac247] succeeded in 3.906616104999557s: None 2024-05-11T01:38:05.423036605Z [2024-05-11 01:38:05,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e860f01c-0215-42fb-9dae-496bbb9244de] succeeded in 4.252938473999166s: None 2024-05-11T01:39:00.470539054Z [2024-05-11 01:39:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93334373-b895-4878-aa78-e2a261ff898f] received 2024-05-11T01:39:00.481302196Z [2024-05-11 01:39:00,481: INFO/ForkPoolWorker-15] [93334373-b895-4878-aa78-e2a261ff898f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:39:00.482365868Z [2024-05-11 01:39:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93de6777-4fe7-4f82-a860-7bce6c9c727a] received 2024-05-11T01:39:00.489946622Z [2024-05-11 01:39:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ad07706-2a52-448b-846c-9e3505362cfc] received 2024-05-11T01:39:00.496752449Z [2024-05-11 01:39:00,496: INFO/ForkPoolWorker-16] [93de6777-4fe7-4f82-a860-7bce6c9c727a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:39:00.507891368Z [2024-05-11 01:39:00,507: INFO/ForkPoolWorker-1] [6ad07706-2a52-448b-846c-9e3505362cfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:39:00.801053217Z [2024-05-11 01:39:00,797: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:39:00.835175908Z [2024-05-11 01:39:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:39:00.847074189Z [2024-05-11 01:39:00,843: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:39:01.006474578Z [2024-05-11 01:39:01,006: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:39:01.014221401Z [2024-05-11 01:39:01,013: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:39:01.098051401Z [2024-05-11 01:39:01,095: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:39:01.103169164Z [2024-05-11 01:39:01,102: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:39:01.103235696Z [2024-05-11 01:39:01,103: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:39:01.103320928Z [2024-05-11 01:39:01,103: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:39:01.103599240Z [2024-05-11 01:39:01,103: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:39:01.392993853Z [2024-05-11 01:39:01,392: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:39:01.998855008Z [2024-05-11 01:39:01,998: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93de6777-4fe7-4f82-a860-7bce6c9c727a] succeeded in 1.5119390360014222s: None 2024-05-11T01:39:02.000760717Z [2024-05-11 01:39:02,000: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:39:02.004011183Z [2024-05-11 01:39:02,003: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:39:02.020427135Z [2024-05-11 01:39:02,020: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:39:02.021783304Z [2024-05-11 01:39:02,021: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:39:02.021984358Z [2024-05-11 01:39:02,021: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:39:02.022191401Z [2024-05-11 01:39:02,022: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:39:02.022326482Z [2024-05-11 01:39:02,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:39:02.022656896Z [2024-05-11 01:39:02,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:39:02.022813100Z [2024-05-11 01:39:02,022: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:39:02.032699315Z [2024-05-11 01:39:02,032: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:39:02.036097055Z [2024-05-11 01:39:02,035: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:39:02.064076146Z [2024-05-11 01:39:02,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:39:02.065811829Z [2024-05-11 01:39:02,065: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:39:02.066007188Z [2024-05-11 01:39:02,065: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:39:02.066245772Z [2024-05-11 01:39:02,065: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:39:02.066320469Z [2024-05-11 01:39:02,066: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:39:02.068116948Z [2024-05-11 01:39:02,067: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:39:02.068447047Z [2024-05-11 01:39:02,067: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:39:02.115707515Z [2024-05-11 01:39:02,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:39:02.200755775Z [2024-05-11 01:39:02,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:39:03.595182629Z [2024-05-11 01:39:03,594: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ad07706-2a52-448b-846c-9e3505362cfc] succeeded in 3.0999877840004046s: None 2024-05-11T01:39:04.043902404Z [2024-05-11 01:39:04,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93334373-b895-4878-aa78-e2a261ff898f] succeeded in 3.56940622699949s: None 2024-05-11T01:40:00.787968431Z [2024-05-11 01:40:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b64f6bf0-c701-4be6-a79b-2552d1e2684b] received 2024-05-11T01:40:00.794749637Z [2024-05-11 01:40:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7992516d-5cbf-4032-9079-0a2c2b6bd332] received 2024-05-11T01:40:00.798359256Z [2024-05-11 01:40:00,798: INFO/ForkPoolWorker-15] [b64f6bf0-c701-4be6-a79b-2552d1e2684b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:40:00.799517800Z [2024-05-11 01:40:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc3c30b7-3105-4c60-ae2f-a067ef249f3d] received 2024-05-11T01:40:00.802432932Z [2024-05-11 01:40:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b43ff48-7b34-49fb-8091-86937d656ceb] received 2024-05-11T01:40:00.805040039Z [2024-05-11 01:40:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fee0065-d1db-467b-b4eb-464f73d9351f] received 2024-05-11T01:40:00.809136810Z [2024-05-11 01:40:00,808: INFO/ForkPoolWorker-16] [7992516d-5cbf-4032-9079-0a2c2b6bd332] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:40:00.810622074Z [2024-05-11 01:40:00,810: INFO/ForkPoolWorker-1] [cc3c30b7-3105-4c60-ae2f-a067ef249f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:00.811509923Z [2024-05-11 01:40:00,811: INFO/ForkPoolWorker-2] [0b43ff48-7b34-49fb-8091-86937d656ceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:40:00.817727274Z [2024-05-11 01:40:00,817: INFO/ForkPoolWorker-3] [3fee0065-d1db-467b-b4eb-464f73d9351f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:40:01.256806208Z [2024-05-11 01:40:01,253: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:40:01.275046208Z [2024-05-11 01:40:01,263: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:40:01.319379100Z [2024-05-11 01:40:01,311: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:40:01.327415193Z [2024-05-11 01:40:01,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:40:01.338927063Z [2024-05-11 01:40:01,335: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:40:01.426003744Z [2024-05-11 01:40:01,425: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:40:01.430191533Z [2024-05-11 01:40:01,429: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:01.459447755Z [2024-05-11 01:40:01,459: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:40:01.461806594Z [2024-05-11 01:40:01,461: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:40:01.462252124Z [2024-05-11 01:40:01,462: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:40:01.462336818Z [2024-05-11 01:40:01,462: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:40:01.462603754Z [2024-05-11 01:40:01,462: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:40:01.656960054Z [2024-05-11 01:40:01,655: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:01.663788377Z [2024-05-11 01:40:01,663: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:02.305713886Z [2024-05-11 01:40:02,305: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b43ff48-7b34-49fb-8091-86937d656ceb] succeeded in 1.501085552999939s: None 2024-05-11T01:40:02.350412677Z [2024-05-11 01:40:02,350: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3fee0065-d1db-467b-b4eb-464f73d9351f] succeeded in 1.5425372480003716s: None 2024-05-11T01:40:02.882466901Z [2024-05-11 01:40:02,882: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:40:02.882691308Z [2024-05-11 01:40:02,882: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:40:02.885729255Z [2024-05-11 01:40:02,885: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:02.885836393Z [2024-05-11 01:40:02,885: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:02.901020393Z [2024-05-11 01:40:02,900: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:40:02.904745305Z [2024-05-11 01:40:02,904: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:02.904816388Z [2024-05-11 01:40:02,904: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:02.905011080Z [2024-05-11 01:40:02,904: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:02.905144003Z [2024-05-11 01:40:02,904: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:40:02.905472458Z [2024-05-11 01:40:02,905: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:40:02.905559242Z [2024-05-11 01:40:02,905: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:02.908260923Z [2024-05-11 01:40:02,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:40:02.914900992Z [2024-05-11 01:40:02,914: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:02.914918291Z [2024-05-11 01:40:02,914: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:02.915003469Z [2024-05-11 01:40:02,914: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:02.915044163Z [2024-05-11 01:40:02,914: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:40:02.915601446Z [2024-05-11 01:40:02,915: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:40:02.915653366Z [2024-05-11 01:40:02,915: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:02.916673601Z [2024-05-11 01:40:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:40:02.919868462Z [2024-05-11 01:40:02,919: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:02.949369793Z [2024-05-11 01:40:02,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:40:02.951674218Z [2024-05-11 01:40:02,951: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:02.951814857Z [2024-05-11 01:40:02,951: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:02.952041106Z [2024-05-11 01:40:02,951: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:02.952180122Z [2024-05-11 01:40:02,951: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:40:02.952506403Z [2024-05-11 01:40:02,952: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:40:02.952624728Z [2024-05-11 01:40:02,952: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:03.044482601Z [2024-05-11 01:40:03,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:03.048555680Z [2024-05-11 01:40:03,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:03.066558380Z [2024-05-11 01:40:03,066: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:03.788151168Z [2024-05-11 01:40:03,787: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc3c30b7-3105-4c60-ae2f-a067ef249f3d] succeeded in 2.984567966999748s: None 2024-05-11T01:40:03.986863826Z [2024-05-11 01:40:03,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4da4de11-4f6b-47d2-9e9c-a69cc114fce2] received 2024-05-11T01:40:03.997841452Z [2024-05-11 01:40:03,997: INFO/ForkPoolWorker-1] [4da4de11-4f6b-47d2-9e9c-a69cc114fce2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:04.309230552Z [2024-05-11 01:40:04,306: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:40:04.933467388Z [2024-05-11 01:40:04,933: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7992516d-5cbf-4032-9079-0a2c2b6bd332] succeeded in 4.132678437001232s: None 2024-05-11T01:40:05.260116210Z [2024-05-11 01:40:05,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b64f6bf0-c701-4be6-a79b-2552d1e2684b] succeeded in 4.470748912999625s: None 2024-05-11T01:40:05.412654805Z [2024-05-11 01:40:05,412: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:40:05.415726288Z [2024-05-11 01:40:05,415: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:05.435860685Z [2024-05-11 01:40:05,435: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:40:05.437437713Z [2024-05-11 01:40:05,437: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:05.437494742Z [2024-05-11 01:40:05,437: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:05.437641056Z [2024-05-11 01:40:05,437: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:05.437690268Z [2024-05-11 01:40:05,437: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:40:05.438855526Z [2024-05-11 01:40:05,438: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:40:05.438912979Z [2024-05-11 01:40:05,438: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:05.529917583Z [2024-05-11 01:40:05,529: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:06.123472997Z [2024-05-11 01:40:06,123: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4da4de11-4f6b-47d2-9e9c-a69cc114fce2] succeeded in 2.1324352770006954s: None 2024-05-11T01:40:06.882502416Z [2024-05-11 01:40:06,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02cf94f3-6179-46b9-a932-ed752a91a3cf] received 2024-05-11T01:40:06.889666232Z [2024-05-11 01:40:06,889: INFO/ForkPoolWorker-15] [02cf94f3-6179-46b9-a932-ed752a91a3cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:40:07.143182590Z [2024-05-11 01:40:07,140: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:40:08.434469302Z [2024-05-11 01:40:08,433: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:40:08.437435310Z [2024-05-11 01:40:08,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:08.457667135Z [2024-05-11 01:40:08,457: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:40:08.459013689Z [2024-05-11 01:40:08,458: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:08.459136119Z [2024-05-11 01:40:08,458: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:08.459322215Z [2024-05-11 01:40:08,459: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:08.459412088Z [2024-05-11 01:40:08,459: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:40:08.459720662Z [2024-05-11 01:40:08,459: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:40:08.459738445Z [2024-05-11 01:40:08,459: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:08.544286877Z [2024-05-11 01:40:08,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:09.192929113Z [2024-05-11 01:40:09,192: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02cf94f3-6179-46b9-a932-ed752a91a3cf] succeeded in 2.3095153589983966s: None 2024-05-11T01:40:09.219096664Z [2024-05-11 01:40:09,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a2a7c11-e782-4351-aeba-a564dc86caf3] received 2024-05-11T01:40:09.226953289Z [2024-05-11 01:40:09,226: INFO/ForkPoolWorker-15] [4a2a7c11-e782-4351-aeba-a564dc86caf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:40:09.493307370Z [2024-05-11 01:40:09,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:40:10.542016571Z [2024-05-11 01:40:10,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:40:10.545081081Z [2024-05-11 01:40:10,544: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:40:10.573291036Z [2024-05-11 01:40:10,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:40:10.575703366Z [2024-05-11 01:40:10,575: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:40:10.575736950Z [2024-05-11 01:40:10,575: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:40:10.575767914Z [2024-05-11 01:40:10,575: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:40:10.575779117Z [2024-05-11 01:40:10,575: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:40:10.576140924Z [2024-05-11 01:40:10,575: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:40:10.576180000Z [2024-05-11 01:40:10,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:40:10.687444297Z [2024-05-11 01:40:10,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:40:11.332633040Z [2024-05-11 01:40:11,332: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a2a7c11-e782-4351-aeba-a564dc86caf3] succeeded in 2.111779678001767s: None 2024-05-11T01:41:01.074892859Z [2024-05-11 01:41:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d69b608-2b0c-41f8-8379-8c020b531fc6] received 2024-05-11T01:41:01.082539621Z [2024-05-11 01:41:01,082: INFO/ForkPoolWorker-15] [2d69b608-2b0c-41f8-8379-8c020b531fc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:41:01.089975555Z [2024-05-11 01:41:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f01c477-b04e-4b01-8b46-f7453ab3a8b3] received 2024-05-11T01:41:01.102551561Z [2024-05-11 01:41:01,102: INFO/ForkPoolWorker-16] [7f01c477-b04e-4b01-8b46-f7453ab3a8b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:41:01.106440551Z [2024-05-11 01:41:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae59c39b-8b6d-4e5c-820c-f2c861f69e81] received 2024-05-11T01:41:01.114162962Z [2024-05-11 01:41:01,113: INFO/ForkPoolWorker-1] [ae59c39b-8b6d-4e5c-820c-f2c861f69e81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:41:01.447379663Z [2024-05-11 01:41:01,444: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:41:01.459334409Z [2024-05-11 01:41:01,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:41:01.488288532Z [2024-05-11 01:41:01,485: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:41:01.668837152Z [2024-05-11 01:41:01,668: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:41:01.673238729Z [2024-05-11 01:41:01,672: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:41:01.700318805Z [2024-05-11 01:41:01,700: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:41:01.701552222Z [2024-05-11 01:41:01,701: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:41:01.701805545Z [2024-05-11 01:41:01,701: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:41:01.702025727Z [2024-05-11 01:41:01,701: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:41:01.702518057Z [2024-05-11 01:41:01,702: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:41:01.821292346Z [2024-05-11 01:41:01,820: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:41:02.399554658Z [2024-05-11 01:41:02,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae59c39b-8b6d-4e5c-820c-f2c861f69e81] succeeded in 1.2905967950009654s: None 2024-05-11T01:41:02.547662708Z [2024-05-11 01:41:02,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:41:02.551370978Z [2024-05-11 01:41:02,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:41:02.576607469Z [2024-05-11 01:41:02,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:41:02.579520593Z [2024-05-11 01:41:02,579: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:41:02.579726763Z [2024-05-11 01:41:02,579: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:41:02.580016961Z [2024-05-11 01:41:02,579: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:41:02.580168525Z [2024-05-11 01:41:02,579: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:41:02.580631123Z [2024-05-11 01:41:02,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:41:02.580757708Z [2024-05-11 01:41:02,580: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:41:02.599755902Z [2024-05-11 01:41:02,599: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:41:02.604445924Z [2024-05-11 01:41:02,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:41:02.636515141Z [2024-05-11 01:41:02,634: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:41:02.636532811Z [2024-05-11 01:41:02,635: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:41:02.636537128Z [2024-05-11 01:41:02,636: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:41:02.636540969Z [2024-05-11 01:41:02,636: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:41:02.636544906Z [2024-05-11 01:41:02,636: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:41:02.636547962Z [2024-05-11 01:41:02,636: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:41:02.637724127Z [2024-05-11 01:41:02,636: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:41:02.735667567Z [2024-05-11 01:41:02,735: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:41:02.746298610Z [2024-05-11 01:41:02,746: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:41:04.479438574Z [2024-05-11 01:41:04,478: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f01c477-b04e-4b01-8b46-f7453ab3a8b3] succeeded in 3.390352129999883s: None 2024-05-11T01:41:05.238559930Z [2024-05-11 01:41:05,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d69b608-2b0c-41f8-8379-8c020b531fc6] succeeded in 4.1638809490013955s: None 2024-05-11T01:42:00.308489785Z [2024-05-11 01:42:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[586a1288-02e9-493a-b533-7e9c6bd912ee] received 2024-05-11T01:42:00.312377024Z [2024-05-11 01:42:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[424f8ddc-ef90-4b99-bbdb-15552d079cd9] received 2024-05-11T01:42:00.318631183Z [2024-05-11 01:42:00,317: INFO/ForkPoolWorker-15] [586a1288-02e9-493a-b533-7e9c6bd912ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:42:00.318655849Z [2024-05-11 01:42:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62e99134-5952-40c7-818b-afa152dba490] received 2024-05-11T01:42:00.326883897Z [2024-05-11 01:42:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af832958-9148-45e2-b300-4bceab2507f6] received 2024-05-11T01:42:00.331294774Z [2024-05-11 01:42:00,331: INFO/ForkPoolWorker-16] [424f8ddc-ef90-4b99-bbdb-15552d079cd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:42:00.334679079Z [2024-05-11 01:42:00,334: INFO/ForkPoolWorker-1] [62e99134-5952-40c7-818b-afa152dba490] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:42:00.366192244Z [2024-05-11 01:42:00,359: INFO/ForkPoolWorker-2] [af832958-9148-45e2-b300-4bceab2507f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:42:00.669768443Z [2024-05-11 01:42:00,666: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:42:00.818028696Z [2024-05-11 01:42:00,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:42:00.877432389Z [2024-05-11 01:42:00,866: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:42:00.910915870Z [2024-05-11 01:42:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:42:01.214568707Z [2024-05-11 01:42:01,214: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:42:01.219471381Z [2024-05-11 01:42:01,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:42:01.285073178Z [2024-05-11 01:42:01,284: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:42:01.287210787Z [2024-05-11 01:42:01,286: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:42:01.287377031Z [2024-05-11 01:42:01,287: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:42:01.287735219Z [2024-05-11 01:42:01,287: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:42:01.288042018Z [2024-05-11 01:42:01,287: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:42:01.392220125Z [2024-05-11 01:42:01,391: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:42:01.410063230Z [2024-05-11 01:42:01,409: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:42:02.082053399Z [2024-05-11 01:42:02,081: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62e99134-5952-40c7-818b-afa152dba490] succeeded in 1.7611335769997822s: None 2024-05-11T01:42:02.119653631Z [2024-05-11 01:42:02,119: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[424f8ddc-ef90-4b99-bbdb-15552d079cd9] succeeded in 1.8001277509993088s: None 2024-05-11T01:42:02.299472946Z [2024-05-11 01:42:02,299: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:42:02.303492388Z [2024-05-11 01:42:02,303: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:42:02.322384418Z [2024-05-11 01:42:02,322: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:42:02.324034786Z [2024-05-11 01:42:02,323: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:42:02.324223994Z [2024-05-11 01:42:02,323: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:42:02.324422419Z [2024-05-11 01:42:02,324: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:42:02.324549847Z [2024-05-11 01:42:02,324: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:42:02.324812770Z [2024-05-11 01:42:02,324: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:42:02.324940468Z [2024-05-11 01:42:02,324: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:42:02.416761024Z [2024-05-11 01:42:02,416: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:42:02.499764047Z [2024-05-11 01:42:02,499: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:42:02.503086720Z [2024-05-11 01:42:02,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:42:02.529827188Z [2024-05-11 01:42:02,529: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:42:02.531527978Z [2024-05-11 01:42:02,531: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:42:02.531724701Z [2024-05-11 01:42:02,531: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:42:02.532331495Z [2024-05-11 01:42:02,531: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:42:02.532506423Z [2024-05-11 01:42:02,532: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:42:02.532925220Z [2024-05-11 01:42:02,532: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:42:02.533050465Z [2024-05-11 01:42:02,532: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:42:02.622206005Z [2024-05-11 01:42:02,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:42:04.528700053Z [2024-05-11 01:42:04,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[586a1288-02e9-493a-b533-7e9c6bd912ee] succeeded in 4.217382096001529s: None 2024-05-11T01:42:04.627086517Z [2024-05-11 01:42:04,626: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[af832958-9148-45e2-b300-4bceab2507f6] succeeded in 4.295281515998795s: None 2024-05-11T01:43:00.957290946Z [2024-05-11 01:43:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76375046-d586-4178-b2b5-225c73721489] received 2024-05-11T01:43:00.963540732Z [2024-05-11 01:43:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8a8a5bd-6e71-4a77-b6b2-affa2f3796e3] received 2024-05-11T01:43:00.964750552Z [2024-05-11 01:43:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91cd007b-2561-407d-be6c-07083d0863c3] received 2024-05-11T01:43:00.966615477Z [2024-05-11 01:43:00,966: INFO/ForkPoolWorker-15] [76375046-d586-4178-b2b5-225c73721489] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:43:00.971026693Z [2024-05-11 01:43:00,970: INFO/ForkPoolWorker-1] [91cd007b-2561-407d-be6c-07083d0863c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:43:00.974179058Z [2024-05-11 01:43:00,973: INFO/ForkPoolWorker-16] [b8a8a5bd-6e71-4a77-b6b2-affa2f3796e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:43:01.320727560Z [2024-05-11 01:43:01,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:43:01.357262409Z [2024-05-11 01:43:01,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:43:01.389574101Z [2024-05-11 01:43:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:43:01.478628145Z [2024-05-11 01:43:01,478: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:43:01.482427925Z [2024-05-11 01:43:01,481: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:43:01.508638521Z [2024-05-11 01:43:01,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:43:01.510189582Z [2024-05-11 01:43:01,509: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:43:01.510416021Z [2024-05-11 01:43:01,510: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:43:01.510574819Z [2024-05-11 01:43:01,510: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:43:01.511469463Z [2024-05-11 01:43:01,510: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:43:01.612212615Z [2024-05-11 01:43:01,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:43:02.222144397Z [2024-05-11 01:43:02,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8a8a5bd-6e71-4a77-b6b2-affa2f3796e3] succeeded in 1.2562486049992003s: None 2024-05-11T01:43:02.497758544Z [2024-05-11 01:43:02,497: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:43:02.500909991Z [2024-05-11 01:43:02,500: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:43:02.516310318Z [2024-05-11 01:43:02,516: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:43:02.517321493Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:43:02.517336771Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:43:02.517433518Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:43:02.517468444Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:43:02.517668643Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:43:02.517691319Z [2024-05-11 01:43:02,517: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:43:02.535143442Z [2024-05-11 01:43:02,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:43:02.539521730Z [2024-05-11 01:43:02,539: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:43:02.562705051Z [2024-05-11 01:43:02,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:43:02.564119742Z [2024-05-11 01:43:02,563: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:43:02.564139023Z [2024-05-11 01:43:02,563: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:43:02.564340490Z [2024-05-11 01:43:02,564: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:43:02.564475973Z [2024-05-11 01:43:02,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:43:02.564712108Z [2024-05-11 01:43:02,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:43:02.564790226Z [2024-05-11 01:43:02,564: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:43:02.590240000Z [2024-05-11 01:43:02,589: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:43:02.642994708Z [2024-05-11 01:43:02,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:43:05.026863909Z [2024-05-11 01:43:05,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76375046-d586-4178-b2b5-225c73721489] succeeded in 4.066851943000074s: None 2024-05-11T01:43:06.366729806Z [2024-05-11 01:43:06,365: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91cd007b-2561-407d-be6c-07083d0863c3] succeeded in 5.400323818999823s: None 2024-05-11T01:44:00.801835458Z [2024-05-11 01:44:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bdb44fb-3c96-4d8a-94e3-80853cb623a1] received 2024-05-11T01:44:00.812333184Z [2024-05-11 01:44:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80e63dcd-5884-4e5a-8f8f-d0ce3b9aaa67] received 2024-05-11T01:44:00.818135715Z [2024-05-11 01:44:00,813: INFO/ForkPoolWorker-15] [1bdb44fb-3c96-4d8a-94e3-80853cb623a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:44:00.819568057Z [2024-05-11 01:44:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8eaedfb-3f7a-486d-bf19-94681dd4e296] received 2024-05-11T01:44:00.820832603Z [2024-05-11 01:44:00,820: INFO/ForkPoolWorker-16] [80e63dcd-5884-4e5a-8f8f-d0ce3b9aaa67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:44:00.820962771Z [2024-05-11 01:44:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a22ae46e-e0f2-4687-9d15-2d440f25dbd9] received 2024-05-11T01:44:00.827615541Z [2024-05-11 01:44:00,827: INFO/ForkPoolWorker-1] [c8eaedfb-3f7a-486d-bf19-94681dd4e296] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:44:00.832239227Z [2024-05-11 01:44:00,832: INFO/ForkPoolWorker-2] [a22ae46e-e0f2-4687-9d15-2d440f25dbd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:44:01.185544826Z [2024-05-11 01:44:01,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:44:01.283264702Z [2024-05-11 01:44:01,280: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:44:01.306281603Z [2024-05-11 01:44:01,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:44:01.350027822Z [2024-05-11 01:44:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:44:01.473496272Z [2024-05-11 01:44:01,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:44:01.528012027Z [2024-05-11 01:44:01,524: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:44:01.536577957Z [2024-05-11 01:44:01,536: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:44:01.599092443Z [2024-05-11 01:44:01,598: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:44:01.602341373Z [2024-05-11 01:44:01,602: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:44:01.602367632Z [2024-05-11 01:44:01,602: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:44:01.602414514Z [2024-05-11 01:44:01,602: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:44:01.602667089Z [2024-05-11 01:44:01,602: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:44:01.717631403Z [2024-05-11 01:44:01,717: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:44:01.975651256Z [2024-05-11 01:44:01,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bdb44fb-3c96-4d8a-94e3-80853cb623a1] succeeded in 1.171807536000415s: None 2024-05-11T01:44:02.324941583Z [2024-05-11 01:44:02,324: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8eaedfb-3f7a-486d-bf19-94681dd4e296] succeeded in 1.5046672389999003s: None 2024-05-11T01:44:02.462101398Z [2024-05-11 01:44:02,461: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:44:02.465316526Z [2024-05-11 01:44:02,464: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:44:02.492650040Z [2024-05-11 01:44:02,492: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:44:02.494504283Z [2024-05-11 01:44:02,494: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:44:02.494791653Z [2024-05-11 01:44:02,494: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:44:02.495139048Z [2024-05-11 01:44:02,494: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:44:02.495440990Z [2024-05-11 01:44:02,495: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:44:02.496127761Z [2024-05-11 01:44:02,495: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:44:02.496470387Z [2024-05-11 01:44:02,496: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:44:02.542470055Z [2024-05-11 01:44:02,542: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:44:02.545695604Z [2024-05-11 01:44:02,545: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:44:02.565296861Z [2024-05-11 01:44:02,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:44:02.566684587Z [2024-05-11 01:44:02,566: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:44:02.566848452Z [2024-05-11 01:44:02,566: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:44:02.567086555Z [2024-05-11 01:44:02,566: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:44:02.567232966Z [2024-05-11 01:44:02,567: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:44:02.567633748Z [2024-05-11 01:44:02,567: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:44:02.567791930Z [2024-05-11 01:44:02,567: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:44:02.584715720Z [2024-05-11 01:44:02,584: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:44:02.661199969Z [2024-05-11 01:44:02,660: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:44:04.286210924Z [2024-05-11 01:44:04,285: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a22ae46e-e0f2-4687-9d15-2d440f25dbd9] succeeded in 3.462135498999487s: None 2024-05-11T01:44:05.633367117Z [2024-05-11 01:44:05,631: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80e63dcd-5884-4e5a-8f8f-d0ce3b9aaa67] succeeded in 4.819387490000736s: None 2024-05-11T01:45:01.300723624Z [2024-05-11 01:45:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e14d09c-163a-46bc-9cd1-c9147616b69a] received 2024-05-11T01:45:01.304812359Z [2024-05-11 01:45:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fd15623-bd0e-4118-a1a6-d63878a2ff34] received 2024-05-11T01:45:01.311208302Z [2024-05-11 01:45:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dd1934a-11a4-425d-9d9b-4d8d442add4d] received 2024-05-11T01:45:01.312299298Z [2024-05-11 01:45:01,312: INFO/ForkPoolWorker-15] [1e14d09c-163a-46bc-9cd1-c9147616b69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:01.316968807Z [2024-05-11 01:45:01,316: INFO/ForkPoolWorker-16] [7fd15623-bd0e-4118-a1a6-d63878a2ff34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:45:01.334400428Z [2024-05-11 01:45:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b840968-a22c-4c20-be36-915349aaf239] received 2024-05-11T01:45:01.344759850Z [2024-05-11 01:45:01,344: INFO/ForkPoolWorker-2] [0b840968-a22c-4c20-be36-915349aaf239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:45:01.368412517Z [2024-05-11 01:45:01,368: INFO/ForkPoolWorker-1] [8dd1934a-11a4-425d-9d9b-4d8d442add4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:45:01.759212943Z [2024-05-11 01:45:01,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:45:01.824897181Z [2024-05-11 01:45:01,821: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:45:02.020450108Z [2024-05-11 01:45:02,020: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:45:02.024662134Z [2024-05-11 01:45:02,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:02.063173391Z [2024-05-11 01:45:02,062: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:45:02.065347874Z [2024-05-11 01:45:02,065: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:45:02.066261663Z [2024-05-11 01:45:02,065: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:45:02.066841017Z [2024-05-11 01:45:02,066: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:45:02.067713385Z [2024-05-11 01:45:02,067: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:45:02.201301734Z [2024-05-11 01:45:02,195: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:45:02.216075948Z [2024-05-11 01:45:02,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:45:02.241260643Z [2024-05-11 01:45:02,240: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:03.037227187Z [2024-05-11 01:45:03,036: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8dd1934a-11a4-425d-9d9b-4d8d442add4d] succeeded in 1.714128076999259s: None 2024-05-11T01:45:03.159529111Z [2024-05-11 01:45:03,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:45:03.162830246Z [2024-05-11 01:45:03,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:03.197059126Z [2024-05-11 01:45:03,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:45:03.197067565Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:03.197071112Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:03.197074667Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:03.197078398Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:45:03.197081364Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:45:03.197084366Z [2024-05-11 01:45:03,188: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:03.360095515Z [2024-05-11 01:45:03,359: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:03.818435420Z [2024-05-11 01:45:03,817: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:45:03.823145618Z [2024-05-11 01:45:03,822: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:03.850456759Z [2024-05-11 01:45:03,850: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:45:03.851964759Z [2024-05-11 01:45:03,851: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:03.852174055Z [2024-05-11 01:45:03,852: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:03.852398099Z [2024-05-11 01:45:03,852: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:03.852969788Z [2024-05-11 01:45:03,852: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:45:03.853421259Z [2024-05-11 01:45:03,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:45:03.853626554Z [2024-05-11 01:45:03,853: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:03.962487334Z [2024-05-11 01:45:03,962: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:04.031461074Z [2024-05-11 01:45:04,031: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:45:04.035391426Z [2024-05-11 01:45:04,034: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:04.075046248Z [2024-05-11 01:45:04,069: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:45:04.075063460Z [2024-05-11 01:45:04,072: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:04.075066862Z [2024-05-11 01:45:04,072: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:04.075070943Z [2024-05-11 01:45:04,073: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:04.075074807Z [2024-05-11 01:45:04,073: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:45:04.075077867Z [2024-05-11 01:45:04,074: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:45:04.075088606Z [2024-05-11 01:45:04,074: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:04.163667905Z [2024-05-11 01:45:04,163: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:04.555279265Z [2024-05-11 01:45:04,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e14d09c-163a-46bc-9cd1-c9147616b69a] succeeded in 3.2481469550002657s: None 2024-05-11T01:45:05.401987872Z [2024-05-11 01:45:05,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7fd15623-bd0e-4118-a1a6-d63878a2ff34] succeeded in 4.08925340299902s: None 2024-05-11T01:45:05.648417725Z [2024-05-11 01:45:05,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[533c74b2-5e59-444f-a2b4-ecce9f10a1f3] received 2024-05-11T01:45:05.656432594Z [2024-05-11 01:45:05,656: INFO/ForkPoolWorker-15] [533c74b2-5e59-444f-a2b4-ecce9f10a1f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:05.693986454Z [2024-05-11 01:45:05,693: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b840968-a22c-4c20-be36-915349aaf239] succeeded in 4.35409221000009s: None 2024-05-11T01:45:05.989862324Z [2024-05-11 01:45:05,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:45:07.143138896Z [2024-05-11 01:45:07,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:45:07.146231357Z [2024-05-11 01:45:07,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:07.170815726Z [2024-05-11 01:45:07,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:45:07.171975108Z [2024-05-11 01:45:07,171: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:07.171995122Z [2024-05-11 01:45:07,171: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:07.172120803Z [2024-05-11 01:45:07,171: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:07.172130593Z [2024-05-11 01:45:07,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:45:07.172416166Z [2024-05-11 01:45:07,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:45:07.172426199Z [2024-05-11 01:45:07,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:07.261377702Z [2024-05-11 01:45:07,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:08.040399006Z [2024-05-11 01:45:08,039: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[533c74b2-5e59-444f-a2b4-ecce9f10a1f3] succeeded in 2.390147756999795s: None 2024-05-11T01:45:08.077110022Z [2024-05-11 01:45:08,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ecf9ba7-ab41-459f-bdc4-9d36c9a87188] received 2024-05-11T01:45:08.095006461Z [2024-05-11 01:45:08,094: INFO/ForkPoolWorker-15] [5ecf9ba7-ab41-459f-bdc4-9d36c9a87188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:45:08.469502576Z [2024-05-11 01:45:08,465: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:45:09.595714238Z [2024-05-11 01:45:09,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:45:09.598916170Z [2024-05-11 01:45:09,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:09.628897204Z [2024-05-11 01:45:09,628: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:45:09.630363202Z [2024-05-11 01:45:09,630: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:09.630571513Z [2024-05-11 01:45:09,630: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:09.630805463Z [2024-05-11 01:45:09,630: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:09.630962854Z [2024-05-11 01:45:09,630: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:45:09.631474671Z [2024-05-11 01:45:09,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:45:09.631687136Z [2024-05-11 01:45:09,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:09.749316076Z [2024-05-11 01:45:09,748: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:10.294196495Z [2024-05-11 01:45:10,292: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ecf9ba7-ab41-459f-bdc4-9d36c9a87188] succeeded in 2.2126314449997153s: None 2024-05-11T01:45:10.417274046Z [2024-05-11 01:45:10,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f7ad38-e6af-4c4d-a230-2dcd9dae4023] received 2024-05-11T01:45:10.444224457Z [2024-05-11 01:45:10,442: INFO/ForkPoolWorker-15] [99f7ad38-e6af-4c4d-a230-2dcd9dae4023] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:45:10.739125699Z [2024-05-11 01:45:10,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:45:11.943529968Z [2024-05-11 01:45:11,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:45:11.948682493Z [2024-05-11 01:45:11,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:45:11.980763454Z [2024-05-11 01:45:11,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:45:11.982523398Z [2024-05-11 01:45:11,982: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:45:11.982717106Z [2024-05-11 01:45:11,982: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:45:11.982922542Z [2024-05-11 01:45:11,982: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:45:11.983037887Z [2024-05-11 01:45:11,982: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:45:11.983414954Z [2024-05-11 01:45:11,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:45:11.983961760Z [2024-05-11 01:45:11,983: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:45:12.073882277Z [2024-05-11 01:45:12,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:45:12.764961372Z [2024-05-11 01:45:12,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99f7ad38-e6af-4c4d-a230-2dcd9dae4023] succeeded in 2.3422493079997366s: None 2024-05-11T01:46:00.296965169Z [2024-05-11 01:46:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b06d528-173f-43f2-ad75-1d41750eeab5] received 2024-05-11T01:46:00.299396303Z [2024-05-11 01:46:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07b34453-60b5-476f-b66a-58081f383bb9] received 2024-05-11T01:46:00.307136307Z [2024-05-11 01:46:00,302: INFO/ForkPoolWorker-16] [07b34453-60b5-476f-b66a-58081f383bb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:46:00.315894445Z [2024-05-11 01:46:00,314: INFO/ForkPoolWorker-15] [8b06d528-173f-43f2-ad75-1d41750eeab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:46:00.329988817Z [2024-05-11 01:46:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b1616d-f0a0-48d2-879c-3542f9e3da88] received 2024-05-11T01:46:00.332964572Z [2024-05-11 01:46:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2005f6d-921a-473b-8d01-6a99a9f1e178] received 2024-05-11T01:46:00.387277134Z [2024-05-11 01:46:00,387: INFO/ForkPoolWorker-1] [c7b1616d-f0a0-48d2-879c-3542f9e3da88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:46:00.389362824Z [2024-05-11 01:46:00,389: INFO/ForkPoolWorker-2] [f2005f6d-921a-473b-8d01-6a99a9f1e178] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:46:00.670173811Z [2024-05-11 01:46:00,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:46:00.690784768Z [2024-05-11 01:46:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:46:00.857348157Z [2024-05-11 01:46:00,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:46:00.924213682Z [2024-05-11 01:46:00,921: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:46:01.057345507Z [2024-05-11 01:46:01,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:46:01.083697930Z [2024-05-11 01:46:01,083: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:46:01.098131899Z [2024-05-11 01:46:01,097: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:46:01.229816872Z [2024-05-11 01:46:01,229: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:46:01.234065787Z [2024-05-11 01:46:01,232: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:46:01.234374851Z [2024-05-11 01:46:01,234: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:46:01.234629024Z [2024-05-11 01:46:01,234: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:46:01.234842050Z [2024-05-11 01:46:01,234: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:46:01.345689655Z [2024-05-11 01:46:01,345: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:46:01.747048559Z [2024-05-11 01:46:01,746: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b06d528-173f-43f2-ad75-1d41750eeab5] succeeded in 1.4521248480014037s: None 2024-05-11T01:46:01.999519436Z [2024-05-11 01:46:01,998: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7b1616d-f0a0-48d2-879c-3542f9e3da88] succeeded in 1.6676946360003058s: None 2024-05-11T01:46:02.332215476Z [2024-05-11 01:46:02,331: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:46:02.335700266Z [2024-05-11 01:46:02,335: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:46:02.357287620Z [2024-05-11 01:46:02,357: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:46:02.360722372Z [2024-05-11 01:46:02,360: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:46:02.361524874Z [2024-05-11 01:46:02,360: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:46:02.361808733Z [2024-05-11 01:46:02,361: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:46:02.362041249Z [2024-05-11 01:46:02,361: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:46:02.363378927Z [2024-05-11 01:46:02,363: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:46:02.366058249Z [2024-05-11 01:46:02,363: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:46:02.461167187Z [2024-05-11 01:46:02,460: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:46:02.568954282Z [2024-05-11 01:46:02,568: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:46:02.573474667Z [2024-05-11 01:46:02,572: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:46:02.600478724Z [2024-05-11 01:46:02,600: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:46:02.601817681Z [2024-05-11 01:46:02,601: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:46:02.601832404Z [2024-05-11 01:46:02,601: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:46:02.601953451Z [2024-05-11 01:46:02,601: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:46:02.601998575Z [2024-05-11 01:46:02,601: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:46:02.602197935Z [2024-05-11 01:46:02,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:46:02.602223867Z [2024-05-11 01:46:02,602: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:46:02.686267248Z [2024-05-11 01:46:02,685: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:46:04.223817160Z [2024-05-11 01:46:04,223: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2005f6d-921a-473b-8d01-6a99a9f1e178] succeeded in 3.8777588289995037s: None 2024-05-11T01:46:04.852701362Z [2024-05-11 01:46:04,852: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[07b34453-60b5-476f-b66a-58081f383bb9] succeeded in 4.556427777999488s: None 2024-05-11T01:47:01.211048759Z [2024-05-11 01:47:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03c8ebbc-e1f7-4e20-95d0-dc41b38451ed] received 2024-05-11T01:47:01.218411219Z [2024-05-11 01:47:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cd460de-259c-4160-bd2d-b5f385b7278d] received 2024-05-11T01:47:01.224124633Z [2024-05-11 01:47:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb7deec4-9b8c-4ead-bada-bef19f80f874] received 2024-05-11T01:47:01.228846945Z [2024-05-11 01:47:01,228: INFO/ForkPoolWorker-16] [9cd460de-259c-4160-bd2d-b5f385b7278d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:47:01.229128220Z [2024-05-11 01:47:01,228: INFO/ForkPoolWorker-15] [03c8ebbc-e1f7-4e20-95d0-dc41b38451ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:47:01.232550850Z [2024-05-11 01:47:01,232: INFO/ForkPoolWorker-1] [bb7deec4-9b8c-4ead-bada-bef19f80f874] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:47:01.501191510Z [2024-05-11 01:47:01,498: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:47:01.524432910Z [2024-05-11 01:47:01,521: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:47:01.561238098Z [2024-05-11 01:47:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:47:01.728372304Z [2024-05-11 01:47:01,727: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:47:01.732821974Z [2024-05-11 01:47:01,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:47:01.756220004Z [2024-05-11 01:47:01,756: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:47:01.757287205Z [2024-05-11 01:47:01,757: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:47:01.757490302Z [2024-05-11 01:47:01,757: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:47:01.757625181Z [2024-05-11 01:47:01,757: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:47:01.757934174Z [2024-05-11 01:47:01,757: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:47:01.850435127Z [2024-05-11 01:47:01,850: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:47:02.432666179Z [2024-05-11 01:47:02,432: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03c8ebbc-e1f7-4e20-95d0-dc41b38451ed] succeeded in 1.2112290280001616s: None 2024-05-11T01:47:02.607451622Z [2024-05-11 01:47:02,607: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:47:02.610772135Z [2024-05-11 01:47:02,610: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:47:02.627157920Z [2024-05-11 01:47:02,626: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:47:02.628323460Z [2024-05-11 01:47:02,628: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:47:02.628426343Z [2024-05-11 01:47:02,628: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:47:02.628595905Z [2024-05-11 01:47:02,628: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:47:02.628694299Z [2024-05-11 01:47:02,628: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:47:02.629043434Z [2024-05-11 01:47:02,628: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:47:02.629151364Z [2024-05-11 01:47:02,629: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:47:02.662451767Z [2024-05-11 01:47:02,662: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:47:02.665720083Z [2024-05-11 01:47:02,665: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:47:02.687016830Z [2024-05-11 01:47:02,686: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:47:02.688229112Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:47:02.688299183Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:47:02.688484451Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:47:02.688517574Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:47:02.688891858Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:47:02.688903818Z [2024-05-11 01:47:02,688: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:47:02.718773648Z [2024-05-11 01:47:02,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:47:02.780857884Z [2024-05-11 01:47:02,780: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:47:04.343947085Z [2024-05-11 01:47:04,343: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb7deec4-9b8c-4ead-bada-bef19f80f874] succeeded in 3.117096455000137s: None 2024-05-11T01:47:04.770959518Z [2024-05-11 01:47:04,770: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cd460de-259c-4160-bd2d-b5f385b7278d] succeeded in 3.5509059579999303s: None 2024-05-11T01:48:01.160526050Z [2024-05-11 01:48:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbc9789d-0548-4dd2-884e-a8943c1f00fa] received 2024-05-11T01:48:01.164792962Z [2024-05-11 01:48:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbd4a9e4-f618-494a-aed1-d4e0134e0405] received 2024-05-11T01:48:01.168105397Z [2024-05-11 01:48:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e565a13-9229-4fb9-a8e6-7dc77841d3db] received 2024-05-11T01:48:01.170703624Z [2024-05-11 01:48:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94781a9a-cad7-4c02-8896-9a948b8018c4] received 2024-05-11T01:48:01.178906918Z [2024-05-11 01:48:01,176: INFO/ForkPoolWorker-16] [cbd4a9e4-f618-494a-aed1-d4e0134e0405] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:48:01.185556062Z [2024-05-11 01:48:01,185: INFO/ForkPoolWorker-2] [94781a9a-cad7-4c02-8896-9a948b8018c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:48:01.190412483Z [2024-05-11 01:48:01,185: INFO/ForkPoolWorker-15] [bbc9789d-0548-4dd2-884e-a8943c1f00fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:48:01.202662343Z [2024-05-11 01:48:01,202: INFO/ForkPoolWorker-1] [2e565a13-9229-4fb9-a8e6-7dc77841d3db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:48:01.599880219Z [2024-05-11 01:48:01,596: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:48:01.649530348Z [2024-05-11 01:48:01,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:48:01.660260131Z [2024-05-11 01:48:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:48:01.827732083Z [2024-05-11 01:48:01,824: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:48:01.834780908Z [2024-05-11 01:48:01,834: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:48:01.849635602Z [2024-05-11 01:48:01,842: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:48:01.911438176Z [2024-05-11 01:48:01,911: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:48:01.912265083Z [2024-05-11 01:48:01,912: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:48:01.921555506Z [2024-05-11 01:48:01,921: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:48:01.921658274Z [2024-05-11 01:48:01,921: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:48:01.921703936Z [2024-05-11 01:48:01,921: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:48:01.921973959Z [2024-05-11 01:48:01,921: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:48:02.048458034Z [2024-05-11 01:48:02,048: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:48:02.616023010Z [2024-05-11 01:48:02,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbc9789d-0548-4dd2-884e-a8943c1f00fa] succeeded in 1.4462311859988404s: None 2024-05-11T01:48:02.630426592Z [2024-05-11 01:48:02,629: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[94781a9a-cad7-4c02-8896-9a948b8018c4] succeeded in 1.4570035809992987s: None 2024-05-11T01:48:02.987754284Z [2024-05-11 01:48:02,987: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:48:02.990966411Z [2024-05-11 01:48:02,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:48:03.011300766Z [2024-05-11 01:48:03,011: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:48:03.012899086Z [2024-05-11 01:48:03,012: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:48:03.013014991Z [2024-05-11 01:48:03,012: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:48:03.013204604Z [2024-05-11 01:48:03,012: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:48:03.013296407Z [2024-05-11 01:48:03,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:48:03.013678436Z [2024-05-11 01:48:03,013: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:48:03.013793059Z [2024-05-11 01:48:03,013: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:48:03.088913663Z [2024-05-11 01:48:03,088: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:48:03.092784058Z [2024-05-11 01:48:03,092: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:48:03.104763791Z [2024-05-11 01:48:03,103: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:48:03.112404343Z [2024-05-11 01:48:03,112: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:48:03.113938284Z [2024-05-11 01:48:03,113: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:48:03.114080596Z [2024-05-11 01:48:03,113: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:48:03.114222191Z [2024-05-11 01:48:03,114: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:48:03.114283415Z [2024-05-11 01:48:03,114: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:48:03.114576214Z [2024-05-11 01:48:03,114: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:48:03.114777747Z [2024-05-11 01:48:03,114: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:48:03.190572842Z [2024-05-11 01:48:03,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:48:05.405761988Z [2024-05-11 01:48:05,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e565a13-9229-4fb9-a8e6-7dc77841d3db] succeeded in 4.227763781000249s: None 2024-05-11T01:48:05.719797644Z [2024-05-11 01:48:05,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbd4a9e4-f618-494a-aed1-d4e0134e0405] succeeded in 4.551616811000713s: None 2024-05-11T01:49:00.817390510Z [2024-05-11 01:49:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdc99521-6738-4677-a09f-54d0efbdc58b] received 2024-05-11T01:49:00.822855702Z [2024-05-11 01:49:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4af47fbc-47ea-4a97-aea9-f9d100fab24f] received 2024-05-11T01:49:00.831603782Z [2024-05-11 01:49:00,831: INFO/ForkPoolWorker-15] [bdc99521-6738-4677-a09f-54d0efbdc58b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:49:00.837636833Z [2024-05-11 01:49:00,837: INFO/ForkPoolWorker-16] [4af47fbc-47ea-4a97-aea9-f9d100fab24f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:49:00.839574240Z [2024-05-11 01:49:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[663c1433-62fc-4abf-a020-f750495eeac3] received 2024-05-11T01:49:00.855156825Z [2024-05-11 01:49:00,854: INFO/ForkPoolWorker-1] [663c1433-62fc-4abf-a020-f750495eeac3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:49:01.240641840Z [2024-05-11 01:49:01,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:49:01.304188436Z [2024-05-11 01:49:01,301: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:49:01.329031168Z [2024-05-11 01:49:01,325: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:49:01.486876464Z [2024-05-11 01:49:01,486: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:49:01.491267870Z [2024-05-11 01:49:01,490: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:49:01.525415137Z [2024-05-11 01:49:01,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:49:01.526542439Z [2024-05-11 01:49:01,526: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:49:01.526676139Z [2024-05-11 01:49:01,526: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:49:01.526742068Z [2024-05-11 01:49:01,526: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:49:01.527218406Z [2024-05-11 01:49:01,527: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:49:01.612975480Z [2024-05-11 01:49:01,612: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:49:02.189916749Z [2024-05-11 01:49:02,189: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[663c1433-62fc-4abf-a020-f750495eeac3] succeeded in 1.3484147529998154s: None 2024-05-11T01:49:02.379486381Z [2024-05-11 01:49:02,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:49:02.382687309Z [2024-05-11 01:49:02,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:49:02.401213946Z [2024-05-11 01:49:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:49:02.402512058Z [2024-05-11 01:49:02,402: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:49:02.402541018Z [2024-05-11 01:49:02,402: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:49:02.402689145Z [2024-05-11 01:49:02,402: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:49:02.402717326Z [2024-05-11 01:49:02,402: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:49:02.403105380Z [2024-05-11 01:49:02,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:49:02.403222285Z [2024-05-11 01:49:02,403: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:49:02.478293761Z [2024-05-11 01:49:02,478: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:49:02.524228073Z [2024-05-11 01:49:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:49:02.528101227Z [2024-05-11 01:49:02,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:49:02.555958963Z [2024-05-11 01:49:02,555: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:49:02.557856804Z [2024-05-11 01:49:02,557: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:49:02.558218629Z [2024-05-11 01:49:02,557: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:49:02.558536947Z [2024-05-11 01:49:02,558: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:49:02.558763238Z [2024-05-11 01:49:02,558: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:49:02.559562178Z [2024-05-11 01:49:02,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:49:02.559695556Z [2024-05-11 01:49:02,559: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:49:02.649653973Z [2024-05-11 01:49:02,649: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:49:04.277470927Z [2024-05-11 01:49:04,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdc99521-6738-4677-a09f-54d0efbdc58b] succeeded in 3.4569847309994657s: None 2024-05-11T01:49:04.708072307Z [2024-05-11 01:49:04,707: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4af47fbc-47ea-4a97-aea9-f9d100fab24f] succeeded in 3.881944001001102s: None 2024-05-11T01:50:01.257699014Z [2024-05-11 01:50:01,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a830a6f8-026d-4447-a811-c58f277d3fc3] received 2024-05-11T01:50:01.264079118Z [2024-05-11 01:50:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5e9f80c-b68a-4f94-9805-643da2cb37f6] received 2024-05-11T01:50:01.265989631Z [2024-05-11 01:50:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34bd971d-142a-4c18-b001-9f53a8c94657] received 2024-05-11T01:50:01.268251927Z [2024-05-11 01:50:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f1d86a9-48f2-4149-a4f3-6dbcad187644] received 2024-05-11T01:50:01.270232906Z [2024-05-11 01:50:01,270: INFO/ForkPoolWorker-16] [f5e9f80c-b68a-4f94-9805-643da2cb37f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:01.270541746Z [2024-05-11 01:50:01,270: INFO/ForkPoolWorker-15] [a830a6f8-026d-4447-a811-c58f277d3fc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:50:01.275156031Z [2024-05-11 01:50:01,274: INFO/ForkPoolWorker-1] [34bd971d-142a-4c18-b001-9f53a8c94657] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:50:01.290325249Z [2024-05-11 01:50:01,290: INFO/ForkPoolWorker-2] [9f1d86a9-48f2-4149-a4f3-6dbcad187644] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:50:01.304700917Z [2024-05-11 01:50:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80e5fcea-a69d-4193-8dbc-80a057fdd3af] received 2024-05-11T01:50:01.321134693Z [2024-05-11 01:50:01,320: INFO/ForkPoolWorker-3] [80e5fcea-a69d-4193-8dbc-80a057fdd3af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:50:01.590639623Z [2024-05-11 01:50:01,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:50:01.661031850Z [2024-05-11 01:50:01,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:50:01.801950581Z [2024-05-11 01:50:01,798: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:50:01.883880470Z [2024-05-11 01:50:01,883: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:50:01.888077052Z [2024-05-11 01:50:01,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:01.902932025Z [2024-05-11 01:50:01,892: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:50:01.913268684Z [2024-05-11 01:50:01,909: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:50:01.939253666Z [2024-05-11 01:50:01,939: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:50:01.940681945Z [2024-05-11 01:50:01,940: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:50:01.940895105Z [2024-05-11 01:50:01,940: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:50:01.941055907Z [2024-05-11 01:50:01,940: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:50:01.941337443Z [2024-05-11 01:50:01,941: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:50:02.053618553Z [2024-05-11 01:50:02,053: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:02.345850624Z [2024-05-11 01:50:02,345: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:02.714222544Z [2024-05-11 01:50:02,713: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34bd971d-142a-4c18-b001-9f53a8c94657] succeeded in 1.4444696250011475s: None 2024-05-11T01:50:02.962409496Z [2024-05-11 01:50:02,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f1d86a9-48f2-4149-a4f3-6dbcad187644] succeeded in 1.6871940979999636s: None 2024-05-11T01:50:03.198482904Z [2024-05-11 01:50:03,198: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:50:03.201704177Z [2024-05-11 01:50:03,201: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:03.227258647Z [2024-05-11 01:50:03,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:50:03.230168417Z [2024-05-11 01:50:03,229: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:03.230966727Z [2024-05-11 01:50:03,230: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:03.231370130Z [2024-05-11 01:50:03,230: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:03.231455626Z [2024-05-11 01:50:03,231: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:50:03.231708127Z [2024-05-11 01:50:03,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:50:03.231888493Z [2024-05-11 01:50:03,231: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:03.289144909Z [2024-05-11 01:50:03,288: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T01:50:03.292671347Z [2024-05-11 01:50:03,292: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:03.320196106Z [2024-05-11 01:50:03,319: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:03.338137216Z [2024-05-11 01:50:03,337: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T01:50:03.342487171Z [2024-05-11 01:50:03,342: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:03.342519752Z [2024-05-11 01:50:03,342: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:03.344518146Z [2024-05-11 01:50:03,342: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:03.344543165Z [2024-05-11 01:50:03,344: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T01:50:03.345570861Z [2024-05-11 01:50:03,345: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:50:03.345594110Z [2024-05-11 01:50:03,345: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:03.451059581Z [2024-05-11 01:50:03,450: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:03.489735022Z [2024-05-11 01:50:03,486: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:50:03.494057919Z [2024-05-11 01:50:03,490: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:03.530409415Z [2024-05-11 01:50:03,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:50:03.530426430Z [2024-05-11 01:50:03,521: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:03.530430945Z [2024-05-11 01:50:03,522: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:03.530435988Z [2024-05-11 01:50:03,522: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:03.530440514Z [2024-05-11 01:50:03,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:50:03.530444257Z [2024-05-11 01:50:03,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:50:03.530447930Z [2024-05-11 01:50:03,522: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:03.633177021Z [2024-05-11 01:50:03,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:03.918519193Z [2024-05-11 01:50:03,918: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5e9f80c-b68a-4f94-9805-643da2cb37f6] succeeded in 2.6529158480007027s: None 2024-05-11T01:50:04.644772411Z [2024-05-11 01:50:04,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfd93475-4d54-4e78-8203-192262667e4a] received 2024-05-11T01:50:04.654744261Z [2024-05-11 01:50:04,654: INFO/ForkPoolWorker-16] [bfd93475-4d54-4e78-8203-192262667e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:04.857514823Z [2024-05-11 01:50:04,857: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[80e5fcea-a69d-4193-8dbc-80a057fdd3af] succeeded in 3.550077494001016s: None 2024-05-11T01:50:04.949439069Z [2024-05-11 01:50:04,946: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:50:05.469918332Z [2024-05-11 01:50:05,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a830a6f8-026d-4447-a811-c58f277d3fc3] succeeded in 4.207312247999653s: None 2024-05-11T01:50:06.225029938Z [2024-05-11 01:50:06,224: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:50:06.228233562Z [2024-05-11 01:50:06,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:06.247049516Z [2024-05-11 01:50:06,246: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:50:06.248630051Z [2024-05-11 01:50:06,248: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:06.248855064Z [2024-05-11 01:50:06,248: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:06.249147612Z [2024-05-11 01:50:06,248: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:06.249404919Z [2024-05-11 01:50:06,249: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:50:06.249820292Z [2024-05-11 01:50:06,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:50:06.250083464Z [2024-05-11 01:50:06,249: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:06.333994200Z [2024-05-11 01:50:06,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:06.993194277Z [2024-05-11 01:50:06,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfd93475-4d54-4e78-8203-192262667e4a] succeeded in 2.3459892999999283s: None 2024-05-11T01:50:07.050662076Z [2024-05-11 01:50:07,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1cabfd6-ad88-4bff-b756-26a47563cfd6] received 2024-05-11T01:50:07.067470146Z [2024-05-11 01:50:07,067: INFO/ForkPoolWorker-15] [c1cabfd6-ad88-4bff-b756-26a47563cfd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:50:07.371898910Z [2024-05-11 01:50:07,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:50:08.554917389Z [2024-05-11 01:50:08,554: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:50:08.558081643Z [2024-05-11 01:50:08,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:08.575090152Z [2024-05-11 01:50:08,574: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:50:08.576167238Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:08.576260633Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:08.576414680Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:08.576482885Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:50:08.576741374Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:50:08.576833452Z [2024-05-11 01:50:08,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:08.682252886Z [2024-05-11 01:50:08,681: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:09.207618088Z [2024-05-11 01:50:09,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1cabfd6-ad88-4bff-b756-26a47563cfd6] succeeded in 2.1549011089991836s: None 2024-05-11T01:50:09.370898832Z [2024-05-11 01:50:09,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebd7a17a-3f51-4db2-a43f-eb95bc8a88c5] received 2024-05-11T01:50:09.378196620Z [2024-05-11 01:50:09,377: INFO/ForkPoolWorker-15] [ebd7a17a-3f51-4db2-a43f-eb95bc8a88c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:50:09.675390125Z [2024-05-11 01:50:09,672: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:50:10.812703680Z [2024-05-11 01:50:10,812: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:50:10.815899320Z [2024-05-11 01:50:10,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:50:10.835711204Z [2024-05-11 01:50:10,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:50:10.837262187Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:50:10.837290327Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:50:10.837512123Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:50:10.837564769Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:50:10.837945182Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:50:10.838046836Z [2024-05-11 01:50:10,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:50:10.938816024Z [2024-05-11 01:50:10,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:50:11.539861244Z [2024-05-11 01:50:11,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ebd7a17a-3f51-4db2-a43f-eb95bc8a88c5] succeeded in 2.1669416679997084s: None 2024-05-11T01:51:00.553933958Z [2024-05-11 01:51:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c19f4e0-eb6a-419f-ba18-9b6ccea0c40b] received 2024-05-11T01:51:00.568855980Z [2024-05-11 01:51:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b9c535-52f2-4681-acc9-30ec1bc0e97f] received 2024-05-11T01:51:00.569704577Z [2024-05-11 01:51:00,569: INFO/ForkPoolWorker-15] [5c19f4e0-eb6a-419f-ba18-9b6ccea0c40b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:51:00.580069478Z [2024-05-11 01:51:00,579: INFO/ForkPoolWorker-16] [c7b9c535-52f2-4681-acc9-30ec1bc0e97f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:51:00.581113971Z [2024-05-11 01:51:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[527bcd73-7558-49d5-9fc0-1c1f23d4f15f] received 2024-05-11T01:51:00.597631538Z [2024-05-11 01:51:00,597: INFO/ForkPoolWorker-1] [527bcd73-7558-49d5-9fc0-1c1f23d4f15f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:51:00.862522428Z [2024-05-11 01:51:00,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:51:00.874264676Z [2024-05-11 01:51:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:51:00.887936042Z [2024-05-11 01:51:00,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:51:01.022025104Z [2024-05-11 01:51:01,020: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:51:01.029979939Z [2024-05-11 01:51:01,024: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:51:01.056200961Z [2024-05-11 01:51:01,047: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:51:01.057968411Z [2024-05-11 01:51:01,050: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:51:01.057984131Z [2024-05-11 01:51:01,050: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:51:01.057988085Z [2024-05-11 01:51:01,050: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:51:01.057991172Z [2024-05-11 01:51:01,050: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:51:01.154543507Z [2024-05-11 01:51:01,154: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:51:01.803528552Z [2024-05-11 01:51:01,802: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7b9c535-52f2-4681-acc9-30ec1bc0e97f] succeeded in 1.2319756260003487s: None 2024-05-11T01:51:02.093260602Z [2024-05-11 01:51:02,092: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:51:02.096497140Z [2024-05-11 01:51:02,096: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:51:02.115142462Z [2024-05-11 01:51:02,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:51:02.116432233Z [2024-05-11 01:51:02,116: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:51:02.118241837Z [2024-05-11 01:51:02,117: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:51:02.118258801Z [2024-05-11 01:51:02,117: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:51:02.118282285Z [2024-05-11 01:51:02,117: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:51:02.118288298Z [2024-05-11 01:51:02,117: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:51:02.118522484Z [2024-05-11 01:51:02,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:51:02.118681169Z [2024-05-11 01:51:02,118: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:51:02.118770161Z [2024-05-11 01:51:02,118: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:51:02.146556770Z [2024-05-11 01:51:02,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:51:02.148695993Z [2024-05-11 01:51:02,148: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:51:02.148714122Z [2024-05-11 01:51:02,148: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:51:02.148942289Z [2024-05-11 01:51:02,148: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:51:02.148997970Z [2024-05-11 01:51:02,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:51:02.149433987Z [2024-05-11 01:51:02,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:51:02.149548301Z [2024-05-11 01:51:02,149: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:51:02.205486985Z [2024-05-11 01:51:02,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:51:02.256064962Z [2024-05-11 01:51:02,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:51:04.803011835Z [2024-05-11 01:51:04,802: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[527bcd73-7558-49d5-9fc0-1c1f23d4f15f] succeeded in 4.220056738000494s: None 2024-05-11T01:51:05.570927198Z [2024-05-11 01:51:05,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c19f4e0-eb6a-419f-ba18-9b6ccea0c40b] succeeded in 5.0137950200005434s: None 2024-05-11T01:52:01.337254223Z [2024-05-11 01:52:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f98f9be2-b760-495d-8006-58948a4c97bc] received 2024-05-11T01:52:01.340267104Z [2024-05-11 01:52:01,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40b26e6f-6297-4878-8d8f-c6676d84cbf3] received 2024-05-11T01:52:01.353202809Z [2024-05-11 01:52:01,351: INFO/ForkPoolWorker-15] [f98f9be2-b760-495d-8006-58948a4c97bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:52:01.354173244Z [2024-05-11 01:52:01,353: INFO/ForkPoolWorker-16] [40b26e6f-6297-4878-8d8f-c6676d84cbf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:52:01.363201663Z [2024-05-11 01:52:01,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd0a73ff-2a4b-4871-ba31-5a8b114f993c] received 2024-05-11T01:52:01.364696330Z [2024-05-11 01:52:01,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99badaf7-ee58-4b4b-8fb1-9f6b26b9ed0d] received 2024-05-11T01:52:01.378840728Z [2024-05-11 01:52:01,378: INFO/ForkPoolWorker-2] [99badaf7-ee58-4b4b-8fb1-9f6b26b9ed0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:52:01.408875938Z [2024-05-11 01:52:01,408: INFO/ForkPoolWorker-1] [cd0a73ff-2a4b-4871-ba31-5a8b114f993c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:52:01.838229824Z [2024-05-11 01:52:01,834: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:52:02.048878905Z [2024-05-11 01:52:02,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:52:02.124462167Z [2024-05-11 01:52:02,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:52:02.218190052Z [2024-05-11 01:52:02,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:52:02.401727185Z [2024-05-11 01:52:02,401: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:52:02.432824779Z [2024-05-11 01:52:02,432: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T01:52:02.437076621Z [2024-05-11 01:52:02,436: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:52:02.502431379Z [2024-05-11 01:52:02,502: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:52:02.505696243Z [2024-05-11 01:52:02,505: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:52:02.505910810Z [2024-05-11 01:52:02,505: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:52:02.506059606Z [2024-05-11 01:52:02,505: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T01:52:02.506356687Z [2024-05-11 01:52:02,506: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:52:02.619513660Z [2024-05-11 01:52:02,619: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:52:03.128041305Z [2024-05-11 01:52:03,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f98f9be2-b760-495d-8006-58948a4c97bc] succeeded in 1.7891744659991673s: None 2024-05-11T01:52:03.380416636Z [2024-05-11 01:52:03,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd0a73ff-2a4b-4871-ba31-5a8b114f993c] succeeded in 1.9909949819993926s: None 2024-05-11T01:52:03.652299013Z [2024-05-11 01:52:03,651: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:52:03.669329662Z [2024-05-11 01:52:03,655: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:52:03.697962574Z [2024-05-11 01:52:03,697: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:52:03.699737896Z [2024-05-11 01:52:03,699: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:52:03.699763367Z [2024-05-11 01:52:03,699: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:52:03.699859205Z [2024-05-11 01:52:03,699: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:52:03.699890797Z [2024-05-11 01:52:03,699: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:52:03.700121405Z [2024-05-11 01:52:03,700: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:52:03.700152893Z [2024-05-11 01:52:03,700: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:52:03.776093242Z [2024-05-11 01:52:03,775: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:52:04.050704076Z [2024-05-11 01:52:04,050: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:52:04.054469889Z [2024-05-11 01:52:04,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:52:04.117657600Z [2024-05-11 01:52:04,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:52:04.119511283Z [2024-05-11 01:52:04,119: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:52:04.119553942Z [2024-05-11 01:52:04,119: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:52:04.119764098Z [2024-05-11 01:52:04,119: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:52:04.119903983Z [2024-05-11 01:52:04,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:52:04.120174759Z [2024-05-11 01:52:04,120: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:52:04.120521994Z [2024-05-11 01:52:04,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:52:04.210811179Z [2024-05-11 01:52:04,210: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:52:05.449740071Z [2024-05-11 01:52:05,449: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99badaf7-ee58-4b4b-8fb1-9f6b26b9ed0d] succeeded in 4.0817705760000536s: None 2024-05-11T01:52:06.179329602Z [2024-05-11 01:52:06,178: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40b26e6f-6297-4878-8d8f-c6676d84cbf3] succeeded in 4.83703155799958s: None 2024-05-11T01:53:01.064586569Z [2024-05-11 01:53:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56b3630e-100b-4f0d-a1c1-5b5c1826f4d7] received 2024-05-11T01:53:01.084483201Z [2024-05-11 01:53:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47fec02a-f4c5-4b72-bd5b-6c551de655e2] received 2024-05-11T01:53:01.089784976Z [2024-05-11 01:53:01,086: INFO/ForkPoolWorker-15] [56b3630e-100b-4f0d-a1c1-5b5c1826f4d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:53:01.093527731Z [2024-05-11 01:53:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[221e8ccc-5c0a-44a1-830e-8f69a2ef4c53] received 2024-05-11T01:53:01.101102031Z [2024-05-11 01:53:01,100: INFO/ForkPoolWorker-16] [47fec02a-f4c5-4b72-bd5b-6c551de655e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:53:01.106787742Z [2024-05-11 01:53:01,106: INFO/ForkPoolWorker-1] [221e8ccc-5c0a-44a1-830e-8f69a2ef4c53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:53:01.420283814Z [2024-05-11 01:53:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:53:01.483518267Z [2024-05-11 01:53:01,480: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:53:01.547260901Z [2024-05-11 01:53:01,543: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:53:01.690852117Z [2024-05-11 01:53:01,690: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:53:01.695506805Z [2024-05-11 01:53:01,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:53:01.726631237Z [2024-05-11 01:53:01,726: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:53:01.728592355Z [2024-05-11 01:53:01,728: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:53:01.728711654Z [2024-05-11 01:53:01,728: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:53:01.728774057Z [2024-05-11 01:53:01,728: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:53:01.729063335Z [2024-05-11 01:53:01,728: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:53:01.857825266Z [2024-05-11 01:53:01,857: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:53:02.586529755Z [2024-05-11 01:53:02,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47fec02a-f4c5-4b72-bd5b-6c551de655e2] succeeded in 1.4965499699992506s: None 2024-05-11T01:53:02.614794599Z [2024-05-11 01:53:02,614: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:53:02.618412371Z [2024-05-11 01:53:02,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:53:02.645798327Z [2024-05-11 01:53:02,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:53:02.647417838Z [2024-05-11 01:53:02,647: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:53:02.647604899Z [2024-05-11 01:53:02,647: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:53:02.647905581Z [2024-05-11 01:53:02,647: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:53:02.648090213Z [2024-05-11 01:53:02,647: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:53:02.648599940Z [2024-05-11 01:53:02,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:53:02.648772107Z [2024-05-11 01:53:02,648: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:53:02.764511077Z [2024-05-11 01:53:02,764: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:53:02.809742279Z [2024-05-11 01:53:02,809: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:53:02.813069185Z [2024-05-11 01:53:02,812: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:53:02.841655619Z [2024-05-11 01:53:02,841: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:53:02.843557551Z [2024-05-11 01:53:02,843: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:53:02.843682124Z [2024-05-11 01:53:02,843: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:53:02.843966519Z [2024-05-11 01:53:02,843: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:53:02.844110139Z [2024-05-11 01:53:02,843: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:53:02.844521015Z [2024-05-11 01:53:02,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:53:02.844661999Z [2024-05-11 01:53:02,844: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:53:02.956168457Z [2024-05-11 01:53:02,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:53:04.690359061Z [2024-05-11 01:53:04,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56b3630e-100b-4f0d-a1c1-5b5c1826f4d7] succeeded in 3.6203762820005068s: None 2024-05-11T01:53:04.748564234Z [2024-05-11 01:53:04,747: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[221e8ccc-5c0a-44a1-830e-8f69a2ef4c53] succeeded in 3.6529200710010628s: None 2024-05-11T01:54:01.025707930Z [2024-05-11 01:54:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31a2d588-5f5a-4698-89f1-bc8e55672d4d] received 2024-05-11T01:54:01.027444775Z [2024-05-11 01:54:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a1f55a6-d163-4af3-ba21-20c589763990] received 2024-05-11T01:54:01.048826500Z [2024-05-11 01:54:01,035: INFO/ForkPoolWorker-16] [0a1f55a6-d163-4af3-ba21-20c589763990] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:54:01.048849995Z [2024-05-11 01:54:01,044: INFO/ForkPoolWorker-15] [31a2d588-5f5a-4698-89f1-bc8e55672d4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:54:01.069368922Z [2024-05-11 01:54:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96a55567-8ed7-460a-bd40-aba161177f8d] received 2024-05-11T01:54:01.078041185Z [2024-05-11 01:54:01,075: INFO/ForkPoolWorker-1] [96a55567-8ed7-460a-bd40-aba161177f8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:54:01.078072376Z [2024-05-11 01:54:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cdf5611-f644-4505-af68-fd8f9fa4f9b7] received 2024-05-11T01:54:01.089992689Z [2024-05-11 01:54:01,087: INFO/ForkPoolWorker-2] [6cdf5611-f644-4505-af68-fd8f9fa4f9b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:54:01.428309574Z [2024-05-11 01:54:01,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:54:01.583471914Z [2024-05-11 01:54:01,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:54:01.689483806Z [2024-05-11 01:54:01,689: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:54:01.719905290Z [2024-05-11 01:54:01,706: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:54:01.722352216Z [2024-05-11 01:54:01,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:54:01.925078652Z [2024-05-11 01:54:01,924: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:54:01.929254159Z [2024-05-11 01:54:01,928: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:54:01.962942941Z [2024-05-11 01:54:01,962: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:54:01.964138679Z [2024-05-11 01:54:01,963: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:54:01.964345290Z [2024-05-11 01:54:01,964: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:54:01.964492217Z [2024-05-11 01:54:01,964: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:54:01.964750357Z [2024-05-11 01:54:01,964: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:54:02.089602338Z [2024-05-11 01:54:02,089: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:54:02.194078197Z [2024-05-11 01:54:02,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31a2d588-5f5a-4698-89f1-bc8e55672d4d] succeeded in 1.1667913589990349s: None 2024-05-11T01:54:02.724786987Z [2024-05-11 01:54:02,724: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6cdf5611-f644-4505-af68-fd8f9fa4f9b7] succeeded in 1.6457660689993645s: None 2024-05-11T01:54:03.033086373Z [2024-05-11 01:54:03,031: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:54:03.034667123Z [2024-05-11 01:54:03,034: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:54:03.070823393Z [2024-05-11 01:54:03,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:54:03.079014373Z [2024-05-11 01:54:03,078: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:54:03.079036746Z [2024-05-11 01:54:03,078: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:54:03.079276747Z [2024-05-11 01:54:03,078: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:54:03.079359945Z [2024-05-11 01:54:03,079: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:54:03.079381398Z [2024-05-11 01:54:03,079: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:54:03.079389440Z [2024-05-11 01:54:03,079: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:54:03.109181397Z [2024-05-11 01:54:03,108: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:54:03.112356528Z [2024-05-11 01:54:03,111: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:54:03.136605788Z [2024-05-11 01:54:03,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:54:03.137845478Z [2024-05-11 01:54:03,137: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:54:03.137937612Z [2024-05-11 01:54:03,137: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:54:03.137994845Z [2024-05-11 01:54:03,137: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:54:03.138007330Z [2024-05-11 01:54:03,137: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:54:03.138228540Z [2024-05-11 01:54:03,138: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:54:03.138238142Z [2024-05-11 01:54:03,138: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:54:03.191555453Z [2024-05-11 01:54:03,191: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:54:03.219343894Z [2024-05-11 01:54:03,218: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:54:06.343767806Z [2024-05-11 01:54:06,343: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96a55567-8ed7-460a-bd40-aba161177f8d] succeeded in 5.274617938001029s: None 2024-05-11T01:54:06.764329337Z [2024-05-11 01:54:06,757: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a1f55a6-d163-4af3-ba21-20c589763990] succeeded in 5.7253165489983076s: None 2024-05-11T01:55:00.911688560Z [2024-05-11 01:55:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e9e8c12-9ba4-4c4a-a957-768775b3b902] received 2024-05-11T01:55:00.914619251Z [2024-05-11 01:55:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a545681-6130-4795-b166-8f12eb34dbab] received 2024-05-11T01:55:00.920541443Z [2024-05-11 01:55:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d35f279c-dca2-40c2-a894-4ac145167338] received 2024-05-11T01:55:00.926274051Z [2024-05-11 01:55:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9a2f2a7-2f4f-4436-bd69-f62a0dbcbe87] received 2024-05-11T01:55:00.930909286Z [2024-05-11 01:55:00,930: INFO/ForkPoolWorker-15] [6e9e8c12-9ba4-4c4a-a957-768775b3b902] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:00.934405324Z [2024-05-11 01:55:00,931: INFO/ForkPoolWorker-16] [7a545681-6130-4795-b166-8f12eb34dbab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:55:00.941304907Z [2024-05-11 01:55:00,941: INFO/ForkPoolWorker-2] [e9a2f2a7-2f4f-4436-bd69-f62a0dbcbe87] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:55:00.949608109Z [2024-05-11 01:55:00,949: INFO/ForkPoolWorker-1] [d35f279c-dca2-40c2-a894-4ac145167338] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:55:01.400914628Z [2024-05-11 01:55:01,395: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:55:01.402195509Z [2024-05-11 01:55:01,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:55:01.449697800Z [2024-05-11 01:55:01,446: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:55:01.669810751Z [2024-05-11 01:55:01,669: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T01:55:01.678937555Z [2024-05-11 01:55:01,678: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:01.688366345Z [2024-05-11 01:55:01,684: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:55:01.736420470Z [2024-05-11 01:55:01,736: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:55:01.737530530Z [2024-05-11 01:55:01,737: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:55:01.737672086Z [2024-05-11 01:55:01,737: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:55:01.737745703Z [2024-05-11 01:55:01,737: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T01:55:01.737998391Z [2024-05-11 01:55:01,737: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:55:01.851828759Z [2024-05-11 01:55:01,851: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:02.503302103Z [2024-05-11 01:55:02,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9a2f2a7-2f4f-4436-bd69-f62a0dbcbe87] succeeded in 1.5753498109988868s: None 2024-05-11T01:55:02.806035414Z [2024-05-11 01:55:02,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:55:02.809998663Z [2024-05-11 01:55:02,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:02.857409701Z [2024-05-11 01:55:02,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:55:02.859124815Z [2024-05-11 01:55:02,858: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:02.859179280Z [2024-05-11 01:55:02,859: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:02.859368050Z [2024-05-11 01:55:02,859: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:02.859447736Z [2024-05-11 01:55:02,859: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:55:02.859855647Z [2024-05-11 01:55:02,859: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:55:02.859967273Z [2024-05-11 01:55:02,859: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:02.988321071Z [2024-05-11 01:55:02,988: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:03.058843822Z [2024-05-11 01:55:03,058: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:55:03.062457770Z [2024-05-11 01:55:03,062: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:03.102666538Z [2024-05-11 01:55:03,102: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:55:03.107278985Z [2024-05-11 01:55:03,106: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:03.107308843Z [2024-05-11 01:55:03,107: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:03.107490938Z [2024-05-11 01:55:03,107: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:03.107618970Z [2024-05-11 01:55:03,107: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:55:03.107992132Z [2024-05-11 01:55:03,107: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:55:03.108095518Z [2024-05-11 01:55:03,107: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:03.194899349Z [2024-05-11 01:55:03,194: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:03.271511827Z [2024-05-11 01:55:03,271: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:55:03.276373485Z [2024-05-11 01:55:03,275: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:03.299942435Z [2024-05-11 01:55:03,299: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:55:03.301923618Z [2024-05-11 01:55:03,301: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:03.302076609Z [2024-05-11 01:55:03,301: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:03.302291046Z [2024-05-11 01:55:03,302: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:03.302510781Z [2024-05-11 01:55:03,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:55:03.302945024Z [2024-05-11 01:55:03,302: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:55:03.303082392Z [2024-05-11 01:55:03,302: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:03.423435219Z [2024-05-11 01:55:03,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:04.006937533Z [2024-05-11 01:55:04,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d3af8ff-d242-4c3f-b26c-64b55fb8060a] received 2024-05-11T01:55:04.015086563Z [2024-05-11 01:55:04,014: INFO/ForkPoolWorker-2] [3d3af8ff-d242-4c3f-b26c-64b55fb8060a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:04.103668221Z [2024-05-11 01:55:04,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e9e8c12-9ba4-4c4a-a957-768775b3b902] succeeded in 3.187734437000472s: None 2024-05-11T01:55:04.297360809Z [2024-05-11 01:55:04,294: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:55:05.107468779Z [2024-05-11 01:55:05,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d35f279c-dca2-40c2-a894-4ac145167338] succeeded in 4.165676868000446s: None 2024-05-11T01:55:05.525572827Z [2024-05-11 01:55:05,525: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:55:05.528837759Z [2024-05-11 01:55:05,528: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:05.553134593Z [2024-05-11 01:55:05,552: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:55:05.554572004Z [2024-05-11 01:55:05,554: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:05.554603186Z [2024-05-11 01:55:05,554: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:05.554762849Z [2024-05-11 01:55:05,554: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:05.554869703Z [2024-05-11 01:55:05,554: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:55:05.555189780Z [2024-05-11 01:55:05,555: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:55:05.555211092Z [2024-05-11 01:55:05,555: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:05.637671320Z [2024-05-11 01:55:05,637: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:06.251972964Z [2024-05-11 01:55:06,251: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d3af8ff-d242-4c3f-b26c-64b55fb8060a] succeeded in 2.242821563999314s: None 2024-05-11T01:55:06.255876169Z [2024-05-11 01:55:06,255: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a545681-6130-4795-b166-8f12eb34dbab] succeeded in 5.336131641000975s: None 2024-05-11T01:55:06.490775013Z [2024-05-11 01:55:06,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37badead-6c6b-45cc-bb8e-553ca9603fc5] received 2024-05-11T01:55:06.499538742Z [2024-05-11 01:55:06,499: INFO/ForkPoolWorker-15] [37badead-6c6b-45cc-bb8e-553ca9603fc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T01:55:06.874621643Z [2024-05-11 01:55:06,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:55:08.013928640Z [2024-05-11 01:55:08,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:55:08.017068164Z [2024-05-11 01:55:08,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:08.036064594Z [2024-05-11 01:55:08,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:55:08.037270061Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:08.037329599Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:08.037474777Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:08.037524181Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:55:08.037779075Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:55:08.037825203Z [2024-05-11 01:55:08,037: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:08.131022186Z [2024-05-11 01:55:08,130: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:08.684965757Z [2024-05-11 01:55:08,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37badead-6c6b-45cc-bb8e-553ca9603fc5] succeeded in 2.192448935998982s: None 2024-05-11T01:55:08.906867542Z [2024-05-11 01:55:08,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dac61e3-1c3b-4f86-87b5-016d44c98589] received 2024-05-11T01:55:08.922223637Z [2024-05-11 01:55:08,916: INFO/ForkPoolWorker-15] [6dac61e3-1c3b-4f86-87b5-016d44c98589] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T01:55:09.198631454Z [2024-05-11 01:55:09,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T01:55:10.298083701Z [2024-05-11 01:55:10,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:55:10.298106908Z [2024-05-11 01:55:10,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:55:10.330636680Z [2024-05-11 01:55:10,329: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:55:10.331571940Z [2024-05-11 01:55:10,331: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:55:10.331700103Z [2024-05-11 01:55:10,331: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:55:10.331971255Z [2024-05-11 01:55:10,331: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:55:10.332113134Z [2024-05-11 01:55:10,332: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:55:10.332615661Z [2024-05-11 01:55:10,332: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T01:55:10.334283952Z [2024-05-11 01:55:10,332: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:55:10.406291056Z [2024-05-11 01:55:10,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:55:10.937500445Z [2024-05-11 01:55:10,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6dac61e3-1c3b-4f86-87b5-016d44c98589] succeeded in 2.02791150000121s: None 2024-05-11T01:56:00.875673426Z [2024-05-11 01:56:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1877c5c-e673-4d81-b3ab-6268afe87abb] received 2024-05-11T01:56:00.881265856Z [2024-05-11 01:56:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac5a4654-4d1e-4011-8f33-5c7fc79c0813] received 2024-05-11T01:56:00.885602869Z [2024-05-11 01:56:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3c8886f-2a93-4f48-8038-6eb628cf3727] received 2024-05-11T01:56:00.892629274Z [2024-05-11 01:56:00,892: INFO/ForkPoolWorker-1] [f3c8886f-2a93-4f48-8038-6eb628cf3727] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:56:00.896038159Z [2024-05-11 01:56:00,895: INFO/ForkPoolWorker-16] [ac5a4654-4d1e-4011-8f33-5c7fc79c0813] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:56:00.896573567Z [2024-05-11 01:56:00,896: INFO/ForkPoolWorker-15] [c1877c5c-e673-4d81-b3ab-6268afe87abb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:56:00.897094191Z [2024-05-11 01:56:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bfd33bf-580a-452e-a926-c25815c774e7] received 2024-05-11T01:56:00.906830212Z [2024-05-11 01:56:00,906: INFO/ForkPoolWorker-2] [5bfd33bf-580a-452e-a926-c25815c774e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:56:01.318395597Z [2024-05-11 01:56:01,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:56:01.407212531Z [2024-05-11 01:56:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:56:01.432258352Z [2024-05-11 01:56:01,427: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:56:01.489329358Z [2024-05-11 01:56:01,488: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T01:56:01.493302403Z [2024-05-11 01:56:01,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:56:01.535276436Z [2024-05-11 01:56:01,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:56:01.539012473Z [2024-05-11 01:56:01,538: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:56:01.539096107Z [2024-05-11 01:56:01,538: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:56:01.539154307Z [2024-05-11 01:56:01,539: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T01:56:01.539447151Z [2024-05-11 01:56:01,539: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:56:01.560434218Z [2024-05-11 01:56:01,556: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:56:01.638227953Z [2024-05-11 01:56:01,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:56:01.805721803Z [2024-05-11 01:56:01,805: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:56:02.586655554Z [2024-05-11 01:56:02,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1877c5c-e673-4d81-b3ab-6268afe87abb] succeeded in 1.7042321940007241s: None 2024-05-11T01:56:02.737536672Z [2024-05-11 01:56:02,737: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3c8886f-2a93-4f48-8038-6eb628cf3727] succeeded in 1.850183091000872s: None 2024-05-11T01:56:03.064632223Z [2024-05-11 01:56:03,064: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T01:56:03.068000860Z [2024-05-11 01:56:03,067: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:56:03.081716058Z [2024-05-11 01:56:03,081: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:56:03.085716261Z [2024-05-11 01:56:03,085: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:56:03.091689563Z [2024-05-11 01:56:03,091: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:56:03.094401175Z [2024-05-11 01:56:03,094: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:56:03.094471453Z [2024-05-11 01:56:03,094: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:56:03.094723949Z [2024-05-11 01:56:03,094: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:56:03.094744595Z [2024-05-11 01:56:03,094: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T01:56:03.095406115Z [2024-05-11 01:56:03,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:56:03.096769126Z [2024-05-11 01:56:03,095: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:56:03.112321258Z [2024-05-11 01:56:03,112: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:56:03.113571516Z [2024-05-11 01:56:03,113: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:56:03.113647605Z [2024-05-11 01:56:03,113: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:56:03.113899942Z [2024-05-11 01:56:03,113: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:56:03.113964349Z [2024-05-11 01:56:03,113: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:56:03.114271917Z [2024-05-11 01:56:03,114: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:56:03.114342064Z [2024-05-11 01:56:03,114: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:56:03.187613309Z [2024-05-11 01:56:03,187: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:56:03.194702204Z [2024-05-11 01:56:03,194: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:56:04.785616337Z [2024-05-11 01:56:04,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac5a4654-4d1e-4011-8f33-5c7fc79c0813] succeeded in 3.901097171999936s: None 2024-05-11T01:56:05.349548055Z [2024-05-11 01:56:05,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5bfd33bf-580a-452e-a926-c25815c774e7] succeeded in 4.450818444000106s: None 2024-05-11T01:57:00.734978145Z [2024-05-11 01:57:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f03d0bbe-683f-4f52-a2a8-5bc04714645c] received 2024-05-11T01:57:00.741630607Z [2024-05-11 01:57:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6066d88b-0624-4ec0-b946-fd7a8cf55f3e] received 2024-05-11T01:57:00.742309491Z [2024-05-11 01:57:00,742: INFO/ForkPoolWorker-15] [f03d0bbe-683f-4f52-a2a8-5bc04714645c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:57:00.758043687Z [2024-05-11 01:57:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc485adc-e359-48a1-b0c2-16e42f7a5ac0] received 2024-05-11T01:57:00.759459926Z [2024-05-11 01:57:00,759: INFO/ForkPoolWorker-16] [6066d88b-0624-4ec0-b946-fd7a8cf55f3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:57:00.769160254Z [2024-05-11 01:57:00,768: INFO/ForkPoolWorker-1] [cc485adc-e359-48a1-b0c2-16e42f7a5ac0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:57:01.136392672Z [2024-05-11 01:57:01,132: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:57:01.277078460Z [2024-05-11 01:57:01,273: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:57:01.328926317Z [2024-05-11 01:57:01,325: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:57:01.453703358Z [2024-05-11 01:57:01,453: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:57:01.457696489Z [2024-05-11 01:57:01,457: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:57:01.503217806Z [2024-05-11 01:57:01,502: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:57:01.508819259Z [2024-05-11 01:57:01,508: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:57:01.509393324Z [2024-05-11 01:57:01,508: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:57:01.509409960Z [2024-05-11 01:57:01,509: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:57:01.510300377Z [2024-05-11 01:57:01,510: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:57:01.621949146Z [2024-05-11 01:57:01,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:57:02.212707373Z [2024-05-11 01:57:02,212: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6066d88b-0624-4ec0-b946-fd7a8cf55f3e] succeeded in 1.4639067899988731s: None 2024-05-11T01:57:02.446926856Z [2024-05-11 01:57:02,446: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:57:02.450187908Z [2024-05-11 01:57:02,449: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:57:02.476453654Z [2024-05-11 01:57:02,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:57:02.478751421Z [2024-05-11 01:57:02,478: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:57:02.478885458Z [2024-05-11 01:57:02,478: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:57:02.479098845Z [2024-05-11 01:57:02,478: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:57:02.479224049Z [2024-05-11 01:57:02,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:57:02.480074900Z [2024-05-11 01:57:02,479: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:57:02.480195745Z [2024-05-11 01:57:02,480: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:57:02.561558605Z [2024-05-11 01:57:02,561: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:57:02.639123500Z [2024-05-11 01:57:02,638: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:57:02.642544112Z [2024-05-11 01:57:02,642: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:57:02.666887232Z [2024-05-11 01:57:02,666: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:57:02.668568259Z [2024-05-11 01:57:02,668: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:57:02.668760913Z [2024-05-11 01:57:02,668: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:57:02.668972451Z [2024-05-11 01:57:02,668: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:57:02.669059510Z [2024-05-11 01:57:02,668: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:57:02.669390335Z [2024-05-11 01:57:02,669: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:57:02.669406988Z [2024-05-11 01:57:02,669: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:57:02.770228714Z [2024-05-11 01:57:02,769: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:57:04.028428682Z [2024-05-11 01:57:04,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f03d0bbe-683f-4f52-a2a8-5bc04714645c] succeeded in 3.2916423980004765s: None 2024-05-11T01:57:04.676724988Z [2024-05-11 01:57:04,676: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc485adc-e359-48a1-b0c2-16e42f7a5ac0] succeeded in 3.9141661819994624s: None 2024-05-11T01:58:00.562059883Z [2024-05-11 01:58:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[845de46e-41e8-4d54-888c-4f5673fb6354] received 2024-05-11T01:58:00.567612142Z [2024-05-11 01:58:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b57b9537-5528-4472-8807-94dcca3a75da] received 2024-05-11T01:58:00.576361331Z [2024-05-11 01:58:00,576: INFO/ForkPoolWorker-16] [b57b9537-5528-4472-8807-94dcca3a75da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:58:00.576395833Z [2024-05-11 01:58:00,575: INFO/ForkPoolWorker-15] [845de46e-41e8-4d54-888c-4f5673fb6354] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:58:00.578597517Z [2024-05-11 01:58:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f67bce98-167f-4a74-af73-3135b8c7a5d6] received 2024-05-11T01:58:00.588126515Z [2024-05-11 01:58:00,587: INFO/ForkPoolWorker-1] [f67bce98-167f-4a74-af73-3135b8c7a5d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T01:58:00.591795921Z [2024-05-11 01:58:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[290f2b6c-2648-410c-b3df-f5c46ceec55c] received 2024-05-11T01:58:00.605650894Z [2024-05-11 01:58:00,605: INFO/ForkPoolWorker-2] [290f2b6c-2648-410c-b3df-f5c46ceec55c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:58:00.892826610Z [2024-05-11 01:58:00,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:58:00.920855981Z [2024-05-11 01:58:00,916: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:58:00.977239009Z [2024-05-11 01:58:00,973: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:58:01.045993053Z [2024-05-11 01:58:01,042: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T01:58:01.269186222Z [2024-05-11 01:58:01,268: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:58:01.273289731Z [2024-05-11 01:58:01,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:58:01.315052985Z [2024-05-11 01:58:01,314: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:58:01.319405230Z [2024-05-11 01:58:01,319: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:58:01.319583039Z [2024-05-11 01:58:01,319: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:58:01.319758786Z [2024-05-11 01:58:01,319: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:58:01.320125175Z [2024-05-11 01:58:01,319: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:58:01.456978384Z [2024-05-11 01:58:01,456: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:58:01.474806729Z [2024-05-11 01:58:01,474: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:58:02.061325676Z [2024-05-11 01:58:02,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b57b9537-5528-4472-8807-94dcca3a75da] succeeded in 1.4906233209985658s: None 2024-05-11T01:58:02.166213785Z [2024-05-11 01:58:02,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f67bce98-167f-4a74-af73-3135b8c7a5d6] succeeded in 1.5845953879997978s: None 2024-05-11T01:58:02.294514060Z [2024-05-11 01:58:02,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:58:02.297791493Z [2024-05-11 01:58:02,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:58:02.322372609Z [2024-05-11 01:58:02,322: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:58:02.324783759Z [2024-05-11 01:58:02,324: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:58:02.324908444Z [2024-05-11 01:58:02,324: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:58:02.325092802Z [2024-05-11 01:58:02,324: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:58:02.325200835Z [2024-05-11 01:58:02,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:58:02.325531006Z [2024-05-11 01:58:02,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:58:02.325690780Z [2024-05-11 01:58:02,325: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:58:02.358916920Z [2024-05-11 01:58:02,358: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T01:58:02.362113965Z [2024-05-11 01:58:02,361: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:58:02.392487567Z [2024-05-11 01:58:02,392: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T01:58:02.393658025Z [2024-05-11 01:58:02,393: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:58:02.393692087Z [2024-05-11 01:58:02,393: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:58:02.393738558Z [2024-05-11 01:58:02,393: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:58:02.393790454Z [2024-05-11 01:58:02,393: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T01:58:02.394961381Z [2024-05-11 01:58:02,394: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:58:02.394975191Z [2024-05-11 01:58:02,394: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:58:02.420932796Z [2024-05-11 01:58:02,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:58:02.479301436Z [2024-05-11 01:58:02,479: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:58:03.925626819Z [2024-05-11 01:58:03,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[845de46e-41e8-4d54-888c-4f5673fb6354] succeeded in 3.360711586999969s: None 2024-05-11T01:58:04.379112329Z [2024-05-11 01:58:04,378: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[290f2b6c-2648-410c-b3df-f5c46ceec55c] succeeded in 3.7845303600006446s: None 2024-05-11T01:59:00.222575104Z [2024-05-11 01:59:00,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27153d15-8658-4e6e-ae57-52a88bde5945] received 2024-05-11T01:59:00.229982166Z [2024-05-11 01:59:00,229: INFO/ForkPoolWorker-15] [27153d15-8658-4e6e-ae57-52a88bde5945] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T01:59:00.235679972Z [2024-05-11 01:59:00,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97bd03f4-0d0c-4df8-8bcc-38d617164d91] received 2024-05-11T01:59:00.240004791Z [2024-05-11 01:59:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e67a12b7-dbc2-46a1-9150-d453cd53e29a] received 2024-05-11T01:59:00.253202734Z [2024-05-11 01:59:00,252: INFO/ForkPoolWorker-1] [e67a12b7-dbc2-46a1-9150-d453cd53e29a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T01:59:00.260933780Z [2024-05-11 01:59:00,260: INFO/ForkPoolWorker-16] [97bd03f4-0d0c-4df8-8bcc-38d617164d91] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T01:59:00.626024155Z [2024-05-11 01:59:00,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T01:59:00.667339894Z [2024-05-11 01:59:00,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T01:59:00.826909849Z [2024-05-11 01:59:00,825: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T01:59:00.830895018Z [2024-05-11 01:59:00,830: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:59:00.850745578Z [2024-05-11 01:59:00,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T01:59:00.851593799Z [2024-05-11 01:59:00,851: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T01:59:00.851644208Z [2024-05-11 01:59:00,851: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T01:59:00.851693093Z [2024-05-11 01:59:00,851: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T01:59:00.851919426Z [2024-05-11 01:59:00,851: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T01:59:00.857879401Z [2024-05-11 01:59:00,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T01:59:00.939397870Z [2024-05-11 01:59:00,939: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:59:01.570877560Z [2024-05-11 01:59:01,570: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97bd03f4-0d0c-4df8-8bcc-38d617164d91] succeeded in 1.3319122890006838s: None 2024-05-11T01:59:01.858578661Z [2024-05-11 01:59:01,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T01:59:01.861775864Z [2024-05-11 01:59:01,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:59:01.883944407Z [2024-05-11 01:59:01,883: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T01:59:01.885387691Z [2024-05-11 01:59:01,885: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:59:01.885658634Z [2024-05-11 01:59:01,885: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:59:01.885945209Z [2024-05-11 01:59:01,885: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:59:01.886046416Z [2024-05-11 01:59:01,885: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T01:59:01.888595042Z [2024-05-11 01:59:01,888: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T01:59:01.888685083Z [2024-05-11 01:59:01,888: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:59:01.965368564Z [2024-05-11 01:59:01,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:59:02.168479782Z [2024-05-11 01:59:02,168: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T01:59:02.171598940Z [2024-05-11 01:59:02,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T01:59:02.192643716Z [2024-05-11 01:59:02,192: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T01:59:02.194122695Z [2024-05-11 01:59:02,193: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T01:59:02.194330979Z [2024-05-11 01:59:02,194: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T01:59:02.194534447Z [2024-05-11 01:59:02,194: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T01:59:02.194658345Z [2024-05-11 01:59:02,194: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T01:59:02.194969875Z [2024-05-11 01:59:02,194: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T01:59:02.194982795Z [2024-05-11 01:59:02,194: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T01:59:02.287034955Z [2024-05-11 01:59:02,286: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T01:59:03.583365418Z [2024-05-11 01:59:03,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27153d15-8658-4e6e-ae57-52a88bde5945] succeeded in 3.358878941000512s: None 2024-05-11T01:59:04.801736115Z [2024-05-11 01:59:04,800: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e67a12b7-dbc2-46a1-9150-d453cd53e29a] succeeded in 4.559423189999507s: None 2024-05-11T02:00:00.421102496Z [2024-05-11 02:00:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2851de2b-21d7-401d-8f9e-2a1ad74ab3cb] received 2024-05-11T02:00:00.426490544Z [2024-05-11 02:00:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[913d7976-bd53-4c59-a1d1-2c76e08f2073] received 2024-05-11T02:00:00.435699605Z [2024-05-11 02:00:00,435: INFO/ForkPoolWorker-16] [913d7976-bd53-4c59-a1d1-2c76e08f2073] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:00:00.443779969Z [2024-05-11 02:00:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b2bdb03-e151-4b59-ba3b-4c31987cf8fb] received 2024-05-11T02:00:00.446652443Z [2024-05-11 02:00:00,446: INFO/ForkPoolWorker-15] [2851de2b-21d7-401d-8f9e-2a1ad74ab3cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:00:00.454055187Z [2024-05-11 02:00:00,452: INFO/ForkPoolWorker-1] [9b2bdb03-e151-4b59-ba3b-4c31987cf8fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:00.454077309Z [2024-05-11 02:00:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80af49b0-d98f-4a7f-9b2b-19cbf231c257] received 2024-05-11T02:00:00.455344704Z [2024-05-11 02:00:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d22451b-320d-43a9-a90e-20d7defceca4] received 2024-05-11T02:00:00.469752796Z [2024-05-11 02:00:00,469: INFO/ForkPoolWorker-2] [80af49b0-d98f-4a7f-9b2b-19cbf231c257] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:00:00.491110247Z [2024-05-11 02:00:00,490: INFO/ForkPoolWorker-3] [2d22451b-320d-43a9-a90e-20d7defceca4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:00:00.838968513Z [2024-05-11 02:00:00,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:00:01.012200600Z [2024-05-11 02:00:00,998: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:00:01.364192952Z [2024-05-11 02:00:01,359: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:00:01.607554775Z [2024-05-11 02:00:01,597: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:00:01.609664326Z [2024-05-11 02:00:01,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:00:01.647795698Z [2024-05-11 02:00:01,647: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:01.942643448Z [2024-05-11 02:00:01,942: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:00:01.950055941Z [2024-05-11 02:00:01,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:01.997196501Z [2024-05-11 02:00:01,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:00:02.004351568Z [2024-05-11 02:00:02,004: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:00:02.006163864Z [2024-05-11 02:00:02,004: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:00:02.006568388Z [2024-05-11 02:00:02,006: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:00:02.007756064Z [2024-05-11 02:00:02,007: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:00:02.143381309Z [2024-05-11 02:00:02,143: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:02.544110307Z [2024-05-11 02:00:02,543: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[80af49b0-d98f-4a7f-9b2b-19cbf231c257] succeeded in 2.088678718000665s: None 2024-05-11T02:00:02.841037920Z [2024-05-11 02:00:02,840: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:00:02.844664401Z [2024-05-11 02:00:02,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:02.889916456Z [2024-05-11 02:00:02,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:00:02.895834681Z [2024-05-11 02:00:02,895: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:02.896893415Z [2024-05-11 02:00:02,895: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:02.898346827Z [2024-05-11 02:00:02,896: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:02.898579779Z [2024-05-11 02:00:02,898: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:00:02.899049958Z [2024-05-11 02:00:02,898: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:00:02.900184485Z [2024-05-11 02:00:02,899: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:03.021416200Z [2024-05-11 02:00:03,020: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[913d7976-bd53-4c59-a1d1-2c76e08f2073] succeeded in 2.5935877499996423s: None 2024-05-11T02:00:03.034646210Z [2024-05-11 02:00:03,034: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:03.239057708Z [2024-05-11 02:00:03,238: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:00:03.242668491Z [2024-05-11 02:00:03,242: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:03.262850226Z [2024-05-11 02:00:03,262: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T02:00:03.264979388Z [2024-05-11 02:00:03,264: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:00:03.266532328Z [2024-05-11 02:00:03,266: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:03.266545979Z [2024-05-11 02:00:03,266: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:03.266556409Z [2024-05-11 02:00:03,266: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:03.266786800Z [2024-05-11 02:00:03,266: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:03.266867280Z [2024-05-11 02:00:03,266: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:00:03.267867146Z [2024-05-11 02:00:03,267: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:00:03.267890029Z [2024-05-11 02:00:03,267: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:03.305123950Z [2024-05-11 02:00:03,304: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T02:00:03.307205562Z [2024-05-11 02:00:03,306: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:03.307234127Z [2024-05-11 02:00:03,306: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:03.307426878Z [2024-05-11 02:00:03,307: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:03.307557931Z [2024-05-11 02:00:03,307: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T02:00:03.308177765Z [2024-05-11 02:00:03,307: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:00:03.308335591Z [2024-05-11 02:00:03,308: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:03.380462447Z [2024-05-11 02:00:03,380: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:03.431160558Z [2024-05-11 02:00:03,430: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:04.133269715Z [2024-05-11 02:00:04,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b2bdb03-e151-4b59-ba3b-4c31987cf8fb] succeeded in 3.6875846949988045s: None 2024-05-11T02:00:04.308360892Z [2024-05-11 02:00:04,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d6c06b2-c31b-44e0-afb5-5c1e654a2e19] received 2024-05-11T02:00:04.317244842Z [2024-05-11 02:00:04,316: INFO/ForkPoolWorker-16] [3d6c06b2-c31b-44e0-afb5-5c1e654a2e19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:04.600808943Z [2024-05-11 02:00:04,597: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:00:05.074480408Z [2024-05-11 02:00:05,073: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2d22451b-320d-43a9-a90e-20d7defceca4] succeeded in 4.61468166800114s: None 2024-05-11T02:00:05.262727469Z [2024-05-11 02:00:05,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2851de2b-21d7-401d-8f9e-2a1ad74ab3cb] succeeded in 4.839480119000655s: None 2024-05-11T02:00:05.737318360Z [2024-05-11 02:00:05,736: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:00:05.740570520Z [2024-05-11 02:00:05,740: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:05.763878651Z [2024-05-11 02:00:05,763: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:00:05.765384288Z [2024-05-11 02:00:05,765: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:05.765597563Z [2024-05-11 02:00:05,765: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:05.765941639Z [2024-05-11 02:00:05,765: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:05.766290526Z [2024-05-11 02:00:05,766: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:00:05.766744705Z [2024-05-11 02:00:05,766: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:00:05.766921328Z [2024-05-11 02:00:05,766: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:05.872826219Z [2024-05-11 02:00:05,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:06.507597147Z [2024-05-11 02:00:06,507: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d6c06b2-c31b-44e0-afb5-5c1e654a2e19] succeeded in 2.1981404990001465s: None 2024-05-11T02:00:06.982229791Z [2024-05-11 02:00:06,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96c33655-eb7a-464c-993d-37c07c46e7ef] received 2024-05-11T02:00:06.992930795Z [2024-05-11 02:00:06,992: INFO/ForkPoolWorker-15] [96c33655-eb7a-464c-993d-37c07c46e7ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:00:07.341650416Z [2024-05-11 02:00:07,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:00:08.490675661Z [2024-05-11 02:00:08,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:00:08.493974940Z [2024-05-11 02:00:08,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:08.522349077Z [2024-05-11 02:00:08,522: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:00:08.524022374Z [2024-05-11 02:00:08,523: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:08.524106377Z [2024-05-11 02:00:08,523: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:08.524418199Z [2024-05-11 02:00:08,524: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:08.524609121Z [2024-05-11 02:00:08,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:00:08.525025968Z [2024-05-11 02:00:08,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:00:08.525195708Z [2024-05-11 02:00:08,524: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:08.630273115Z [2024-05-11 02:00:08,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:10.343427088Z [2024-05-11 02:00:10,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96c33655-eb7a-464c-993d-37c07c46e7ef] succeeded in 3.3579033969999728s: None 2024-05-11T02:00:10.477081042Z [2024-05-11 02:00:10,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[800cc44f-ed9e-4aa8-b609-1895f432f60c] received 2024-05-11T02:00:10.492300651Z [2024-05-11 02:00:10,491: INFO/ForkPoolWorker-15] [800cc44f-ed9e-4aa8-b609-1895f432f60c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:00:10.757943933Z [2024-05-11 02:00:10,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:00:12.035366117Z [2024-05-11 02:00:12,034: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:00:12.039253478Z [2024-05-11 02:00:12,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:00:12.064515493Z [2024-05-11 02:00:12,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:00:12.066729005Z [2024-05-11 02:00:12,066: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:00:12.066949857Z [2024-05-11 02:00:12,066: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:00:12.067172610Z [2024-05-11 02:00:12,066: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:00:12.067194599Z [2024-05-11 02:00:12,067: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:00:12.067765206Z [2024-05-11 02:00:12,067: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:00:12.068087204Z [2024-05-11 02:00:12,067: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:00:12.166337988Z [2024-05-11 02:00:12,166: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:00:12.788570092Z [2024-05-11 02:00:12,787: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[800cc44f-ed9e-4aa8-b609-1895f432f60c] succeeded in 2.3089332269992155s: None 2024-05-11T02:01:01.238684682Z [2024-05-11 02:01:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e031b374-9f77-447d-b252-3b5755ead8d9] received 2024-05-11T02:01:01.243836296Z [2024-05-11 02:01:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aed5540f-c4fd-46a6-ad13-0aa87ac2ae8b] received 2024-05-11T02:01:01.245458914Z [2024-05-11 02:01:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[959146d7-1a4e-4b80-bbf4-d803ed92b267] received 2024-05-11T02:01:01.246818406Z [2024-05-11 02:01:01,246: INFO/ForkPoolWorker-15] [e031b374-9f77-447d-b252-3b5755ead8d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:01:01.254905912Z [2024-05-11 02:01:01,254: INFO/ForkPoolWorker-16] [aed5540f-c4fd-46a6-ad13-0aa87ac2ae8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:01:01.258586966Z [2024-05-11 02:01:01,258: INFO/ForkPoolWorker-1] [959146d7-1a4e-4b80-bbf4-d803ed92b267] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:01:01.564532609Z [2024-05-11 02:01:01,560: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:01:01.575931445Z [2024-05-11 02:01:01,572: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:01:01.596197399Z [2024-05-11 02:01:01,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:01:01.736259437Z [2024-05-11 02:01:01,735: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:01:01.741673816Z [2024-05-11 02:01:01,741: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:01:01.767967683Z [2024-05-11 02:01:01,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:01:01.769084603Z [2024-05-11 02:01:01,768: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:01:01.769748190Z [2024-05-11 02:01:01,769: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:01:01.770038088Z [2024-05-11 02:01:01,769: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:01:01.770542964Z [2024-05-11 02:01:01,770: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:01:01.862106543Z [2024-05-11 02:01:01,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:01:02.516844462Z [2024-05-11 02:01:02,516: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aed5540f-c4fd-46a6-ad13-0aa87ac2ae8b] succeeded in 1.2698857420000422s: None 2024-05-11T02:01:02.815337812Z [2024-05-11 02:01:02,814: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:01:02.818629348Z [2024-05-11 02:01:02,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:01:02.839162933Z [2024-05-11 02:01:02,838: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:01:02.840748940Z [2024-05-11 02:01:02,840: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:01:02.840872644Z [2024-05-11 02:01:02,840: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:01:02.841057539Z [2024-05-11 02:01:02,840: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:01:02.841186989Z [2024-05-11 02:01:02,841: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:01:02.841523425Z [2024-05-11 02:01:02,841: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:01:02.841598218Z [2024-05-11 02:01:02,841: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:01:02.928779800Z [2024-05-11 02:01:02,928: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:01:02.948144757Z [2024-05-11 02:01:02,947: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:01:02.951632270Z [2024-05-11 02:01:02,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:01:02.977497426Z [2024-05-11 02:01:02,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:01:02.978880415Z [2024-05-11 02:01:02,978: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:01:02.978901477Z [2024-05-11 02:01:02,978: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:01:02.979102920Z [2024-05-11 02:01:02,978: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:01:02.979251628Z [2024-05-11 02:01:02,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:01:02.979564151Z [2024-05-11 02:01:02,979: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:01:02.979692806Z [2024-05-11 02:01:02,979: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:01:03.086598140Z [2024-05-11 02:01:03,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:01:04.977201364Z [2024-05-11 02:01:04,976: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[959146d7-1a4e-4b80-bbf4-d803ed92b267] succeeded in 3.7298456950011314s: None 2024-05-11T02:01:05.401371747Z [2024-05-11 02:01:05,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e031b374-9f77-447d-b252-3b5755ead8d9] succeeded in 4.161161867999908s: None 2024-05-11T02:02:01.140220800Z [2024-05-11 02:02:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99d70722-81d9-4c28-a76d-a79e0ff1bc0c] received 2024-05-11T02:02:01.142965658Z [2024-05-11 02:02:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[784fb8b8-1536-4a90-8c9b-002be2ff5582] received 2024-05-11T02:02:01.157851183Z [2024-05-11 02:02:01,157: INFO/ForkPoolWorker-15] [99d70722-81d9-4c28-a76d-a79e0ff1bc0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:02:01.158275755Z [2024-05-11 02:02:01,158: INFO/ForkPoolWorker-16] [784fb8b8-1536-4a90-8c9b-002be2ff5582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:02:01.179051482Z [2024-05-11 02:02:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ef19a4b-d3f1-4b32-8229-f40deb9f9a8e] received 2024-05-11T02:02:01.180983658Z [2024-05-11 02:02:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ba8beb9-589f-48c2-a0cb-90b3fbe75893] received 2024-05-11T02:02:01.193474635Z [2024-05-11 02:02:01,193: INFO/ForkPoolWorker-1] [0ef19a4b-d3f1-4b32-8229-f40deb9f9a8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:02:01.198130091Z [2024-05-11 02:02:01,197: INFO/ForkPoolWorker-2] [4ba8beb9-589f-48c2-a0cb-90b3fbe75893] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:02:01.479688515Z [2024-05-11 02:02:01,476: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:02:01.507135471Z [2024-05-11 02:02:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:02:01.547934873Z [2024-05-11 02:02:01,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:02:01.558503392Z [2024-05-11 02:02:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:02:01.709006680Z [2024-05-11 02:02:01,708: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:02:01.713102995Z [2024-05-11 02:02:01,712: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:02:01.761991073Z [2024-05-11 02:02:01,761: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:02:01.763633765Z [2024-05-11 02:02:01,763: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:02:01.763743250Z [2024-05-11 02:02:01,763: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:02:01.763888203Z [2024-05-11 02:02:01,763: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:02:01.764126333Z [2024-05-11 02:02:01,764: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:02:01.777615883Z [2024-05-11 02:02:01,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:02:01.899230962Z [2024-05-11 02:02:01,898: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:02:02.379797195Z [2024-05-11 02:02:02,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99d70722-81d9-4c28-a76d-a79e0ff1bc0c] succeeded in 1.236714402999496s: None 2024-05-11T02:02:02.539027279Z [2024-05-11 02:02:02,538: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ba8beb9-589f-48c2-a0cb-90b3fbe75893] succeeded in 1.3535855720001564s: None 2024-05-11T02:02:02.893243793Z [2024-05-11 02:02:02,892: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:02:02.897301673Z [2024-05-11 02:02:02,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:02:02.921122367Z [2024-05-11 02:02:02,920: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:02:02.922460681Z [2024-05-11 02:02:02,922: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:02:02.922528434Z [2024-05-11 02:02:02,922: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:02:02.922698557Z [2024-05-11 02:02:02,922: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:02:02.922761334Z [2024-05-11 02:02:02,922: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:02:02.923039833Z [2024-05-11 02:02:02,922: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:02:02.923115532Z [2024-05-11 02:02:02,923: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:02:02.984299122Z [2024-05-11 02:02:02,983: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:02:02.987376905Z [2024-05-11 02:02:02,986: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:02:03.001618967Z [2024-05-11 02:02:03,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:02:03.025025191Z [2024-05-11 02:02:03,024: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:02:03.026609471Z [2024-05-11 02:02:03,026: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:02:03.026636289Z [2024-05-11 02:02:03,026: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:02:03.026824589Z [2024-05-11 02:02:03,026: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:02:03.026993093Z [2024-05-11 02:02:03,026: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:02:03.027487566Z [2024-05-11 02:02:03,027: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:02:03.027524330Z [2024-05-11 02:02:03,027: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:02:03.111172399Z [2024-05-11 02:02:03,110: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:02:04.840979086Z [2024-05-11 02:02:04,840: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ef19a4b-d3f1-4b32-8229-f40deb9f9a8e] succeeded in 3.6586346900003264s: None 2024-05-11T02:02:05.142326101Z [2024-05-11 02:02:05,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[784fb8b8-1536-4a90-8c9b-002be2ff5582] succeeded in 3.9962507099990034s: None 2024-05-11T02:03:00.377659024Z [2024-05-11 02:03:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec49c3ee-e1a9-4a72-9fd5-b669c72951e5] received 2024-05-11T02:03:00.385556784Z [2024-05-11 02:03:00,385: INFO/ForkPoolWorker-15] [ec49c3ee-e1a9-4a72-9fd5-b669c72951e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:03:00.395018468Z [2024-05-11 02:03:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b6b993c-ff8e-4cdb-ab6d-f8b15c2317ed] received 2024-05-11T02:03:00.397741657Z [2024-05-11 02:03:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[912b5607-da79-4db3-8e14-82ff2fa2a6af] received 2024-05-11T02:03:00.406343528Z [2024-05-11 02:03:00,406: INFO/ForkPoolWorker-1] [912b5607-da79-4db3-8e14-82ff2fa2a6af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:03:00.407543020Z [2024-05-11 02:03:00,407: INFO/ForkPoolWorker-16] [9b6b993c-ff8e-4cdb-ab6d-f8b15c2317ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:03:00.724657764Z [2024-05-11 02:03:00,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:03:00.777665607Z [2024-05-11 02:03:00,774: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:03:00.823690545Z [2024-05-11 02:03:00,820: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:03:00.924974815Z [2024-05-11 02:03:00,924: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:03:00.928870493Z [2024-05-11 02:03:00,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:03:00.951211477Z [2024-05-11 02:03:00,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:03:00.952361823Z [2024-05-11 02:03:00,952: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:03:00.952469365Z [2024-05-11 02:03:00,952: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:03:00.952541250Z [2024-05-11 02:03:00,952: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:03:00.953098812Z [2024-05-11 02:03:00,952: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:03:01.046798695Z [2024-05-11 02:03:01,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:03:01.725831510Z [2024-05-11 02:03:01,725: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b6b993c-ff8e-4cdb-ab6d-f8b15c2317ed] succeeded in 1.3294019750010193s: None 2024-05-11T02:03:01.896895256Z [2024-05-11 02:03:01,896: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:03:01.900923525Z [2024-05-11 02:03:01,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:03:01.925328712Z [2024-05-11 02:03:01,925: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:03:01.926995024Z [2024-05-11 02:03:01,926: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:03:01.927175515Z [2024-05-11 02:03:01,926: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:03:01.927403533Z [2024-05-11 02:03:01,927: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:03:01.927559768Z [2024-05-11 02:03:01,927: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:03:01.928415828Z [2024-05-11 02:03:01,928: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:03:01.928541079Z [2024-05-11 02:03:01,928: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:03:01.995747488Z [2024-05-11 02:03:01,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:03:01.998908814Z [2024-05-11 02:03:01,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:03:02.019718951Z [2024-05-11 02:03:02,019: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:03:02.026098383Z [2024-05-11 02:03:02,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:03:02.027512987Z [2024-05-11 02:03:02,027: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:03:02.027625530Z [2024-05-11 02:03:02,027: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:03:02.027835218Z [2024-05-11 02:03:02,027: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:03:02.027852070Z [2024-05-11 02:03:02,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:03:02.028215297Z [2024-05-11 02:03:02,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:03:02.028379672Z [2024-05-11 02:03:02,028: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:03:02.104016450Z [2024-05-11 02:03:02,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:03:03.580363789Z [2024-05-11 02:03:03,579: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[912b5607-da79-4db3-8e14-82ff2fa2a6af] succeeded in 3.178404539001349s: None 2024-05-11T02:03:04.082720338Z [2024-05-11 02:03:04,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec49c3ee-e1a9-4a72-9fd5-b669c72951e5] succeeded in 3.702726203999191s: None 2024-05-11T02:04:00.657670465Z [2024-05-11 02:04:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ece01b9d-1406-487c-a997-75ac6324da75] received 2024-05-11T02:04:00.659550214Z [2024-05-11 02:04:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[622ac20d-701e-4ab7-b3fb-31307c57329b] received 2024-05-11T02:04:00.666846029Z [2024-05-11 02:04:00,666: INFO/ForkPoolWorker-15] [ece01b9d-1406-487c-a997-75ac6324da75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:04:00.668300213Z [2024-05-11 02:04:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7de5a9b9-7e89-49d0-9d25-0fc912160b92] received 2024-05-11T02:04:00.674749041Z [2024-05-11 02:04:00,674: INFO/ForkPoolWorker-16] [622ac20d-701e-4ab7-b3fb-31307c57329b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:04:00.679035947Z [2024-05-11 02:04:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a98569b9-e6ef-4b8f-83ab-940a91f538dd] received 2024-05-11T02:04:00.686185367Z [2024-05-11 02:04:00,685: INFO/ForkPoolWorker-1] [7de5a9b9-7e89-49d0-9d25-0fc912160b92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:04:00.700173335Z [2024-05-11 02:04:00,699: INFO/ForkPoolWorker-2] [a98569b9-e6ef-4b8f-83ab-940a91f538dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:04:01.030030921Z [2024-05-11 02:04:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:04:01.034014103Z [2024-05-11 02:04:01,025: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:04:01.152298114Z [2024-05-11 02:04:01,149: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:04:01.193638469Z [2024-05-11 02:04:01,188: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:04:01.433604168Z [2024-05-11 02:04:01,433: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:04:01.465278110Z [2024-05-11 02:04:01,464: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:04:01.469354171Z [2024-05-11 02:04:01,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:04:01.523636945Z [2024-05-11 02:04:01,523: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:04:01.531246421Z [2024-05-11 02:04:01,530: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:04:01.531593756Z [2024-05-11 02:04:01,531: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:04:01.531689905Z [2024-05-11 02:04:01,531: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:04:01.531948557Z [2024-05-11 02:04:01,531: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:04:01.640014459Z [2024-05-11 02:04:01,639: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:04:02.418937365Z [2024-05-11 02:04:02,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7de5a9b9-7e89-49d0-9d25-0fc912160b92] succeeded in 1.7493990439998015s: None 2024-05-11T02:04:02.422091896Z [2024-05-11 02:04:02,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[622ac20d-701e-4ab7-b3fb-31307c57329b] succeeded in 1.7608452590011439s: None 2024-05-11T02:04:02.590380631Z [2024-05-11 02:04:02,590: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:04:02.593786990Z [2024-05-11 02:04:02,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:04:02.630986081Z [2024-05-11 02:04:02,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:04:02.632711281Z [2024-05-11 02:04:02,632: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:04:02.632752311Z [2024-05-11 02:04:02,632: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:04:02.632951686Z [2024-05-11 02:04:02,632: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:04:02.632984026Z [2024-05-11 02:04:02,632: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:04:02.633398712Z [2024-05-11 02:04:02,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:04:02.633413148Z [2024-05-11 02:04:02,633: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:04:02.668072734Z [2024-05-11 02:04:02,667: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:04:02.671454021Z [2024-05-11 02:04:02,671: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:04:02.707049393Z [2024-05-11 02:04:02,706: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:04:02.716175494Z [2024-05-11 02:04:02,715: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:04:02.716354854Z [2024-05-11 02:04:02,716: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:04:02.716620100Z [2024-05-11 02:04:02,716: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:04:02.716748453Z [2024-05-11 02:04:02,716: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:04:02.717172404Z [2024-05-11 02:04:02,716: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:04:02.717335685Z [2024-05-11 02:04:02,717: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:04:02.721800722Z [2024-05-11 02:04:02,721: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:04:02.807251634Z [2024-05-11 02:04:02,806: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:04:04.293472573Z [2024-05-11 02:04:04,292: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ece01b9d-1406-487c-a997-75ac6324da75] succeeded in 3.6336379189997388s: None 2024-05-11T02:04:05.421184668Z [2024-05-11 02:04:05,420: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a98569b9-e6ef-4b8f-83ab-940a91f538dd] succeeded in 4.740249858001334s: None 2024-05-11T02:05:00.948023769Z [2024-05-11 02:05:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[356a4081-7e1c-4687-b05c-c15acb4986e4] received 2024-05-11T02:05:00.951538272Z [2024-05-11 02:05:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be475677-8932-45e7-90b6-57e41cd70402] received 2024-05-11T02:05:00.955354719Z [2024-05-11 02:05:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00ee5a91-e1f0-404c-a059-350cf067b860] received 2024-05-11T02:05:00.958139330Z [2024-05-11 02:05:00,957: INFO/ForkPoolWorker-15] [356a4081-7e1c-4687-b05c-c15acb4986e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:05:00.959144161Z [2024-05-11 02:05:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d0e4a8e-c526-4909-b3c2-f38c2007cb84] received 2024-05-11T02:05:00.965661525Z [2024-05-11 02:05:00,965: INFO/ForkPoolWorker-16] [be475677-8932-45e7-90b6-57e41cd70402] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:05:00.966391832Z [2024-05-11 02:05:00,966: INFO/ForkPoolWorker-2] [8d0e4a8e-c526-4909-b3c2-f38c2007cb84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:05:00.966404575Z [2024-05-11 02:05:00,966: INFO/ForkPoolWorker-1] [00ee5a91-e1f0-404c-a059-350cf067b860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:01.312117987Z [2024-05-11 02:05:01,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:05:01.332244385Z [2024-05-11 02:05:01,329: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:05:01.500471750Z [2024-05-11 02:05:01,500: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:05:01.504688333Z [2024-05-11 02:05:01,504: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:01.555120974Z [2024-05-11 02:05:01,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:05:01.559183593Z [2024-05-11 02:05:01,558: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:05:01.559473080Z [2024-05-11 02:05:01,559: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:05:01.559663562Z [2024-05-11 02:05:01,559: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:05:01.560126277Z [2024-05-11 02:05:01,559: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:05:01.560879691Z [2024-05-11 02:05:01,557: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:05:01.572836895Z [2024-05-11 02:05:01,569: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:05:01.687289807Z [2024-05-11 02:05:01,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:02.350398391Z [2024-05-11 02:05:02,350: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be475677-8932-45e7-90b6-57e41cd70402] succeeded in 1.3952092710005672s: None 2024-05-11T02:05:02.485505371Z [2024-05-11 02:05:02,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:05:02.488902739Z [2024-05-11 02:05:02,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:02.511825583Z [2024-05-11 02:05:02,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:05:02.515533918Z [2024-05-11 02:05:02,515: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:02.515553153Z [2024-05-11 02:05:02,515: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:02.515718204Z [2024-05-11 02:05:02,515: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:02.516284639Z [2024-05-11 02:05:02,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:05:02.516793665Z [2024-05-11 02:05:02,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:05:02.517242498Z [2024-05-11 02:05:02,517: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:02.596889676Z [2024-05-11 02:05:02,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:02.787618465Z [2024-05-11 02:05:02,787: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:05:02.791296597Z [2024-05-11 02:05:02,790: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:02.810469166Z [2024-05-11 02:05:02,810: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:05:02.813815065Z [2024-05-11 02:05:02,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:02.829051766Z [2024-05-11 02:05:02,828: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:05:02.831518936Z [2024-05-11 02:05:02,831: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:02.831586241Z [2024-05-11 02:05:02,831: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:02.831975220Z [2024-05-11 02:05:02,831: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:02.832063577Z [2024-05-11 02:05:02,831: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:05:02.832571846Z [2024-05-11 02:05:02,832: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:05:02.832694940Z [2024-05-11 02:05:02,832: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:02.838449044Z [2024-05-11 02:05:02,838: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:05:02.842693746Z [2024-05-11 02:05:02,842: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:02.842748598Z [2024-05-11 02:05:02,842: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:02.843245570Z [2024-05-11 02:05:02,843: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:02.843729256Z [2024-05-11 02:05:02,843: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:05:02.844232697Z [2024-05-11 02:05:02,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:05:02.844519107Z [2024-05-11 02:05:02,844: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:02.935058107Z [2024-05-11 02:05:02,934: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:02.967512745Z [2024-05-11 02:05:02,967: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:03.607700719Z [2024-05-11 02:05:03,606: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00ee5a91-e1f0-404c-a059-350cf067b860] succeeded in 2.6491625910002767s: None 2024-05-11T02:05:03.767308051Z [2024-05-11 02:05:03,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75d0776b-7111-4248-8d98-d33580d712a5] received 2024-05-11T02:05:03.773325742Z [2024-05-11 02:05:03,773: INFO/ForkPoolWorker-16] [75d0776b-7111-4248-8d98-d33580d712a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:04.145006958Z [2024-05-11 02:05:04,135: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:05:04.266753673Z [2024-05-11 02:05:04,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[356a4081-7e1c-4687-b05c-c15acb4986e4] succeeded in 3.316127719999713s: None 2024-05-11T02:05:05.084010331Z [2024-05-11 02:05:05,083: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d0e4a8e-c526-4909-b3c2-f38c2007cb84] succeeded in 4.123081091998756s: None 2024-05-11T02:05:05.278320091Z [2024-05-11 02:05:05,277: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:05:05.281604011Z [2024-05-11 02:05:05,281: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:05.305026522Z [2024-05-11 02:05:05,304: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:05:05.306415791Z [2024-05-11 02:05:05,306: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:05.307033601Z [2024-05-11 02:05:05,306: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:05.308132788Z [2024-05-11 02:05:05,307: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:05.308265028Z [2024-05-11 02:05:05,308: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:05:05.308717631Z [2024-05-11 02:05:05,308: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:05:05.308766642Z [2024-05-11 02:05:05,308: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:05.394146269Z [2024-05-11 02:05:05,393: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:05.987035756Z [2024-05-11 02:05:05,986: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75d0776b-7111-4248-8d98-d33580d712a5] succeeded in 2.2179380569996283s: None 2024-05-11T02:05:06.215162818Z [2024-05-11 02:05:06,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16173733-ca0c-4cb5-b03a-58e1ac703e62] received 2024-05-11T02:05:06.230934341Z [2024-05-11 02:05:06,230: INFO/ForkPoolWorker-15] [16173733-ca0c-4cb5-b03a-58e1ac703e62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:05:06.508897456Z [2024-05-11 02:05:06,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:05:07.753434441Z [2024-05-11 02:05:07,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:05:07.757243939Z [2024-05-11 02:05:07,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:07.781125420Z [2024-05-11 02:05:07,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:05:07.782247690Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:07.782257600Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:07.782342851Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:07.782351531Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:05:07.782582872Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:05:07.782602179Z [2024-05-11 02:05:07,782: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:07.873961490Z [2024-05-11 02:05:07,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:09.445945898Z [2024-05-11 02:05:09,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16173733-ca0c-4cb5-b03a-58e1ac703e62] succeeded in 3.220839765999699s: None 2024-05-11T02:05:09.948010384Z [2024-05-11 02:05:09,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a02cf824-44ea-4082-8a86-b8dd91c64135] received 2024-05-11T02:05:09.957585322Z [2024-05-11 02:05:09,957: INFO/ForkPoolWorker-15] [a02cf824-44ea-4082-8a86-b8dd91c64135] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:05:10.242239015Z [2024-05-11 02:05:10,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:05:11.406869785Z [2024-05-11 02:05:11,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:05:11.410748553Z [2024-05-11 02:05:11,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:05:11.439840590Z [2024-05-11 02:05:11,439: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:05:11.441398014Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:05:11.441431683Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:05:11.441625418Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:05:11.441646711Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:05:11.442146845Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:05:11.442185637Z [2024-05-11 02:05:11,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:05:11.558748377Z [2024-05-11 02:05:11,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:05:12.312347204Z [2024-05-11 02:05:12,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a02cf824-44ea-4082-8a86-b8dd91c64135] succeeded in 2.3613848839995626s: None 2024-05-11T02:06:00.908840442Z [2024-05-11 02:06:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf968a26-39bf-43cd-b6fe-3f30799c07fe] received 2024-05-11T02:06:00.914889882Z [2024-05-11 02:06:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59a244d5-9cb2-4d63-a584-ff144cf5f071] received 2024-05-11T02:06:00.920831016Z [2024-05-11 02:06:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9eb99ac-e8a2-4536-a65b-cbe4f626d141] received 2024-05-11T02:06:00.922732385Z [2024-05-11 02:06:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d427ed2-9faf-4766-a363-09a647f57ebe] received 2024-05-11T02:06:00.925291271Z [2024-05-11 02:06:00,925: INFO/ForkPoolWorker-16] [59a244d5-9cb2-4d63-a584-ff144cf5f071] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:06:00.931106919Z [2024-05-11 02:06:00,930: INFO/ForkPoolWorker-15] [cf968a26-39bf-43cd-b6fe-3f30799c07fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:06:00.938651897Z [2024-05-11 02:06:00,938: INFO/ForkPoolWorker-1] [a9eb99ac-e8a2-4536-a65b-cbe4f626d141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:06:00.949389584Z [2024-05-11 02:06:00,949: INFO/ForkPoolWorker-2] [2d427ed2-9faf-4766-a363-09a647f57ebe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:06:01.380439804Z [2024-05-11 02:06:01,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:06:01.387384176Z [2024-05-11 02:06:01,384: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:06:01.402441103Z [2024-05-11 02:06:01,399: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:06:01.412794048Z [2024-05-11 02:06:01,408: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:06:01.539807779Z [2024-05-11 02:06:01,539: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T02:06:01.544115907Z [2024-05-11 02:06:01,543: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:06:01.603842316Z [2024-05-11 02:06:01,603: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:06:01.607767898Z [2024-05-11 02:06:01,607: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:06:01.608250320Z [2024-05-11 02:06:01,607: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:06:01.608641097Z [2024-05-11 02:06:01,608: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T02:06:01.609557327Z [2024-05-11 02:06:01,609: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:06:01.641794181Z [2024-05-11 02:06:01,641: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:06:01.753225177Z [2024-05-11 02:06:01,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:06:02.347167977Z [2024-05-11 02:06:02,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59a244d5-9cb2-4d63-a584-ff144cf5f071] succeeded in 1.4308992480000597s: None 2024-05-11T02:06:02.410969651Z [2024-05-11 02:06:02,410: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf968a26-39bf-43cd-b6fe-3f30799c07fe] succeeded in 1.4919327279985737s: None 2024-05-11T02:06:02.779286396Z [2024-05-11 02:06:02,778: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:06:02.782540347Z [2024-05-11 02:06:02,782: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:06:02.807412758Z [2024-05-11 02:06:02,806: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:06:02.810786350Z [2024-05-11 02:06:02,810: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:06:02.810946465Z [2024-05-11 02:06:02,810: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:06:02.811221002Z [2024-05-11 02:06:02,810: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:06:02.811344517Z [2024-05-11 02:06:02,811: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:06:02.811884115Z [2024-05-11 02:06:02,811: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:06:02.812013612Z [2024-05-11 02:06:02,811: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:06:02.917433814Z [2024-05-11 02:06:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:06:02.922125647Z [2024-05-11 02:06:02,921: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:06:02.939402703Z [2024-05-11 02:06:02,939: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:06:02.951777925Z [2024-05-11 02:06:02,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:06:02.953299546Z [2024-05-11 02:06:02,953: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:06:02.953460748Z [2024-05-11 02:06:02,953: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:06:02.953693842Z [2024-05-11 02:06:02,953: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:06:02.953850326Z [2024-05-11 02:06:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:06:02.954294450Z [2024-05-11 02:06:02,954: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:06:02.954481169Z [2024-05-11 02:06:02,954: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:06:03.079773321Z [2024-05-11 02:06:03,079: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:06:05.134911227Z [2024-05-11 02:06:05,134: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d427ed2-9faf-4766-a363-09a647f57ebe] succeeded in 4.209916855001211s: None 2024-05-11T02:06:05.711005990Z [2024-05-11 02:06:05,710: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a9eb99ac-e8a2-4536-a65b-cbe4f626d141] succeeded in 4.787594404000629s: None 2024-05-11T02:07:00.705952913Z [2024-05-11 02:07:00,705: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e693585-2be2-4609-b0e9-40406e9330eb] received 2024-05-11T02:07:00.716536534Z [2024-05-11 02:07:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71bd8198-e456-4817-8e95-430a71c4d788] received 2024-05-11T02:07:00.719796086Z [2024-05-11 02:07:00,718: INFO/ForkPoolWorker-15] [7e693585-2be2-4609-b0e9-40406e9330eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:07:00.723866544Z [2024-05-11 02:07:00,723: INFO/ForkPoolWorker-16] [71bd8198-e456-4817-8e95-430a71c4d788] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:07:00.724990935Z [2024-05-11 02:07:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b2a2862-3eae-4128-a5f0-e809571be3b6] received 2024-05-11T02:07:00.731939089Z [2024-05-11 02:07:00,731: INFO/ForkPoolWorker-1] [1b2a2862-3eae-4128-a5f0-e809571be3b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:07:01.000801436Z [2024-05-11 02:07:00,997: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:07:01.053937396Z [2024-05-11 02:07:01,044: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:07:01.053970015Z [2024-05-11 02:07:01,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:07:01.279275135Z [2024-05-11 02:07:01,278: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:07:01.283513150Z [2024-05-11 02:07:01,283: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:07:01.311343871Z [2024-05-11 02:07:01,311: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:07:01.312565954Z [2024-05-11 02:07:01,312: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:07:01.312820232Z [2024-05-11 02:07:01,312: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:07:01.313005208Z [2024-05-11 02:07:01,312: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:07:01.313477297Z [2024-05-11 02:07:01,313: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:07:01.399794775Z [2024-05-11 02:07:01,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:07:02.008759420Z [2024-05-11 02:07:02,008: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b2a2862-3eae-4128-a5f0-e809571be3b6] succeeded in 1.2824473670007137s: None 2024-05-11T02:07:02.226349999Z [2024-05-11 02:07:02,225: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:07:02.226420150Z [2024-05-11 02:07:02,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:07:02.229609984Z [2024-05-11 02:07:02,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:07:02.229644527Z [2024-05-11 02:07:02,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:07:02.247723346Z [2024-05-11 02:07:02,247: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:07:02.249211454Z [2024-05-11 02:07:02,248: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:07:02.249231236Z [2024-05-11 02:07:02,249: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:07:02.249426591Z [2024-05-11 02:07:02,249: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:07:02.249439252Z [2024-05-11 02:07:02,249: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:07:02.249747906Z [2024-05-11 02:07:02,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:07:02.249761182Z [2024-05-11 02:07:02,249: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:07:02.256632489Z [2024-05-11 02:07:02,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:07:02.258232488Z [2024-05-11 02:07:02,257: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:07:02.258296997Z [2024-05-11 02:07:02,258: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:07:02.258420302Z [2024-05-11 02:07:02,258: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:07:02.258489297Z [2024-05-11 02:07:02,258: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:07:02.258729864Z [2024-05-11 02:07:02,258: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:07:02.258797708Z [2024-05-11 02:07:02,258: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:07:02.341307386Z [2024-05-11 02:07:02,340: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:07:02.348811199Z [2024-05-11 02:07:02,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:07:04.518170487Z [2024-05-11 02:07:04,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71bd8198-e456-4817-8e95-430a71c4d788] succeeded in 3.800049455001499s: None 2024-05-11T02:07:04.918652232Z [2024-05-11 02:07:04,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e693585-2be2-4609-b0e9-40406e9330eb] succeeded in 4.209079714000836s: None 2024-05-11T02:08:00.703232136Z [2024-05-11 02:08:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edb3a3e2-e034-4768-9135-0efc2c68b572] received 2024-05-11T02:08:00.705152355Z [2024-05-11 02:08:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b1eb6c-f1db-4fe9-9e90-fd530b6fee31] received 2024-05-11T02:08:00.711441459Z [2024-05-11 02:08:00,711: INFO/ForkPoolWorker-16] [34b1eb6c-f1db-4fe9-9e90-fd530b6fee31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:08:00.713915243Z [2024-05-11 02:08:00,713: INFO/ForkPoolWorker-15] [edb3a3e2-e034-4768-9135-0efc2c68b572] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:08:00.716927321Z [2024-05-11 02:08:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fab56972-d831-4d6d-b02a-d8b8ee0feec2] received 2024-05-11T02:08:00.726130816Z [2024-05-11 02:08:00,725: INFO/ForkPoolWorker-1] [fab56972-d831-4d6d-b02a-d8b8ee0feec2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:08:00.729946351Z [2024-05-11 02:08:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32ecd842-8c00-4042-b075-be37822ce689] received 2024-05-11T02:08:00.746656842Z [2024-05-11 02:08:00,746: INFO/ForkPoolWorker-2] [32ecd842-8c00-4042-b075-be37822ce689] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:08:01.167964448Z [2024-05-11 02:08:01,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:08:01.300131799Z [2024-05-11 02:08:01,296: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:08:01.332119664Z [2024-05-11 02:08:01,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:08:01.514979115Z [2024-05-11 02:08:01,513: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:08:01.518993395Z [2024-05-11 02:08:01,518: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:08:01.538803006Z [2024-05-11 02:08:01,538: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:08:01.546610373Z [2024-05-11 02:08:01,546: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:08:01.548122547Z [2024-05-11 02:08:01,547: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:08:01.548328352Z [2024-05-11 02:08:01,548: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:08:01.548455511Z [2024-05-11 02:08:01,548: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:08:01.548767404Z [2024-05-11 02:08:01,548: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:08:01.627062932Z [2024-05-11 02:08:01,602: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:08:01.699630684Z [2024-05-11 02:08:01,699: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:08:02.200433522Z [2024-05-11 02:08:02,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edb3a3e2-e034-4768-9135-0efc2c68b572] succeeded in 1.4929123379988596s: None 2024-05-11T02:08:02.458848641Z [2024-05-11 02:08:02,458: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32ecd842-8c00-4042-b075-be37822ce689] succeeded in 1.726684703000501s: None 2024-05-11T02:08:02.906624169Z [2024-05-11 02:08:02,906: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:08:02.910215148Z [2024-05-11 02:08:02,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:08:02.942240498Z [2024-05-11 02:08:02,941: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:08:02.943718063Z [2024-05-11 02:08:02,943: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:08:02.943903012Z [2024-05-11 02:08:02,943: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:08:02.944136304Z [2024-05-11 02:08:02,943: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:08:02.944285245Z [2024-05-11 02:08:02,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:08:02.944662565Z [2024-05-11 02:08:02,944: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:08:02.944811716Z [2024-05-11 02:08:02,944: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:08:03.035326564Z [2024-05-11 02:08:03,034: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:08:03.084384799Z [2024-05-11 02:08:03,083: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:08:03.087916905Z [2024-05-11 02:08:03,087: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:08:03.130226892Z [2024-05-11 02:08:03,129: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:08:03.134001242Z [2024-05-11 02:08:03,133: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:08:03.134212237Z [2024-05-11 02:08:03,133: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:08:03.134438566Z [2024-05-11 02:08:03,134: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:08:03.134641414Z [2024-05-11 02:08:03,134: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:08:03.135062399Z [2024-05-11 02:08:03,134: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:08:03.135302495Z [2024-05-11 02:08:03,134: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:08:03.213599479Z [2024-05-11 02:08:03,213: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:08:04.870246905Z [2024-05-11 02:08:04,869: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fab56972-d831-4d6d-b02a-d8b8ee0feec2] succeeded in 4.150321058999907s: None 2024-05-11T02:08:05.339233697Z [2024-05-11 02:08:05,338: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34b1eb6c-f1db-4fe9-9e90-fd530b6fee31] succeeded in 4.63172822100023s: None 2024-05-11T02:09:00.641939347Z [2024-05-11 02:09:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26cc0222-feb5-48fc-a017-04b960f99c5f] received 2024-05-11T02:09:00.641972462Z [2024-05-11 02:09:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[857ca128-9f35-4c9e-acfa-8754ddae288c] received 2024-05-11T02:09:00.641979586Z [2024-05-11 02:09:00,639: INFO/ForkPoolWorker-15] [26cc0222-feb5-48fc-a017-04b960f99c5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:09:00.641983028Z [2024-05-11 02:09:00,641: INFO/ForkPoolWorker-16] [857ca128-9f35-4c9e-acfa-8754ddae288c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:09:00.645300124Z [2024-05-11 02:09:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4c148fb-25b5-4c59-8270-f1856839874d] received 2024-05-11T02:09:00.657765893Z [2024-05-11 02:09:00,657: INFO/ForkPoolWorker-1] [d4c148fb-25b5-4c59-8270-f1856839874d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:09:00.945524499Z [2024-05-11 02:09:00,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:09:00.989237362Z [2024-05-11 02:09:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:09:01.178482267Z [2024-05-11 02:09:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:09:01.350579711Z [2024-05-11 02:09:01,350: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T02:09:01.354348218Z [2024-05-11 02:09:01,353: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:09:01.375110333Z [2024-05-11 02:09:01,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:09:01.376031253Z [2024-05-11 02:09:01,375: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:09:01.376097588Z [2024-05-11 02:09:01,375: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:09:01.376644205Z [2024-05-11 02:09:01,376: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T02:09:01.376812858Z [2024-05-11 02:09:01,376: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:09:01.458835807Z [2024-05-11 02:09:01,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:09:02.099786314Z [2024-05-11 02:09:02,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26cc0222-feb5-48fc-a017-04b960f99c5f] succeeded in 1.4723474330003228s: None 2024-05-11T02:09:02.283307668Z [2024-05-11 02:09:02,282: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:09:02.286705314Z [2024-05-11 02:09:02,286: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:09:02.311867068Z [2024-05-11 02:09:02,311: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:09:02.313657094Z [2024-05-11 02:09:02,313: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:09:02.313990397Z [2024-05-11 02:09:02,313: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:09:02.315843562Z [2024-05-11 02:09:02,315: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:09:02.316349226Z [2024-05-11 02:09:02,316: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:09:02.316984128Z [2024-05-11 02:09:02,316: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:09:02.317194871Z [2024-05-11 02:09:02,317: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:09:02.439242212Z [2024-05-11 02:09:02,438: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:09:02.515973565Z [2024-05-11 02:09:02,515: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:09:02.519322246Z [2024-05-11 02:09:02,518: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:09:02.544758758Z [2024-05-11 02:09:02,544: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:09:02.547601871Z [2024-05-11 02:09:02,546: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:09:02.547634105Z [2024-05-11 02:09:02,547: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:09:02.547818872Z [2024-05-11 02:09:02,547: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:09:02.547869025Z [2024-05-11 02:09:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:09:02.548446251Z [2024-05-11 02:09:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:09:02.548516887Z [2024-05-11 02:09:02,548: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:09:02.624686032Z [2024-05-11 02:09:02,624: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:09:04.964387056Z [2024-05-11 02:09:04,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4c148fb-25b5-4c59-8270-f1856839874d] succeeded in 4.313454283999818s: None 2024-05-11T02:09:05.840304257Z [2024-05-11 02:09:05,839: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[857ca128-9f35-4c9e-acfa-8754ddae288c] succeeded in 5.208437400000548s: None 2024-05-11T02:10:01.120277187Z [2024-05-11 02:10:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84d6ad25-c9c6-43a3-8f70-1d1cbdd40625] received 2024-05-11T02:10:01.125449087Z [2024-05-11 02:10:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[298c2156-4ad7-4eef-b066-772b99bbad57] received 2024-05-11T02:10:01.133838667Z [2024-05-11 02:10:01,132: INFO/ForkPoolWorker-15] [84d6ad25-c9c6-43a3-8f70-1d1cbdd40625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:01.134138587Z [2024-05-11 02:10:01,133: INFO/ForkPoolWorker-16] [298c2156-4ad7-4eef-b066-772b99bbad57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:10:01.141593268Z [2024-05-11 02:10:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d99650b-e0ff-465c-9205-381af4f51ebb] received 2024-05-11T02:10:01.155639737Z [2024-05-11 02:10:01,151: INFO/ForkPoolWorker-1] [7d99650b-e0ff-465c-9205-381af4f51ebb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:10:01.218569355Z [2024-05-11 02:10:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[437b1f25-2446-4431-b512-36f255720e87] received 2024-05-11T02:10:01.222499988Z [2024-05-11 02:10:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cd09b60-764f-4fd8-9ff5-b2319ebb444b] received 2024-05-11T02:10:01.228001539Z [2024-05-11 02:10:01,227: INFO/ForkPoolWorker-2] [437b1f25-2446-4431-b512-36f255720e87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:10:01.251131077Z [2024-05-11 02:10:01,250: INFO/ForkPoolWorker-3] [8cd09b60-764f-4fd8-9ff5-b2319ebb444b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:10:01.589726999Z [2024-05-11 02:10:01,585: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:10:01.631901415Z [2024-05-11 02:10:01,617: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:10:01.822335439Z [2024-05-11 02:10:01,819: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:10:01.837897155Z [2024-05-11 02:10:01,834: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:10:01.846679218Z [2024-05-11 02:10:01,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:10:01.927417801Z [2024-05-11 02:10:01,926: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-11T02:10:01.931303110Z [2024-05-11 02:10:01,930: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:01.990013855Z [2024-05-11 02:10:01,987: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T02:10:01.994802594Z [2024-05-11 02:10:01,994: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:10:01.994943457Z [2024-05-11 02:10:01,994: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:10:01.995122306Z [2024-05-11 02:10:01,994: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-11T02:10:01.995414341Z [2024-05-11 02:10:01,995: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:10:02.088373022Z [2024-05-11 02:10:02,088: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:02.149907782Z [2024-05-11 02:10:02,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:02.730346788Z [2024-05-11 02:10:02,729: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8cd09b60-764f-4fd8-9ff5-b2319ebb444b] succeeded in 1.4987519299993437s: None 2024-05-11T02:10:02.826500782Z [2024-05-11 02:10:02,826: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[298c2156-4ad7-4eef-b066-772b99bbad57] succeeded in 1.6993333829996118s: None 2024-05-11T02:10:03.325265572Z [2024-05-11 02:10:03,324: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:10:03.328517326Z [2024-05-11 02:10:03,328: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:03.350266046Z [2024-05-11 02:10:03,350: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:10:03.354248307Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:03.354350583Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:03.354517140Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:03.354621444Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:10:03.354947146Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:10:03.355056123Z [2024-05-11 02:10:03,354: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:03.453400363Z [2024-05-11 02:10:03,453: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:10:03.456868004Z [2024-05-11 02:10:03,456: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:03.472028263Z [2024-05-11 02:10:03,471: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:03.521648725Z [2024-05-11 02:10:03,519: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:10:03.523872615Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:03.523883880Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:03.523888922Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:03.523893978Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:10:03.523898358Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:10:03.523902297Z [2024-05-11 02:10:03,522: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:03.620696972Z [2024-05-11 02:10:03,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:03.648313997Z [2024-05-11 02:10:03,647: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:10:03.652219363Z [2024-05-11 02:10:03,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:03.684033283Z [2024-05-11 02:10:03,683: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:10:03.685553184Z [2024-05-11 02:10:03,685: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:03.685604259Z [2024-05-11 02:10:03,685: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:03.685883350Z [2024-05-11 02:10:03,685: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:03.685973164Z [2024-05-11 02:10:03,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:10:03.686460614Z [2024-05-11 02:10:03,686: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:10:03.686542068Z [2024-05-11 02:10:03,686: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:03.760460039Z [2024-05-11 02:10:03,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:04.398138501Z [2024-05-11 02:10:04,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84d6ad25-c9c6-43a3-8f70-1d1cbdd40625] succeeded in 3.2738385800003016s: None 2024-05-11T02:10:04.674168317Z [2024-05-11 02:10:04,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78008cc4-f8d8-4fd1-a15a-9135159cd203] received 2024-05-11T02:10:04.688892173Z [2024-05-11 02:10:04,688: INFO/ForkPoolWorker-15] [78008cc4-f8d8-4fd1-a15a-9135159cd203] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:04.967681977Z [2024-05-11 02:10:04,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:10:05.297064700Z [2024-05-11 02:10:05,296: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d99650b-e0ff-465c-9205-381af4f51ebb] succeeded in 4.153935215001184s: None 2024-05-11T02:10:05.346595378Z [2024-05-11 02:10:05,346: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[437b1f25-2446-4431-b512-36f255720e87] succeeded in 4.122879221000403s: None 2024-05-11T02:10:06.121508150Z [2024-05-11 02:10:06,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:10:06.124640269Z [2024-05-11 02:10:06,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:06.150777484Z [2024-05-11 02:10:06,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:10:06.152172604Z [2024-05-11 02:10:06,151: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:06.152309248Z [2024-05-11 02:10:06,152: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:06.152508071Z [2024-05-11 02:10:06,152: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:06.152636141Z [2024-05-11 02:10:06,152: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:10:06.152974367Z [2024-05-11 02:10:06,152: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:10:06.153127944Z [2024-05-11 02:10:06,153: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:06.276804868Z [2024-05-11 02:10:06,276: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:07.052153065Z [2024-05-11 02:10:07,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78008cc4-f8d8-4fd1-a15a-9135159cd203] succeeded in 2.375825695999083s: None 2024-05-11T02:10:07.127471424Z [2024-05-11 02:10:07,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d9cae0b-c46c-46be-80f5-17791d5550a2] received 2024-05-11T02:10:07.140200339Z [2024-05-11 02:10:07,139: INFO/ForkPoolWorker-15] [0d9cae0b-c46c-46be-80f5-17791d5550a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:10:07.481306061Z [2024-05-11 02:10:07,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:10:08.671919125Z [2024-05-11 02:10:08,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:10:08.675505491Z [2024-05-11 02:10:08,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:08.704953681Z [2024-05-11 02:10:08,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:10:08.706816650Z [2024-05-11 02:10:08,706: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:08.707099118Z [2024-05-11 02:10:08,706: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:08.707425853Z [2024-05-11 02:10:08,707: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:08.707928238Z [2024-05-11 02:10:08,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:10:08.708491718Z [2024-05-11 02:10:08,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:10:08.708703444Z [2024-05-11 02:10:08,708: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:08.814711212Z [2024-05-11 02:10:08,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:10.446257201Z [2024-05-11 02:10:10,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d9cae0b-c46c-46be-80f5-17791d5550a2] succeeded in 3.3145464930003072s: None 2024-05-11T02:10:11.029136040Z [2024-05-11 02:10:11,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e791ff9-a609-44c4-bec2-1b76ff57e21a] received 2024-05-11T02:10:11.046195172Z [2024-05-11 02:10:11,045: INFO/ForkPoolWorker-15] [8e791ff9-a609-44c4-bec2-1b76ff57e21a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:10:11.414757110Z [2024-05-11 02:10:11,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:10:12.527387359Z [2024-05-11 02:10:12,526: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:10:12.530470542Z [2024-05-11 02:10:12,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:10:12.551993965Z [2024-05-11 02:10:12,551: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:10:12.553466582Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:10:12.553493182Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:10:12.553588920Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:10:12.553618956Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:10:12.553998230Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:10:12.554095241Z [2024-05-11 02:10:12,553: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:10:12.654294429Z [2024-05-11 02:10:12,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:10:13.282735319Z [2024-05-11 02:10:13,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e791ff9-a609-44c4-bec2-1b76ff57e21a] succeeded in 2.2511539699989953s: None 2024-05-11T02:11:00.306155779Z [2024-05-11 02:11:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d32df14-76b9-457d-9dfa-e8e4615c75a4] received 2024-05-11T02:11:00.310289993Z [2024-05-11 02:11:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[011cd720-f08f-4d9a-b655-52b64969cf91] received 2024-05-11T02:11:00.318047116Z [2024-05-11 02:11:00,314: INFO/ForkPoolWorker-15] [2d32df14-76b9-457d-9dfa-e8e4615c75a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:11:00.318096764Z [2024-05-11 02:11:00,314: INFO/ForkPoolWorker-16] [011cd720-f08f-4d9a-b655-52b64969cf91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:11:00.353829414Z [2024-05-11 02:11:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2355baf-7194-48ec-bc56-67aa9978e157] received 2024-05-11T02:11:00.362976765Z [2024-05-11 02:11:00,362: INFO/ForkPoolWorker-1] [f2355baf-7194-48ec-bc56-67aa9978e157] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:11:00.643006163Z [2024-05-11 02:11:00,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:11:00.655852639Z [2024-05-11 02:11:00,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:11:00.801020399Z [2024-05-11 02:11:00,797: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:11:00.958749681Z [2024-05-11 02:11:00,958: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:11:00.962786514Z [2024-05-11 02:11:00,962: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:11:00.985375210Z [2024-05-11 02:11:00,985: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:11:00.988342347Z [2024-05-11 02:11:00,988: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:11:00.988443174Z [2024-05-11 02:11:00,988: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:11:00.988546588Z [2024-05-11 02:11:00,988: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:11:00.988761399Z [2024-05-11 02:11:00,988: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:11:01.127536464Z [2024-05-11 02:11:01,127: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:11:01.731336361Z [2024-05-11 02:11:01,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2355baf-7194-48ec-bc56-67aa9978e157] succeeded in 1.3757148489985411s: None 2024-05-11T02:11:01.815521969Z [2024-05-11 02:11:01,815: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:11:01.824623776Z [2024-05-11 02:11:01,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:11:01.857072634Z [2024-05-11 02:11:01,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:11:01.860132971Z [2024-05-11 02:11:01,859: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:11:01.875329483Z [2024-05-11 02:11:01,874: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:11:01.879003503Z [2024-05-11 02:11:01,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:11:01.879745597Z [2024-05-11 02:11:01,879: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:11:01.879875177Z [2024-05-11 02:11:01,879: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:11:01.880061328Z [2024-05-11 02:11:01,879: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:11:01.880183737Z [2024-05-11 02:11:01,880: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:11:01.881325187Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:11:01.881372699Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:11:01.881531985Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:11:01.881566453Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:11:01.881850699Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:11:01.881935662Z [2024-05-11 02:11:01,881: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:11:01.886244675Z [2024-05-11 02:11:01,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:11:01.886418819Z [2024-05-11 02:11:01,886: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:11:01.981788008Z [2024-05-11 02:11:01,981: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:11:01.987580988Z [2024-05-11 02:11:01,987: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:11:03.505696626Z [2024-05-11 02:11:03,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[011cd720-f08f-4d9a-b655-52b64969cf91] succeeded in 3.1878836520008917s: None 2024-05-11T02:11:03.752457734Z [2024-05-11 02:11:03,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d32df14-76b9-457d-9dfa-e8e4615c75a4] succeeded in 3.444739426000524s: None 2024-05-11T02:12:00.525778935Z [2024-05-11 02:12:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4bd1555-f268-402e-b2bf-f8718d172db2] received 2024-05-11T02:12:00.528333791Z [2024-05-11 02:12:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c64ee42-cb20-43d0-bee5-ce8d74a28bac] received 2024-05-11T02:12:00.536314416Z [2024-05-11 02:12:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8397e747-6c82-497d-8ae8-36a5329775e6] received 2024-05-11T02:12:00.537448136Z [2024-05-11 02:12:00,537: INFO/ForkPoolWorker-15] [e4bd1555-f268-402e-b2bf-f8718d172db2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:12:00.537967804Z [2024-05-11 02:12:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3941a6dc-68a2-4505-909b-df51186fda5b] received 2024-05-11T02:12:00.542533666Z [2024-05-11 02:12:00,542: INFO/ForkPoolWorker-16] [8c64ee42-cb20-43d0-bee5-ce8d74a28bac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:12:00.550964036Z [2024-05-11 02:12:00,550: INFO/ForkPoolWorker-1] [8397e747-6c82-497d-8ae8-36a5329775e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:12:00.563854162Z [2024-05-11 02:12:00,563: INFO/ForkPoolWorker-2] [3941a6dc-68a2-4505-909b-df51186fda5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:12:00.820697024Z [2024-05-11 02:12:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:12:00.858685906Z [2024-05-11 02:12:00,855: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:12:00.975093133Z [2024-05-11 02:12:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:12:01.011254358Z [2024-05-11 02:12:01,007: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:12:01.066854908Z [2024-05-11 02:12:01,066: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:12:01.194483642Z [2024-05-11 02:12:01,193: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:12:01.198933900Z [2024-05-11 02:12:01,198: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:12:01.293959437Z [2024-05-11 02:12:01,293: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:12:01.298800299Z [2024-05-11 02:12:01,298: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:12:01.298856134Z [2024-05-11 02:12:01,298: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:12:01.298861575Z [2024-05-11 02:12:01,298: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:12:01.299068404Z [2024-05-11 02:12:01,298: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:12:01.418193370Z [2024-05-11 02:12:01,417: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:12:01.786337379Z [2024-05-11 02:12:01,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4bd1555-f268-402e-b2bf-f8718d172db2] succeeded in 1.2572703730002104s: None 2024-05-11T02:12:02.080478991Z [2024-05-11 02:12:02,080: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3941a6dc-68a2-4505-909b-df51186fda5b] succeeded in 1.539324971001406s: None 2024-05-11T02:12:02.378361889Z [2024-05-11 02:12:02,377: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:12:02.381705712Z [2024-05-11 02:12:02,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:12:02.408647232Z [2024-05-11 02:12:02,408: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:12:02.414248384Z [2024-05-11 02:12:02,413: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:12:02.414325200Z [2024-05-11 02:12:02,414: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:12:02.414441776Z [2024-05-11 02:12:02,414: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:12:02.414492302Z [2024-05-11 02:12:02,414: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:12:02.414907310Z [2024-05-11 02:12:02,414: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:12:02.415036747Z [2024-05-11 02:12:02,414: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:12:02.512950969Z [2024-05-11 02:12:02,512: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:12:02.543992039Z [2024-05-11 02:12:02,543: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:12:02.547254117Z [2024-05-11 02:12:02,546: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:12:02.570874469Z [2024-05-11 02:12:02,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:12:02.572379714Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:12:02.572395978Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:12:02.572542388Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:12:02.572554215Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:12:02.572910666Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:12:02.573029149Z [2024-05-11 02:12:02,572: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:12:02.679320052Z [2024-05-11 02:12:02,679: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:12:04.873693363Z [2024-05-11 02:12:04,873: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8397e747-6c82-497d-8ae8-36a5329775e6] succeeded in 4.335132969999904s: None 2024-05-11T02:12:06.630879879Z [2024-05-11 02:12:06,630: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c64ee42-cb20-43d0-bee5-ce8d74a28bac] succeeded in 6.0998074269991776s: None 2024-05-11T02:13:01.081977841Z [2024-05-11 02:13:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b9276a-cba3-412d-86ce-83091f0bca67] received 2024-05-11T02:13:01.097707224Z [2024-05-11 02:13:01,097: INFO/ForkPoolWorker-15] [e8b9276a-cba3-412d-86ce-83091f0bca67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:13:01.101553982Z [2024-05-11 02:13:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de42ae8-4672-41f9-b6e4-1f91e98a9b65] received 2024-05-11T02:13:01.103627349Z [2024-05-11 02:13:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[935fd806-ff20-4062-b8b0-5b14be768124] received 2024-05-11T02:13:01.116668873Z [2024-05-11 02:13:01,116: INFO/ForkPoolWorker-16] [5de42ae8-4672-41f9-b6e4-1f91e98a9b65] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:13:01.122296427Z [2024-05-11 02:13:01,121: INFO/ForkPoolWorker-1] [935fd806-ff20-4062-b8b0-5b14be768124] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:13:01.448978527Z [2024-05-11 02:13:01,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:13:01.491530595Z [2024-05-11 02:13:01,487: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:13:01.582533460Z [2024-05-11 02:13:01,577: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:13:01.658912613Z [2024-05-11 02:13:01,658: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:13:01.663473171Z [2024-05-11 02:13:01,663: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:13:01.682284516Z [2024-05-11 02:13:01,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:13:01.683279096Z [2024-05-11 02:13:01,683: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:13:01.683369733Z [2024-05-11 02:13:01,683: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:13:01.683435322Z [2024-05-11 02:13:01,683: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:13:01.683676069Z [2024-05-11 02:13:01,683: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:13:01.808307774Z [2024-05-11 02:13:01,808: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:13:02.414951700Z [2024-05-11 02:13:02,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5de42ae8-4672-41f9-b6e4-1f91e98a9b65] succeeded in 1.3122748080004385s: None 2024-05-11T02:13:02.804842706Z [2024-05-11 02:13:02,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:13:02.808575431Z [2024-05-11 02:13:02,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:13:02.831077075Z [2024-05-11 02:13:02,830: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:13:02.833037608Z [2024-05-11 02:13:02,832: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:13:02.833410259Z [2024-05-11 02:13:02,833: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:13:02.834068947Z [2024-05-11 02:13:02,833: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:13:02.834341236Z [2024-05-11 02:13:02,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:13:02.834690216Z [2024-05-11 02:13:02,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:13:02.834873041Z [2024-05-11 02:13:02,834: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:13:02.921250524Z [2024-05-11 02:13:02,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:13:03.015460444Z [2024-05-11 02:13:03,015: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:13:03.018792690Z [2024-05-11 02:13:03,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:13:03.051586965Z [2024-05-11 02:13:03,051: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:13:03.052958230Z [2024-05-11 02:13:03,052: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:13:03.053094536Z [2024-05-11 02:13:03,052: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:13:03.053294785Z [2024-05-11 02:13:03,053: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:13:03.053409051Z [2024-05-11 02:13:03,053: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:13:03.053731413Z [2024-05-11 02:13:03,053: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:13:03.053943057Z [2024-05-11 02:13:03,053: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:13:03.183574670Z [2024-05-11 02:13:03,183: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:13:06.137649874Z [2024-05-11 02:13:06,137: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[935fd806-ff20-4062-b8b0-5b14be768124] succeeded in 5.0276661360003345s: None 2024-05-11T02:13:06.245820369Z [2024-05-11 02:13:06,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8b9276a-cba3-412d-86ce-83091f0bca67] succeeded in 5.163315435000186s: None 2024-05-11T02:14:01.066286871Z [2024-05-11 02:14:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dc90013-ba4a-4ab6-a9a6-81090d07b479] received 2024-05-11T02:14:01.074134305Z [2024-05-11 02:14:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0efa757c-7d78-4caa-aa3a-0f1dfd082b3b] received 2024-05-11T02:14:01.091451072Z [2024-05-11 02:14:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00e7b1e-b0d8-4d8f-b5fb-05db1a1fa14d] received 2024-05-11T02:14:01.091477308Z [2024-05-11 02:14:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[604ec30d-d370-48dd-8073-bfaf44f05c60] received 2024-05-11T02:14:01.091482967Z [2024-05-11 02:14:01,089: INFO/ForkPoolWorker-16] [0efa757c-7d78-4caa-aa3a-0f1dfd082b3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:14:01.095427671Z [2024-05-11 02:14:01,095: INFO/ForkPoolWorker-1] [b00e7b1e-b0d8-4d8f-b5fb-05db1a1fa14d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:14:01.106481534Z [2024-05-11 02:14:01,106: INFO/ForkPoolWorker-15] [7dc90013-ba4a-4ab6-a9a6-81090d07b479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:14:01.106508986Z [2024-05-11 02:14:01,098: INFO/ForkPoolWorker-2] [604ec30d-d370-48dd-8073-bfaf44f05c60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:14:01.482192396Z [2024-05-11 02:14:01,479: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:14:01.497764977Z [2024-05-11 02:14:01,494: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:14:01.512541821Z [2024-05-11 02:14:01,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:14:01.627265393Z [2024-05-11 02:14:01,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:14:01.666623775Z [2024-05-11 02:14:01,666: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:14:01.670545623Z [2024-05-11 02:14:01,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:14:01.712122308Z [2024-05-11 02:14:01,711: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:14:01.713179292Z [2024-05-11 02:14:01,712: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:14:01.713263738Z [2024-05-11 02:14:01,713: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:14:01.713301029Z [2024-05-11 02:14:01,713: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:14:01.713513780Z [2024-05-11 02:14:01,713: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:14:01.745732461Z [2024-05-11 02:14:01,745: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:14:01.806825371Z [2024-05-11 02:14:01,806: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:14:02.351113199Z [2024-05-11 02:14:02,350: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b00e7b1e-b0d8-4d8f-b5fb-05db1a1fa14d] succeeded in 1.26199106400054s: None 2024-05-11T02:14:02.470500888Z [2024-05-11 02:14:02,470: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0efa757c-7d78-4caa-aa3a-0f1dfd082b3b] succeeded in 1.3866809219998686s: None 2024-05-11T02:14:02.784697286Z [2024-05-11 02:14:02,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:14:02.788122006Z [2024-05-11 02:14:02,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:14:02.815390814Z [2024-05-11 02:14:02,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:14:02.816607226Z [2024-05-11 02:14:02,816: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:14:02.816694322Z [2024-05-11 02:14:02,816: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:14:02.816842058Z [2024-05-11 02:14:02,816: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:14:02.816914466Z [2024-05-11 02:14:02,816: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:14:02.817162529Z [2024-05-11 02:14:02,817: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:14:02.817246462Z [2024-05-11 02:14:02,817: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:14:02.894930272Z [2024-05-11 02:14:02,894: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:14:02.898654164Z [2024-05-11 02:14:02,898: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:14:02.909943841Z [2024-05-11 02:14:02,909: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:14:02.924545564Z [2024-05-11 02:14:02,924: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:14:02.926710622Z [2024-05-11 02:14:02,926: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:14:02.926737517Z [2024-05-11 02:14:02,926: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:14:02.926993617Z [2024-05-11 02:14:02,926: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:14:02.927007783Z [2024-05-11 02:14:02,926: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:14:02.928208258Z [2024-05-11 02:14:02,927: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:14:02.928244851Z [2024-05-11 02:14:02,928: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:14:03.039233025Z [2024-05-11 02:14:03,038: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:14:05.126970383Z [2024-05-11 02:14:05,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dc90013-ba4a-4ab6-a9a6-81090d07b479] succeeded in 4.046437797000181s: None 2024-05-11T02:14:05.810543971Z [2024-05-11 02:14:05,809: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[604ec30d-d370-48dd-8073-bfaf44f05c60] succeeded in 4.7194041250004375s: None 2024-05-11T02:15:01.181061252Z [2024-05-11 02:15:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20b25e6b-a5c4-4212-86ff-fb94641aff48] received 2024-05-11T02:15:01.181968477Z [2024-05-11 02:15:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebe471a3-8e71-4367-94fb-eb7c131d7eee] received 2024-05-11T02:15:01.190184026Z [2024-05-11 02:15:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e5d2014-e854-4df5-a418-8a029632b15a] received 2024-05-11T02:15:01.191524969Z [2024-05-11 02:15:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[889a9d11-526e-4d42-9f3a-658335f55992] received 2024-05-11T02:15:01.199747877Z [2024-05-11 02:15:01,199: INFO/ForkPoolWorker-15] [20b25e6b-a5c4-4212-86ff-fb94641aff48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:15:01.203017864Z [2024-05-11 02:15:01,202: INFO/ForkPoolWorker-2] [889a9d11-526e-4d42-9f3a-658335f55992] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:15:01.203155076Z [2024-05-11 02:15:01,202: INFO/ForkPoolWorker-1] [9e5d2014-e854-4df5-a418-8a029632b15a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:15:01.203407796Z [2024-05-11 02:15:01,202: INFO/ForkPoolWorker-16] [ebe471a3-8e71-4367-94fb-eb7c131d7eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:01.547986030Z [2024-05-11 02:15:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:15:01.567650992Z [2024-05-11 02:15:01,564: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:15:01.651267048Z [2024-05-11 02:15:01,641: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:15:01.654609591Z [2024-05-11 02:15:01,645: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:15:01.880083799Z [2024-05-11 02:15:01,879: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:15:01.884634658Z [2024-05-11 02:15:01,884: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:01.919336021Z [2024-05-11 02:15:01,919: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:15:01.922649608Z [2024-05-11 02:15:01,922: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:15:01.922983079Z [2024-05-11 02:15:01,922: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:15:01.923775274Z [2024-05-11 02:15:01,923: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:15:01.924493063Z [2024-05-11 02:15:01,924: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:15:02.082394792Z [2024-05-11 02:15:02,082: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:02.792752733Z [2024-05-11 02:15:02,792: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[889a9d11-526e-4d42-9f3a-658335f55992] succeeded in 1.6002563030015153s: None 2024-05-11T02:15:02.935879208Z [2024-05-11 02:15:02,935: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:15:02.939775995Z [2024-05-11 02:15:02,939: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:02.980300178Z [2024-05-11 02:15:02,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:15:02.982402427Z [2024-05-11 02:15:02,982: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:02.982694561Z [2024-05-11 02:15:02,982: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:02.983063541Z [2024-05-11 02:15:02,982: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:02.983244603Z [2024-05-11 02:15:02,983: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:15:02.983618922Z [2024-05-11 02:15:02,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:15:02.983802466Z [2024-05-11 02:15:02,983: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:03.016482347Z [2024-05-11 02:15:03,016: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:15:03.019629243Z [2024-05-11 02:15:03,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:03.050967086Z [2024-05-11 02:15:03,050: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:15:03.054767798Z [2024-05-11 02:15:03,054: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:03.075787213Z [2024-05-11 02:15:03,075: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:15:03.077026565Z [2024-05-11 02:15:03,076: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:03.077106788Z [2024-05-11 02:15:03,077: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:03.077266180Z [2024-05-11 02:15:03,077: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:03.077341321Z [2024-05-11 02:15:03,077: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:15:03.077626931Z [2024-05-11 02:15:03,077: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:15:03.077717440Z [2024-05-11 02:15:03,077: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:03.087149688Z [2024-05-11 02:15:03,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:15:03.087557657Z [2024-05-11 02:15:03,087: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:03.088879967Z [2024-05-11 02:15:03,088: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:03.089055572Z [2024-05-11 02:15:03,088: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:03.089258149Z [2024-05-11 02:15:03,089: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:03.089387944Z [2024-05-11 02:15:03,089: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:15:03.089698350Z [2024-05-11 02:15:03,089: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:15:03.090204442Z [2024-05-11 02:15:03,090: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:03.163168123Z [2024-05-11 02:15:03,162: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:03.206938446Z [2024-05-11 02:15:03,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:03.875577511Z [2024-05-11 02:15:03,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebe471a3-8e71-4367-94fb-eb7c131d7eee] succeeded in 2.6906556300000375s: None 2024-05-11T02:15:03.911484466Z [2024-05-11 02:15:03,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8374a5-586e-4739-bed9-a4fd8c740b87] received 2024-05-11T02:15:03.923321803Z [2024-05-11 02:15:03,922: INFO/ForkPoolWorker-16] [9d8374a5-586e-4739-bed9-a4fd8c740b87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:04.234735430Z [2024-05-11 02:15:04,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:15:04.813087758Z [2024-05-11 02:15:04,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20b25e6b-a5c4-4212-86ff-fb94641aff48] succeeded in 3.630899509000301s: None 2024-05-11T02:15:05.318441227Z [2024-05-11 02:15:05,318: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:15:05.321612383Z [2024-05-11 02:15:05,321: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:05.340907754Z [2024-05-11 02:15:05,340: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:15:05.342217203Z [2024-05-11 02:15:05,342: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:05.342256622Z [2024-05-11 02:15:05,342: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:05.342406543Z [2024-05-11 02:15:05,342: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:05.342442028Z [2024-05-11 02:15:05,342: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:15:05.343134893Z [2024-05-11 02:15:05,342: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:15:05.343153629Z [2024-05-11 02:15:05,343: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:05.417740811Z [2024-05-11 02:15:05,417: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:05.682819227Z [2024-05-11 02:15:05,682: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e5d2014-e854-4df5-a418-8a029632b15a] succeeded in 4.489664254000672s: None 2024-05-11T02:15:06.008117764Z [2024-05-11 02:15:06,007: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d8374a5-586e-4739-bed9-a4fd8c740b87] succeeded in 2.092465073999847s: None 2024-05-11T02:15:06.390908349Z [2024-05-11 02:15:06,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[853c1d7a-a47b-4572-af92-27d1e6cd5990] received 2024-05-11T02:15:06.400892564Z [2024-05-11 02:15:06,400: INFO/ForkPoolWorker-15] [853c1d7a-a47b-4572-af92-27d1e6cd5990] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:15:06.700756902Z [2024-05-11 02:15:06,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:15:07.898733849Z [2024-05-11 02:15:07,898: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:15:07.902360518Z [2024-05-11 02:15:07,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:07.921212375Z [2024-05-11 02:15:07,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:15:07.922399777Z [2024-05-11 02:15:07,922: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:07.922556546Z [2024-05-11 02:15:07,922: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:07.922772302Z [2024-05-11 02:15:07,922: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:07.922803204Z [2024-05-11 02:15:07,922: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:15:07.923131649Z [2024-05-11 02:15:07,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:15:07.923284046Z [2024-05-11 02:15:07,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:08.013645001Z [2024-05-11 02:15:08,013: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:09.544748624Z [2024-05-11 02:15:09,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[853c1d7a-a47b-4572-af92-27d1e6cd5990] succeeded in 3.151313840000512s: None 2024-05-11T02:15:09.830751734Z [2024-05-11 02:15:09,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b4901d-aff7-4341-a044-b7405bd4e70e] received 2024-05-11T02:15:09.841500967Z [2024-05-11 02:15:09,841: INFO/ForkPoolWorker-15] [e5b4901d-aff7-4341-a044-b7405bd4e70e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:15:10.148796207Z [2024-05-11 02:15:10,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:15:11.338282796Z [2024-05-11 02:15:11,337: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:15:11.341716232Z [2024-05-11 02:15:11,341: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:15:11.365790913Z [2024-05-11 02:15:11,365: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:15:11.367744938Z [2024-05-11 02:15:11,367: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:15:11.367985898Z [2024-05-11 02:15:11,367: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:15:11.368130238Z [2024-05-11 02:15:11,367: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:15:11.368205103Z [2024-05-11 02:15:11,368: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:15:11.368624941Z [2024-05-11 02:15:11,368: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:15:11.368866524Z [2024-05-11 02:15:11,368: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:15:11.479822735Z [2024-05-11 02:15:11,479: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:15:12.075270046Z [2024-05-11 02:15:12,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5b4901d-aff7-4341-a044-b7405bd4e70e] succeeded in 2.240141931000835s: None 2024-05-11T02:16:01.225407781Z [2024-05-11 02:16:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44b5310e-2f7e-4773-90a3-30e113d2a1e4] received 2024-05-11T02:16:01.227570679Z [2024-05-11 02:16:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[497cfc8c-c11c-4694-9858-674de7fb81b3] received 2024-05-11T02:16:01.235171373Z [2024-05-11 02:16:01,234: INFO/ForkPoolWorker-16] [497cfc8c-c11c-4694-9858-674de7fb81b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:16:01.236982958Z [2024-05-11 02:16:01,236: INFO/ForkPoolWorker-15] [44b5310e-2f7e-4773-90a3-30e113d2a1e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:16:01.240839483Z [2024-05-11 02:16:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e92f507-f82d-4db7-9786-3154e2213ed2] received 2024-05-11T02:16:01.244053543Z [2024-05-11 02:16:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeffa9c4-d2f4-423c-9eeb-652fcd4df660] received 2024-05-11T02:16:01.247843591Z [2024-05-11 02:16:01,247: INFO/ForkPoolWorker-1] [9e92f507-f82d-4db7-9786-3154e2213ed2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:16:01.249803315Z [2024-05-11 02:16:01,249: INFO/ForkPoolWorker-2] [aeffa9c4-d2f4-423c-9eeb-652fcd4df660] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:16:01.536582182Z [2024-05-11 02:16:01,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:16:01.579355444Z [2024-05-11 02:16:01,576: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:16:01.582291040Z [2024-05-11 02:16:01,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:16:01.636504963Z [2024-05-11 02:16:01,633: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:16:01.704227558Z [2024-05-11 02:16:01,703: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:16:01.708523878Z [2024-05-11 02:16:01,707: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:16:01.734876981Z [2024-05-11 02:16:01,734: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:16:01.735938338Z [2024-05-11 02:16:01,735: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:16:01.736011480Z [2024-05-11 02:16:01,735: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:16:01.736064055Z [2024-05-11 02:16:01,735: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:16:01.736607450Z [2024-05-11 02:16:01,736: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:16:01.854367584Z [2024-05-11 02:16:01,854: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:16:01.915394121Z [2024-05-11 02:16:01,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:16:02.497039683Z [2024-05-11 02:16:02,496: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e92f507-f82d-4db7-9786-3154e2213ed2] succeeded in 1.2547694009990664s: None 2024-05-11T02:16:02.607681102Z [2024-05-11 02:16:02,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44b5310e-2f7e-4773-90a3-30e113d2a1e4] succeeded in 1.3789221229999384s: None 2024-05-11T02:16:02.864636971Z [2024-05-11 02:16:02,864: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:16:02.868031692Z [2024-05-11 02:16:02,867: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:16:02.891419040Z [2024-05-11 02:16:02,891: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:16:02.894737740Z [2024-05-11 02:16:02,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:16:02.897679998Z [2024-05-11 02:16:02,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:16:02.899003410Z [2024-05-11 02:16:02,898: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:16:02.899123285Z [2024-05-11 02:16:02,898: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:16:02.899244176Z [2024-05-11 02:16:02,899: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:16:02.899325358Z [2024-05-11 02:16:02,899: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:16:02.899668073Z [2024-05-11 02:16:02,899: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:16:02.899790240Z [2024-05-11 02:16:02,899: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:16:02.929717327Z [2024-05-11 02:16:02,929: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:16:02.931004661Z [2024-05-11 02:16:02,930: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:16:02.931019584Z [2024-05-11 02:16:02,930: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:16:02.931225016Z [2024-05-11 02:16:02,930: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:16:02.931376768Z [2024-05-11 02:16:02,931: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:16:02.931685101Z [2024-05-11 02:16:02,931: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:16:02.931872378Z [2024-05-11 02:16:02,931: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:16:02.993664822Z [2024-05-11 02:16:02,993: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:16:02.999850249Z [2024-05-11 02:16:02,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:16:04.569770070Z [2024-05-11 02:16:04,568: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aeffa9c4-d2f4-423c-9eeb-652fcd4df660] succeeded in 3.3235508100005973s: None 2024-05-11T02:16:04.963399981Z [2024-05-11 02:16:04,963: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[497cfc8c-c11c-4694-9858-674de7fb81b3] succeeded in 3.734470785000667s: None 2024-05-11T02:17:00.968405180Z [2024-05-11 02:17:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58b708ac-23dc-4803-9b8e-47f9780b4928] received 2024-05-11T02:17:00.972102833Z [2024-05-11 02:17:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c61de055-1622-49bf-b1c8-591d74c9b426] received 2024-05-11T02:17:00.976535647Z [2024-05-11 02:17:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19585b8e-0182-41ed-bce0-54ffa26e9bef] received 2024-05-11T02:17:00.982715207Z [2024-05-11 02:17:00,982: INFO/ForkPoolWorker-15] [58b708ac-23dc-4803-9b8e-47f9780b4928] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:17:00.984498574Z [2024-05-11 02:17:00,984: INFO/ForkPoolWorker-16] [c61de055-1622-49bf-b1c8-591d74c9b426] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:17:00.986661154Z [2024-05-11 02:17:00,986: INFO/ForkPoolWorker-1] [19585b8e-0182-41ed-bce0-54ffa26e9bef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:17:01.311615282Z [2024-05-11 02:17:01,308: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:17:01.395448027Z [2024-05-11 02:17:01,390: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:17:01.409904164Z [2024-05-11 02:17:01,406: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:17:01.475646739Z [2024-05-11 02:17:01,475: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:17:01.480202687Z [2024-05-11 02:17:01,479: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:17:01.510626461Z [2024-05-11 02:17:01,510: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:17:01.512046238Z [2024-05-11 02:17:01,511: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:17:01.512371046Z [2024-05-11 02:17:01,512: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:17:01.514473346Z [2024-05-11 02:17:01,512: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:17:01.515111358Z [2024-05-11 02:17:01,514: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:17:01.615793746Z [2024-05-11 02:17:01,615: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:17:02.150604033Z [2024-05-11 02:17:02,150: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[19585b8e-0182-41ed-bce0-54ffa26e9bef] succeeded in 1.1685326950009767s: None 2024-05-11T02:17:02.512319939Z [2024-05-11 02:17:02,511: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:17:02.515440031Z [2024-05-11 02:17:02,515: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:17:02.534392132Z [2024-05-11 02:17:02,534: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:17:02.535544430Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:17:02.535556544Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:17:02.535673546Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:17:02.535684548Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:17:02.535949101Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:17:02.535998764Z [2024-05-11 02:17:02,535: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:17:02.570406549Z [2024-05-11 02:17:02,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:17:02.573738231Z [2024-05-11 02:17:02,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:17:02.591864660Z [2024-05-11 02:17:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:17:02.593376058Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:17:02.593465880Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:17:02.593611666Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:17:02.593688039Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:17:02.593954017Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:17:02.594038963Z [2024-05-11 02:17:02,593: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:17:02.619032350Z [2024-05-11 02:17:02,618: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:17:02.667794474Z [2024-05-11 02:17:02,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:17:04.229975523Z [2024-05-11 02:17:04,229: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c61de055-1622-49bf-b1c8-591d74c9b426] succeeded in 3.2560624899997492s: None 2024-05-11T02:17:04.951067753Z [2024-05-11 02:17:04,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58b708ac-23dc-4803-9b8e-47f9780b4928] succeeded in 3.9775518059996102s: None 2024-05-11T02:18:00.425978119Z [2024-05-11 02:18:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6f602be-1e00-40d2-b51f-1b82b95c62bb] received 2024-05-11T02:18:00.429168386Z [2024-05-11 02:18:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1e4f31c-1583-49a4-8d1f-a20d746172d9] received 2024-05-11T02:18:00.440977791Z [2024-05-11 02:18:00,440: INFO/ForkPoolWorker-15] [d6f602be-1e00-40d2-b51f-1b82b95c62bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:18:00.441985298Z [2024-05-11 02:18:00,441: INFO/ForkPoolWorker-16] [f1e4f31c-1583-49a4-8d1f-a20d746172d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:18:00.444834577Z [2024-05-11 02:18:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a688ad15-0b5a-497d-b2e5-33bed41155c6] received 2024-05-11T02:18:00.448308872Z [2024-05-11 02:18:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e54bcf6-ff2e-4a37-9c06-321f13a3a14f] received 2024-05-11T02:18:00.457017493Z [2024-05-11 02:18:00,455: INFO/ForkPoolWorker-1] [a688ad15-0b5a-497d-b2e5-33bed41155c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:18:00.463808103Z [2024-05-11 02:18:00,463: INFO/ForkPoolWorker-2] [2e54bcf6-ff2e-4a37-9c06-321f13a3a14f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:18:00.782932692Z [2024-05-11 02:18:00,779: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:18:00.819544790Z [2024-05-11 02:18:00,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:18:00.911171071Z [2024-05-11 02:18:00,891: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:18:00.946569687Z [2024-05-11 02:18:00,946: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:18:00.950492099Z [2024-05-11 02:18:00,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:18:00.970204661Z [2024-05-11 02:18:00,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:18:00.979145506Z [2024-05-11 02:18:00,978: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:18:00.980810901Z [2024-05-11 02:18:00,980: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:18:00.980947591Z [2024-05-11 02:18:00,980: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:18:00.981044470Z [2024-05-11 02:18:00,980: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:18:00.981480582Z [2024-05-11 02:18:00,981: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:18:01.136122179Z [2024-05-11 02:18:01,135: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:18:01.446205913Z [2024-05-11 02:18:01,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:18:01.657559213Z [2024-05-11 02:18:01,657: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a688ad15-0b5a-497d-b2e5-33bed41155c6] succeeded in 1.2112239969992515s: None 2024-05-11T02:18:02.086898529Z [2024-05-11 02:18:02,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6f602be-1e00-40d2-b51f-1b82b95c62bb] succeeded in 1.6583014399984677s: None 2024-05-11T02:18:02.199853794Z [2024-05-11 02:18:02,199: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:18:02.203256967Z [2024-05-11 02:18:02,202: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:18:02.227288828Z [2024-05-11 02:18:02,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:18:02.228609733Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:18:02.228627329Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:18:02.228741497Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:18:02.228892331Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:18:02.228966613Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:18:02.229015059Z [2024-05-11 02:18:02,228: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:18:02.314327253Z [2024-05-11 02:18:02,314: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:18:02.336277762Z [2024-05-11 02:18:02,335: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:18:02.339720013Z [2024-05-11 02:18:02,339: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:18:02.358482424Z [2024-05-11 02:18:02,358: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:18:02.360066386Z [2024-05-11 02:18:02,359: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:18:02.360074676Z [2024-05-11 02:18:02,359: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:18:02.360231116Z [2024-05-11 02:18:02,359: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:18:02.360289434Z [2024-05-11 02:18:02,360: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:18:02.360570304Z [2024-05-11 02:18:02,360: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:18:02.360711641Z [2024-05-11 02:18:02,360: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:18:02.455427467Z [2024-05-11 02:18:02,455: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:18:03.857265181Z [2024-05-11 02:18:03,855: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e54bcf6-ff2e-4a37-9c06-321f13a3a14f] succeeded in 3.4060575580006116s: None 2024-05-11T02:18:04.110334098Z [2024-05-11 02:18:04,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1e4f31c-1583-49a4-8d1f-a20d746172d9] succeeded in 3.6783709499995894s: None 2024-05-11T02:19:00.406677498Z [2024-05-11 02:19:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f1fc2cd-631e-4db1-9514-5db7a3897e1c] received 2024-05-11T02:19:00.409317555Z [2024-05-11 02:19:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94ea0bbd-581c-475a-a2e8-67c551c7ccef] received 2024-05-11T02:19:00.412568218Z [2024-05-11 02:19:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b0e2ca2-d4d9-43a1-a10b-aa3e8794f089] received 2024-05-11T02:19:00.426242624Z [2024-05-11 02:19:00,425: INFO/ForkPoolWorker-1] [1b0e2ca2-d4d9-43a1-a10b-aa3e8794f089] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:19:00.427042207Z [2024-05-11 02:19:00,426: INFO/ForkPoolWorker-16] [94ea0bbd-581c-475a-a2e8-67c551c7ccef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:19:00.431627552Z [2024-05-11 02:19:00,431: INFO/ForkPoolWorker-15] [9f1fc2cd-631e-4db1-9514-5db7a3897e1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:19:00.718973978Z [2024-05-11 02:19:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:19:00.747322540Z [2024-05-11 02:19:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:19:00.791065581Z [2024-05-11 02:19:00,787: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:19:00.971931762Z [2024-05-11 02:19:00,971: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:19:00.975937973Z [2024-05-11 02:19:00,975: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:19:01.006453399Z [2024-05-11 02:19:01,006: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:19:01.007951433Z [2024-05-11 02:19:01,007: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:19:01.008065239Z [2024-05-11 02:19:01,007: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:19:01.008117542Z [2024-05-11 02:19:01,008: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:19:01.008367617Z [2024-05-11 02:19:01,008: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:19:01.204148130Z [2024-05-11 02:19:01,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:19:01.739324977Z [2024-05-11 02:19:01,738: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b0e2ca2-d4d9-43a1-a10b-aa3e8794f089] succeeded in 1.3241997300010553s: None 2024-05-11T02:19:02.007862654Z [2024-05-11 02:19:02,007: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:19:02.011472659Z [2024-05-11 02:19:02,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:19:02.015729458Z [2024-05-11 02:19:02,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:19:02.019146407Z [2024-05-11 02:19:02,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:19:02.034901364Z [2024-05-11 02:19:02,034: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:19:02.040503775Z [2024-05-11 02:19:02,040: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:19:02.040635514Z [2024-05-11 02:19:02,040: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:19:02.042006382Z [2024-05-11 02:19:02,041: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:19:02.042635053Z [2024-05-11 02:19:02,042: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:19:02.043653183Z [2024-05-11 02:19:02,043: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:19:02.045374795Z [2024-05-11 02:19:02,045: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:19:02.045520730Z [2024-05-11 02:19:02,045: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:19:02.045736849Z [2024-05-11 02:19:02,045: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:19:02.045905190Z [2024-05-11 02:19:02,045: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:19:02.046043817Z [2024-05-11 02:19:02,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:19:02.046297504Z [2024-05-11 02:19:02,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:19:02.046310065Z [2024-05-11 02:19:02,046: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:19:02.046542278Z [2024-05-11 02:19:02,046: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:19:02.140991801Z [2024-05-11 02:19:02,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:19:02.155612227Z [2024-05-11 02:19:02,155: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:19:03.826418546Z [2024-05-11 02:19:03,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f1fc2cd-631e-4db1-9514-5db7a3897e1c] succeeded in 3.4147761029998946s: None 2024-05-11T02:19:04.104805315Z [2024-05-11 02:19:04,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94ea0bbd-581c-475a-a2e8-67c551c7ccef] succeeded in 3.6854133870001533s: None 2024-05-11T02:20:00.306916528Z [2024-05-11 02:20:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c1cae79-16cd-4d9d-9c3b-841e1672ebf1] received 2024-05-11T02:20:00.309907854Z [2024-05-11 02:20:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd126a82-f14c-44c3-9e79-ac1fecd4c182] received 2024-05-11T02:20:00.328089126Z [2024-05-11 02:20:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d0c0119-e0fc-4a6d-b957-3e21abd1ff25] received 2024-05-11T02:20:00.328115430Z [2024-05-11 02:20:00,321: INFO/ForkPoolWorker-15] [0c1cae79-16cd-4d9d-9c3b-841e1672ebf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:00.332655153Z [2024-05-11 02:20:00,331: INFO/ForkPoolWorker-16] [bd126a82-f14c-44c3-9e79-ac1fecd4c182] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:20:00.337999083Z [2024-05-11 02:20:00,335: INFO/ForkPoolWorker-1] [1d0c0119-e0fc-4a6d-b957-3e21abd1ff25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:20:00.350566222Z [2024-05-11 02:20:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aef56105-9780-4a37-a97f-97c541f1bc2d] received 2024-05-11T02:20:00.372274565Z [2024-05-11 02:20:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1b3deaa-0c75-4c89-b320-af2e0ad4284e] received 2024-05-11T02:20:00.381092053Z [2024-05-11 02:20:00,380: INFO/ForkPoolWorker-2] [aef56105-9780-4a37-a97f-97c541f1bc2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:20:00.392218797Z [2024-05-11 02:20:00,391: INFO/ForkPoolWorker-3] [f1b3deaa-0c75-4c89-b320-af2e0ad4284e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:20:00.794574843Z [2024-05-11 02:20:00,789: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:20:00.945477189Z [2024-05-11 02:20:00,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:20:01.236869982Z [2024-05-11 02:20:01,219: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:20:01.430057339Z [2024-05-11 02:20:01,426: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:20:01.461620380Z [2024-05-11 02:20:01,457: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:20:01.473566973Z [2024-05-11 02:20:01,473: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:01.941849826Z [2024-05-11 02:20:01,941: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:20:01.958544799Z [2024-05-11 02:20:01,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:02.011628602Z [2024-05-11 02:20:02,010: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:20:02.013548945Z [2024-05-11 02:20:02,013: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:20:02.013706902Z [2024-05-11 02:20:02,013: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:20:02.013772860Z [2024-05-11 02:20:02,013: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:20:02.014054721Z [2024-05-11 02:20:02,013: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:20:02.151915799Z [2024-05-11 02:20:02,151: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:02.367075411Z [2024-05-11 02:20:02,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd126a82-f14c-44c3-9e79-ac1fecd4c182] succeeded in 2.056129005999537s: None 2024-05-11T02:20:02.376367757Z [2024-05-11 02:20:02,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:20:02.379809343Z [2024-05-11 02:20:02,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:02.426983705Z [2024-05-11 02:20:02,426: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:20:02.431749893Z [2024-05-11 02:20:02,431: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:02.431774137Z [2024-05-11 02:20:02,431: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:02.431922100Z [2024-05-11 02:20:02,431: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:02.432015513Z [2024-05-11 02:20:02,431: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:20:02.437733602Z [2024-05-11 02:20:02,436: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:20:02.437931163Z [2024-05-11 02:20:02,437: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:02.613550508Z [2024-05-11 02:20:02,613: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:02.847071837Z [2024-05-11 02:20:02,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d0c0119-e0fc-4a6d-b957-3e21abd1ff25] succeeded in 2.5237963759991544s: None 2024-05-11T02:20:03.295849637Z [2024-05-11 02:20:03,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c1cae79-16cd-4d9d-9c3b-841e1672ebf1] succeeded in 2.9845584929989855s: None 2024-05-11T02:20:03.308948586Z [2024-05-11 02:20:03,308: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-11T02:20:03.312402295Z [2024-05-11 02:20:03,311: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:03.346964415Z [2024-05-11 02:20:03,346: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T02:20:03.348522899Z [2024-05-11 02:20:03,348: INFO/ForkPoolWorker-3] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:03.348629359Z [2024-05-11 02:20:03,348: INFO/ForkPoolWorker-3] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:03.348806501Z [2024-05-11 02:20:03,348: INFO/ForkPoolWorker-3] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:03.348915336Z [2024-05-11 02:20:03,348: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-11T02:20:03.349212213Z [2024-05-11 02:20:03,349: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:20:03.349315092Z [2024-05-11 02:20:03,349: INFO/ForkPoolWorker-3] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:03.389517455Z [2024-05-11 02:20:03,389: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:20:03.392988840Z [2024-05-11 02:20:03,392: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:03.419047343Z [2024-05-11 02:20:03,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5c9ae87-3ae3-464d-996d-dc9090c429d0] received 2024-05-11T02:20:03.427110753Z [2024-05-11 02:20:03,426: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:03.427691880Z [2024-05-11 02:20:03,427: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:20:03.430780495Z [2024-05-11 02:20:03,430: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:03.430796189Z [2024-05-11 02:20:03,430: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:03.431226246Z [2024-05-11 02:20:03,430: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:03.431305106Z [2024-05-11 02:20:03,431: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:20:03.431759139Z [2024-05-11 02:20:03,431: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:20:03.433941420Z [2024-05-11 02:20:03,431: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:03.447656888Z [2024-05-11 02:20:03,443: INFO/ForkPoolWorker-15] [e5c9ae87-3ae3-464d-996d-dc9090c429d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:03.591867279Z [2024-05-11 02:20:03,591: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:03.836047188Z [2024-05-11 02:20:03,832: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:20:04.952072147Z [2024-05-11 02:20:04,951: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:20:04.955287701Z [2024-05-11 02:20:04,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:04.976742161Z [2024-05-11 02:20:04,976: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:20:04.978174295Z [2024-05-11 02:20:04,977: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:04.978195655Z [2024-05-11 02:20:04,978: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:04.978353794Z [2024-05-11 02:20:04,978: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:04.978398351Z [2024-05-11 02:20:04,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:20:04.978865281Z [2024-05-11 02:20:04,978: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:20:04.978926142Z [2024-05-11 02:20:04,978: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:05.055417314Z [2024-05-11 02:20:05,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:05.227883110Z [2024-05-11 02:20:05,227: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f1b3deaa-0c75-4c89-b320-af2e0ad4284e] succeeded in 4.853708750000806s: None 2024-05-11T02:20:05.660078681Z [2024-05-11 02:20:05,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5c9ae87-3ae3-464d-996d-dc9090c429d0] succeeded in 2.2331145369989827s: None 2024-05-11T02:20:05.698363959Z [2024-05-11 02:20:05,697: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aef56105-9780-4a37-a97f-97c541f1bc2d] succeeded in 5.329324750999149s: None 2024-05-11T02:20:06.050482396Z [2024-05-11 02:20:06,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2dfec67-d87b-4244-9bd5-735bec86d65e] received 2024-05-11T02:20:06.067218151Z [2024-05-11 02:20:06,066: INFO/ForkPoolWorker-15] [f2dfec67-d87b-4244-9bd5-735bec86d65e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:20:06.346051143Z [2024-05-11 02:20:06,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:20:07.566755434Z [2024-05-11 02:20:07,566: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:20:07.570361610Z [2024-05-11 02:20:07,569: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:07.595158201Z [2024-05-11 02:20:07,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:20:07.598747636Z [2024-05-11 02:20:07,598: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:07.598872739Z [2024-05-11 02:20:07,598: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:07.599129947Z [2024-05-11 02:20:07,598: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:07.599241893Z [2024-05-11 02:20:07,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:20:07.599618546Z [2024-05-11 02:20:07,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:20:07.599724336Z [2024-05-11 02:20:07,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:07.694630735Z [2024-05-11 02:20:07,692: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:09.170652700Z [2024-05-11 02:20:09,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2dfec67-d87b-4244-9bd5-735bec86d65e] succeeded in 3.117863897999996s: None 2024-05-11T02:20:09.223425358Z [2024-05-11 02:20:09,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49e3b94a-763c-489e-9b84-4438867efcf5] received 2024-05-11T02:20:09.232446897Z [2024-05-11 02:20:09,232: INFO/ForkPoolWorker-15] [49e3b94a-763c-489e-9b84-4438867efcf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:20:09.543938346Z [2024-05-11 02:20:09,540: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:20:10.634293786Z [2024-05-11 02:20:10,633: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:20:10.637709310Z [2024-05-11 02:20:10,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:20:10.657141615Z [2024-05-11 02:20:10,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:20:10.658693345Z [2024-05-11 02:20:10,658: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:20:10.658816066Z [2024-05-11 02:20:10,658: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:20:10.659000110Z [2024-05-11 02:20:10,658: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:20:10.659085770Z [2024-05-11 02:20:10,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:20:10.659553684Z [2024-05-11 02:20:10,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:20:10.659698973Z [2024-05-11 02:20:10,659: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:20:10.745891091Z [2024-05-11 02:20:10,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:20:11.364555252Z [2024-05-11 02:20:11,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49e3b94a-763c-489e-9b84-4438867efcf5] succeeded in 2.1367813750002824s: None 2024-05-11T02:21:01.139811786Z [2024-05-11 02:21:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8734c90-8a93-4f48-8908-3e0d1df12fd6] received 2024-05-11T02:21:01.149263386Z [2024-05-11 02:21:01,149: INFO/ForkPoolWorker-15] [b8734c90-8a93-4f48-8908-3e0d1df12fd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:21:01.171694141Z [2024-05-11 02:21:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42acf31c-b079-439d-bf66-c21b7a0539fa] received 2024-05-11T02:21:01.173491187Z [2024-05-11 02:21:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1565cfb-94e0-454c-b978-4f217f3b2759] received 2024-05-11T02:21:01.179453244Z [2024-05-11 02:21:01,179: INFO/ForkPoolWorker-16] [42acf31c-b079-439d-bf66-c21b7a0539fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:21:01.190300085Z [2024-05-11 02:21:01,189: INFO/ForkPoolWorker-1] [e1565cfb-94e0-454c-b978-4f217f3b2759] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:21:01.497081980Z [2024-05-11 02:21:01,493: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:21:01.504597349Z [2024-05-11 02:21:01,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:21:01.510711624Z [2024-05-11 02:21:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:21:01.662043009Z [2024-05-11 02:21:01,661: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:21:01.665990286Z [2024-05-11 02:21:01,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:21:01.688064295Z [2024-05-11 02:21:01,687: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:21:01.689263915Z [2024-05-11 02:21:01,689: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:21:01.689385865Z [2024-05-11 02:21:01,689: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:21:01.689456287Z [2024-05-11 02:21:01,689: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:21:01.689673506Z [2024-05-11 02:21:01,689: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:21:01.798068138Z [2024-05-11 02:21:01,797: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:21:02.409148634Z [2024-05-11 02:21:02,408: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42acf31c-b079-439d-bf66-c21b7a0539fa] succeeded in 1.2340786240001762s: None 2024-05-11T02:21:02.701186338Z [2024-05-11 02:21:02,700: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:21:02.704480863Z [2024-05-11 02:21:02,704: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:21:02.724686499Z [2024-05-11 02:21:02,724: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:21:02.726001137Z [2024-05-11 02:21:02,725: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:21:02.726184258Z [2024-05-11 02:21:02,726: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:21:02.726365819Z [2024-05-11 02:21:02,726: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:21:02.726444972Z [2024-05-11 02:21:02,726: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:21:02.726777157Z [2024-05-11 02:21:02,726: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:21:02.726836088Z [2024-05-11 02:21:02,726: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:21:02.731201341Z [2024-05-11 02:21:02,730: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:21:02.734792842Z [2024-05-11 02:21:02,734: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:21:02.754163001Z [2024-05-11 02:21:02,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:21:02.755745841Z [2024-05-11 02:21:02,755: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:21:02.755912217Z [2024-05-11 02:21:02,755: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:21:02.756132388Z [2024-05-11 02:21:02,755: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:21:02.756183609Z [2024-05-11 02:21:02,756: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:21:02.756491576Z [2024-05-11 02:21:02,756: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:21:02.756602307Z [2024-05-11 02:21:02,756: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:21:02.829184061Z [2024-05-11 02:21:02,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:21:02.841885045Z [2024-05-11 02:21:02,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:21:05.271133009Z [2024-05-11 02:21:05,270: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1565cfb-94e0-454c-b978-4f217f3b2759] succeeded in 4.095151659001203s: None 2024-05-11T02:21:05.933968809Z [2024-05-11 02:21:05,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8734c90-8a93-4f48-8908-3e0d1df12fd6] succeeded in 4.788498494999658s: None 2024-05-11T02:21:34.514427034Z [2024-05-11 02:21:34,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40d8f8cf-575f-478b-ad3b-4f9696cc289e] received 2024-05-11T02:21:34.526709831Z [2024-05-11 02:21:34,526: INFO/ForkPoolWorker-15] [40d8f8cf-575f-478b-ad3b-4f9696cc289e] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022133_089505', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:21:34.817330248Z [2024-05-11 02:21:34,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-11T02:21:35.127596155Z [2024-05-11 02:21:35,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:21:35.757639822Z [2024-05-11 02:21:35,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40d8f8cf-575f-478b-ad3b-4f9696cc289e] succeeded in 1.2405025269999896s: None 2024-05-11T02:22:00.894215203Z [2024-05-11 02:22:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[630863ef-581f-43c1-baf6-fec5c22449f7] received 2024-05-11T02:22:00.899749499Z [2024-05-11 02:22:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27d5bb80-cdaf-47b7-acb6-bcf272109adb] received 2024-05-11T02:22:00.901044714Z [2024-05-11 02:22:00,900: INFO/ForkPoolWorker-15] [630863ef-581f-43c1-baf6-fec5c22449f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:22:00.902476164Z [2024-05-11 02:22:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e48479c-69c5-447f-bfca-cb51d7002cad] received 2024-05-11T02:22:00.910127274Z [2024-05-11 02:22:00,909: INFO/ForkPoolWorker-16] [27d5bb80-cdaf-47b7-acb6-bcf272109adb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:22:00.914075733Z [2024-05-11 02:22:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba157071-63c2-4fbc-ade6-5f09426262d5] received 2024-05-11T02:22:00.916502458Z [2024-05-11 02:22:00,916: INFO/ForkPoolWorker-1] [8e48479c-69c5-447f-bfca-cb51d7002cad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:22:00.921414252Z [2024-05-11 02:22:00,921: INFO/ForkPoolWorker-2] [ba157071-63c2-4fbc-ade6-5f09426262d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:22:01.266334338Z [2024-05-11 02:22:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:22:01.324263837Z [2024-05-11 02:22:01,320: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:22:01.351927528Z [2024-05-11 02:22:01,348: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:22:01.407353664Z [2024-05-11 02:22:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:22:01.542946872Z [2024-05-11 02:22:01,542: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:22:01.546904603Z [2024-05-11 02:22:01,546: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:22:01.587391952Z [2024-05-11 02:22:01,586: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:22:01.591022297Z [2024-05-11 02:22:01,590: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:22:01.591182768Z [2024-05-11 02:22:01,590: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:22:01.591292383Z [2024-05-11 02:22:01,591: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:22:01.591401409Z [2024-05-11 02:22:01,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:22:01.591676132Z [2024-05-11 02:22:01,591: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:22:01.701533124Z [2024-05-11 02:22:01,701: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:22:02.159261576Z [2024-05-11 02:22:02,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[630863ef-581f-43c1-baf6-fec5c22449f7] succeeded in 1.2637383830006002s: None 2024-05-11T02:22:02.335250116Z [2024-05-11 02:22:02,334: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba157071-63c2-4fbc-ade6-5f09426262d5] succeeded in 1.4188447929991526s: None 2024-05-11T02:22:02.599487388Z [2024-05-11 02:22:02,599: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:22:02.602805960Z [2024-05-11 02:22:02,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:22:02.625180377Z [2024-05-11 02:22:02,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:22:02.626967385Z [2024-05-11 02:22:02,626: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:22:02.627178538Z [2024-05-11 02:22:02,626: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:22:02.627452193Z [2024-05-11 02:22:02,627: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:22:02.627582578Z [2024-05-11 02:22:02,627: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:22:02.628052860Z [2024-05-11 02:22:02,627: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:22:02.628207492Z [2024-05-11 02:22:02,628: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:22:02.704061731Z [2024-05-11 02:22:02,703: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:22:02.841066843Z [2024-05-11 02:22:02,840: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:22:02.844255391Z [2024-05-11 02:22:02,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:22:02.870349844Z [2024-05-11 02:22:02,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:22:02.871895255Z [2024-05-11 02:22:02,871: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:22:02.871941390Z [2024-05-11 02:22:02,871: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:22:02.872164927Z [2024-05-11 02:22:02,871: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:22:02.872224187Z [2024-05-11 02:22:02,872: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:22:02.872517102Z [2024-05-11 02:22:02,872: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:22:02.872557082Z [2024-05-11 02:22:02,872: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:22:02.943887169Z [2024-05-11 02:22:02,943: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:22:04.651393445Z [2024-05-11 02:22:04,650: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27d5bb80-cdaf-47b7-acb6-bcf272109adb] succeeded in 3.7477805500002432s: None 2024-05-11T02:22:05.178747398Z [2024-05-11 02:22:05,176: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e48479c-69c5-447f-bfca-cb51d7002cad] succeeded in 4.270801467999263s: None 2024-05-11T02:23:00.680763604Z [2024-05-11 02:23:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6db23f44-e865-44b7-9b81-ff9da686b3cd] received 2024-05-11T02:23:00.684946821Z [2024-05-11 02:23:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c449a8a9-28db-4fe9-b505-4e439aa69520] received 2024-05-11T02:23:00.688629194Z [2024-05-11 02:23:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36fd8856-3681-436c-a037-45c4710d66f1] received 2024-05-11T02:23:00.690869858Z [2024-05-11 02:23:00,690: INFO/ForkPoolWorker-15] [6db23f44-e865-44b7-9b81-ff9da686b3cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:23:00.699043653Z [2024-05-11 02:23:00,698: INFO/ForkPoolWorker-16] [c449a8a9-28db-4fe9-b505-4e439aa69520] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:23:00.703556346Z [2024-05-11 02:23:00,702: INFO/ForkPoolWorker-1] [36fd8856-3681-436c-a037-45c4710d66f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:23:00.985162633Z [2024-05-11 02:23:00,981: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:23:00.999246371Z [2024-05-11 02:23:00,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:23:01.003685495Z [2024-05-11 02:23:01,000: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:23:01.249601788Z [2024-05-11 02:23:01,249: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:23:01.254416874Z [2024-05-11 02:23:01,253: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:23:01.282803535Z [2024-05-11 02:23:01,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:23:01.286777346Z [2024-05-11 02:23:01,286: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:23:01.286886814Z [2024-05-11 02:23:01,286: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:23:01.286947133Z [2024-05-11 02:23:01,286: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:23:01.287232125Z [2024-05-11 02:23:01,287: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:23:01.406764535Z [2024-05-11 02:23:01,406: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:23:02.016257992Z [2024-05-11 02:23:02,015: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36fd8856-3681-436c-a037-45c4710d66f1] succeeded in 1.3252327589998458s: None 2024-05-11T02:23:02.226472045Z [2024-05-11 02:23:02,226: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:23:02.229989165Z [2024-05-11 02:23:02,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:23:02.254276502Z [2024-05-11 02:23:02,254: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:23:02.256150727Z [2024-05-11 02:23:02,255: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:23:02.256656979Z [2024-05-11 02:23:02,256: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:23:02.256907732Z [2024-05-11 02:23:02,256: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:23:02.257028277Z [2024-05-11 02:23:02,256: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:23:02.257347374Z [2024-05-11 02:23:02,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:23:02.257464172Z [2024-05-11 02:23:02,257: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:23:02.284987233Z [2024-05-11 02:23:02,284: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:23:02.288552551Z [2024-05-11 02:23:02,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:23:02.331155165Z [2024-05-11 02:23:02,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:23:02.333145708Z [2024-05-11 02:23:02,332: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:23:02.333218167Z [2024-05-11 02:23:02,333: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:23:02.333441328Z [2024-05-11 02:23:02,333: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:23:02.333476951Z [2024-05-11 02:23:02,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:23:02.334027271Z [2024-05-11 02:23:02,333: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:23:02.334679336Z [2024-05-11 02:23:02,333: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:23:02.345340390Z [2024-05-11 02:23:02,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:23:02.432355653Z [2024-05-11 02:23:02,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:23:04.508674216Z [2024-05-11 02:23:04,508: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6db23f44-e865-44b7-9b81-ff9da686b3cd] succeeded in 3.8259008240002004s: None 2024-05-11T02:23:05.142052087Z [2024-05-11 02:23:05,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c449a8a9-28db-4fe9-b505-4e439aa69520] succeeded in 4.454761912998947s: None 2024-05-11T02:24:00.513690623Z [2024-05-11 02:24:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[605894fe-44c6-4f4f-9bf7-a43b4db8bac6] received 2024-05-11T02:24:00.520015659Z [2024-05-11 02:24:00,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd2b8d7-128c-4d14-8b7f-53dd3506f62b] received 2024-05-11T02:24:00.523035057Z [2024-05-11 02:24:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c16d605-d161-429e-a96a-0191ce0c99c1] received 2024-05-11T02:24:00.529241394Z [2024-05-11 02:24:00,528: INFO/ForkPoolWorker-16] [cdd2b8d7-128c-4d14-8b7f-53dd3506f62b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:24:00.530910504Z [2024-05-11 02:24:00,530: INFO/ForkPoolWorker-1] [4c16d605-d161-429e-a96a-0191ce0c99c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:24:00.535392190Z [2024-05-11 02:24:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a403b043-ef4a-4fdc-b543-915d63c32034] received 2024-05-11T02:24:00.535588820Z [2024-05-11 02:24:00,535: INFO/ForkPoolWorker-15] [605894fe-44c6-4f4f-9bf7-a43b4db8bac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:24:00.546714954Z [2024-05-11 02:24:00,546: INFO/ForkPoolWorker-2] [a403b043-ef4a-4fdc-b543-915d63c32034] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:24:00.832834875Z [2024-05-11 02:24:00,829: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:24:00.856298402Z [2024-05-11 02:24:00,852: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:24:00.866544982Z [2024-05-11 02:24:00,862: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:24:00.889654508Z [2024-05-11 02:24:00,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:24:01.332613245Z [2024-05-11 02:24:01,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:24:01.358270919Z [2024-05-11 02:24:01,357: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:24:01.362513169Z [2024-05-11 02:24:01,362: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:24:01.399038122Z [2024-05-11 02:24:01,398: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:24:01.402911113Z [2024-05-11 02:24:01,402: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:24:01.402983533Z [2024-05-11 02:24:01,402: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:24:01.402988322Z [2024-05-11 02:24:01,402: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:24:01.403154206Z [2024-05-11 02:24:01,403: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:24:01.540288869Z [2024-05-11 02:24:01,540: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:24:02.032115057Z [2024-05-11 02:24:02,031: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[605894fe-44c6-4f4f-9bf7-a43b4db8bac6] succeeded in 1.5101031659996806s: None 2024-05-11T02:24:02.263375738Z [2024-05-11 02:24:02,262: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a403b043-ef4a-4fdc-b543-915d63c32034] succeeded in 1.7252763640008197s: None 2024-05-11T02:24:02.503356652Z [2024-05-11 02:24:02,502: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:24:02.506904222Z [2024-05-11 02:24:02,506: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:24:02.530718591Z [2024-05-11 02:24:02,530: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:24:02.532100197Z [2024-05-11 02:24:02,531: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:24:02.532113291Z [2024-05-11 02:24:02,532: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:24:02.532303295Z [2024-05-11 02:24:02,532: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:24:02.532385789Z [2024-05-11 02:24:02,532: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:24:02.532617308Z [2024-05-11 02:24:02,532: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:24:02.532629696Z [2024-05-11 02:24:02,532: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:24:02.545189705Z [2024-05-11 02:24:02,544: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:24:02.549054601Z [2024-05-11 02:24:02,548: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:24:02.574993902Z [2024-05-11 02:24:02,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:24:02.576249415Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:24:02.576265157Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:24:02.576412651Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:24:02.576430619Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:24:02.576891332Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:24:02.576916710Z [2024-05-11 02:24:02,576: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:24:02.644771678Z [2024-05-11 02:24:02,644: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:24:02.679454853Z [2024-05-11 02:24:02,679: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:24:04.605030631Z [2024-05-11 02:24:04,604: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cdd2b8d7-128c-4d14-8b7f-53dd3506f62b] succeeded in 4.081476954999744s: None 2024-05-11T02:24:05.300150911Z [2024-05-11 02:24:05,299: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c16d605-d161-429e-a96a-0191ce0c99c1] succeeded in 4.774600598999314s: None 2024-05-11T02:25:00.394654969Z [2024-05-11 02:25:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33b3368f-d165-4c3a-96d1-a1e53c6d9342] received 2024-05-11T02:25:00.397046543Z [2024-05-11 02:25:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f175ba5-7119-4ef5-bc5e-8f5fc4ffddd8] received 2024-05-11T02:25:00.406084014Z [2024-05-11 02:25:00,405: INFO/ForkPoolWorker-15] [33b3368f-d165-4c3a-96d1-a1e53c6d9342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:00.406400359Z [2024-05-11 02:25:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5baef0dd-184c-4479-84d2-2f68723b3f9c] received 2024-05-11T02:25:00.409478671Z [2024-05-11 02:25:00,409: INFO/ForkPoolWorker-16] [6f175ba5-7119-4ef5-bc5e-8f5fc4ffddd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:25:00.412625964Z [2024-05-11 02:25:00,412: INFO/ForkPoolWorker-1] [5baef0dd-184c-4479-84d2-2f68723b3f9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:25:00.417116075Z [2024-05-11 02:25:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[892f1f95-0e29-4560-8f6b-07722b8266d2] received 2024-05-11T02:25:00.425070164Z [2024-05-11 02:25:00,423: INFO/ForkPoolWorker-2] [892f1f95-0e29-4560-8f6b-07722b8266d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:25:00.761212908Z [2024-05-11 02:25:00,757: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:25:00.842882629Z [2024-05-11 02:25:00,839: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:25:00.980319681Z [2024-05-11 02:25:00,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:25:01.001638585Z [2024-05-11 02:25:01,001: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:25:01.034109567Z [2024-05-11 02:25:01,018: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:01.088425440Z [2024-05-11 02:25:01,083: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:25:01.157621084Z [2024-05-11 02:25:01,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:25:01.162290557Z [2024-05-11 02:25:01,162: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:25:01.162492583Z [2024-05-11 02:25:01,162: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:25:01.162541436Z [2024-05-11 02:25:01,162: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:25:01.162755832Z [2024-05-11 02:25:01,162: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:25:01.328674039Z [2024-05-11 02:25:01,328: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:02.123248769Z [2024-05-11 02:25:02,122: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[892f1f95-0e29-4560-8f6b-07722b8266d2] succeeded in 1.7042351880008937s: None 2024-05-11T02:25:02.275945290Z [2024-05-11 02:25:02,275: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:25:02.279495953Z [2024-05-11 02:25:02,278: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:02.302264213Z [2024-05-11 02:25:02,301: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:25:02.303827382Z [2024-05-11 02:25:02,303: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:02.303979161Z [2024-05-11 02:25:02,303: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:02.304169373Z [2024-05-11 02:25:02,303: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:02.306220696Z [2024-05-11 02:25:02,306: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:25:02.306764167Z [2024-05-11 02:25:02,306: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:25:02.307115401Z [2024-05-11 02:25:02,306: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:02.388653876Z [2024-05-11 02:25:02,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:02.389336290Z [2024-05-11 02:25:02,389: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:25:02.392638343Z [2024-05-11 02:25:02,392: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:02.424197807Z [2024-05-11 02:25:02,423: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:25:02.425425891Z [2024-05-11 02:25:02,425: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:02.425602225Z [2024-05-11 02:25:02,425: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:02.425797189Z [2024-05-11 02:25:02,425: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:02.425882731Z [2024-05-11 02:25:02,425: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:25:02.426493505Z [2024-05-11 02:25:02,426: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:25:02.426588756Z [2024-05-11 02:25:02,426: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:02.518125312Z [2024-05-11 02:25:02,517: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:02.633431321Z [2024-05-11 02:25:02,633: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:25:02.636861107Z [2024-05-11 02:25:02,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:02.665854694Z [2024-05-11 02:25:02,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:25:02.667247965Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:02.667264388Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:02.667377894Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:02.667401054Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:25:02.667601174Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:25:02.667667025Z [2024-05-11 02:25:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:02.798100933Z [2024-05-11 02:25:02,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:03.572787978Z [2024-05-11 02:25:03,572: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33b3368f-d165-4c3a-96d1-a1e53c6d9342] succeeded in 3.1764107790004346s: None 2024-05-11T02:25:04.100658272Z [2024-05-11 02:25:04,097: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5baef0dd-184c-4479-84d2-2f68723b3f9c] succeeded in 3.6901000699999713s: None 2024-05-11T02:25:04.288087771Z [2024-05-11 02:25:04,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16feaee9-bba0-472f-bdff-fd21d48c6c08] received 2024-05-11T02:25:04.296928460Z [2024-05-11 02:25:04,296: INFO/ForkPoolWorker-15] [16feaee9-bba0-472f-bdff-fd21d48c6c08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:04.437847901Z [2024-05-11 02:25:04,437: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f175ba5-7119-4ef5-bc5e-8f5fc4ffddd8] succeeded in 4.038266438001301s: None 2024-05-11T02:25:04.578536222Z [2024-05-11 02:25:04,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:25:05.701693300Z [2024-05-11 02:25:05,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:25:05.705509756Z [2024-05-11 02:25:05,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:05.731177038Z [2024-05-11 02:25:05,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:25:05.732771673Z [2024-05-11 02:25:05,732: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:05.732951659Z [2024-05-11 02:25:05,732: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:05.733192094Z [2024-05-11 02:25:05,732: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:05.733388947Z [2024-05-11 02:25:05,733: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:25:05.733813719Z [2024-05-11 02:25:05,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:25:05.734024431Z [2024-05-11 02:25:05,733: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:05.832981032Z [2024-05-11 02:25:05,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:06.456592179Z [2024-05-11 02:25:06,456: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16feaee9-bba0-472f-bdff-fd21d48c6c08] succeeded in 2.167108792000363s: None 2024-05-11T02:25:06.610486374Z [2024-05-11 02:25:06,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57683027-6d92-423d-9258-88579728877f] received 2024-05-11T02:25:06.619542384Z [2024-05-11 02:25:06,619: INFO/ForkPoolWorker-15] [57683027-6d92-423d-9258-88579728877f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:25:06.934895151Z [2024-05-11 02:25:06,931: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:25:08.037339992Z [2024-05-11 02:25:08,036: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:25:08.040546816Z [2024-05-11 02:25:08,040: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:08.062544395Z [2024-05-11 02:25:08,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:25:08.063853791Z [2024-05-11 02:25:08,063: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:08.063993045Z [2024-05-11 02:25:08,063: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:08.064218063Z [2024-05-11 02:25:08,063: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:08.064339614Z [2024-05-11 02:25:08,064: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:25:08.064648142Z [2024-05-11 02:25:08,064: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:25:08.064758946Z [2024-05-11 02:25:08,064: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:08.172104161Z [2024-05-11 02:25:08,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:08.721972882Z [2024-05-11 02:25:08,721: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57683027-6d92-423d-9258-88579728877f] succeeded in 2.106161964000421s: None 2024-05-11T02:25:09.270385327Z [2024-05-11 02:25:09,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50356337-664c-4625-81cf-4af7130fdf4f] received 2024-05-11T02:25:09.280235833Z [2024-05-11 02:25:09,279: INFO/ForkPoolWorker-15] [50356337-664c-4625-81cf-4af7130fdf4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:25:09.550369904Z [2024-05-11 02:25:09,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:25:10.712567513Z [2024-05-11 02:25:10,712: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:25:10.715798540Z [2024-05-11 02:25:10,715: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:25:10.731799521Z [2024-05-11 02:25:10,731: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:25:10.732948833Z [2024-05-11 02:25:10,732: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:25:10.732963937Z [2024-05-11 02:25:10,732: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:25:10.733119576Z [2024-05-11 02:25:10,732: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:25:10.733141848Z [2024-05-11 02:25:10,733: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:25:10.733345836Z [2024-05-11 02:25:10,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:25:10.733378254Z [2024-05-11 02:25:10,733: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:25:10.812884470Z [2024-05-11 02:25:10,812: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:25:11.427730216Z [2024-05-11 02:25:11,427: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50356337-664c-4625-81cf-4af7130fdf4f] succeeded in 2.1524874079987057s: None 2024-05-11T02:26:00.368428293Z [2024-05-11 02:26:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c49a526-0d92-428a-9abb-5acf58160f0b] received 2024-05-11T02:26:00.370321628Z [2024-05-11 02:26:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8a80ed3-972d-4321-8fe6-12726af9f8e4] received 2024-05-11T02:26:00.385775040Z [2024-05-11 02:26:00,385: INFO/ForkPoolWorker-15] [3c49a526-0d92-428a-9abb-5acf58160f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:26:00.395472721Z [2024-05-11 02:26:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e787d995-e236-470b-a5a8-a14145a5ba9a] received 2024-05-11T02:26:00.400525548Z [2024-05-11 02:26:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2352182f-c991-43be-9bd4-eaaade0219e2] received 2024-05-11T02:26:00.401010772Z [2024-05-11 02:26:00,400: INFO/ForkPoolWorker-16] [f8a80ed3-972d-4321-8fe6-12726af9f8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:26:00.411788200Z [2024-05-11 02:26:00,411: INFO/ForkPoolWorker-1] [e787d995-e236-470b-a5a8-a14145a5ba9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:26:00.419462700Z [2024-05-11 02:26:00,418: INFO/ForkPoolWorker-2] [2352182f-c991-43be-9bd4-eaaade0219e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:26:00.722831236Z [2024-05-11 02:26:00,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:26:00.739783715Z [2024-05-11 02:26:00,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:26:00.748800314Z [2024-05-11 02:26:00,745: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:26:00.769802870Z [2024-05-11 02:26:00,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:26:00.903059428Z [2024-05-11 02:26:00,902: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:26:00.907005841Z [2024-05-11 02:26:00,906: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:26:00.926999735Z [2024-05-11 02:26:00,926: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:26:00.927870259Z [2024-05-11 02:26:00,927: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:26:00.927935316Z [2024-05-11 02:26:00,927: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:26:00.927991265Z [2024-05-11 02:26:00,927: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:26:00.928241435Z [2024-05-11 02:26:00,928: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:26:01.045521694Z [2024-05-11 02:26:01,044: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:26:01.113827765Z [2024-05-11 02:26:01,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:26:01.812586379Z [2024-05-11 02:26:01,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c49a526-0d92-428a-9abb-5acf58160f0b] succeeded in 1.4411788449997402s: None 2024-05-11T02:26:01.850091552Z [2024-05-11 02:26:01,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2352182f-c991-43be-9bd4-eaaade0219e2] succeeded in 1.4481016549998458s: None 2024-05-11T02:26:02.062509027Z [2024-05-11 02:26:02,062: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:26:02.065736299Z [2024-05-11 02:26:02,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:26:02.086951737Z [2024-05-11 02:26:02,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:26:02.088786144Z [2024-05-11 02:26:02,088: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:26:02.088878202Z [2024-05-11 02:26:02,088: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:26:02.089080381Z [2024-05-11 02:26:02,088: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:26:02.089154614Z [2024-05-11 02:26:02,089: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:26:02.089431134Z [2024-05-11 02:26:02,089: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:26:02.089476013Z [2024-05-11 02:26:02,089: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:26:02.168827765Z [2024-05-11 02:26:02,168: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:26:02.390235587Z [2024-05-11 02:26:02,389: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:26:02.394374051Z [2024-05-11 02:26:02,393: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:26:02.417115796Z [2024-05-11 02:26:02,416: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:26:02.418545700Z [2024-05-11 02:26:02,418: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:26:02.418563554Z [2024-05-11 02:26:02,418: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:26:02.418717526Z [2024-05-11 02:26:02,418: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:26:02.418758928Z [2024-05-11 02:26:02,418: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:26:02.419089321Z [2024-05-11 02:26:02,418: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:26:02.419271557Z [2024-05-11 02:26:02,419: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:26:02.518810532Z [2024-05-11 02:26:02,518: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:26:04.119910097Z [2024-05-11 02:26:04,119: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e787d995-e236-470b-a5a8-a14145a5ba9a] succeeded in 3.718105130999902s: None 2024-05-11T02:26:04.201187157Z [2024-05-11 02:26:04,200: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8a80ed3-972d-4321-8fe6-12726af9f8e4] succeeded in 3.8177423549986997s: None 2024-05-11T02:27:00.288782533Z [2024-05-11 02:27:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0888185c-7558-4038-8007-dcc41f3b85b4] received 2024-05-11T02:27:00.288817393Z [2024-05-11 02:27:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9c3fea1-ae78-4843-86e5-6a591c81b116] received 2024-05-11T02:27:00.288821550Z [2024-05-11 02:27:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3c2bab5-92c1-48c5-abd6-17383eba1f75] received 2024-05-11T02:27:00.310080447Z [2024-05-11 02:27:00,307: INFO/ForkPoolWorker-1] [b3c2bab5-92c1-48c5-abd6-17383eba1f75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:27:00.310105969Z [2024-05-11 02:27:00,307: INFO/ForkPoolWorker-16] [b9c3fea1-ae78-4843-86e5-6a591c81b116] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:27:00.311226779Z [2024-05-11 02:27:00,310: INFO/ForkPoolWorker-15] [0888185c-7558-4038-8007-dcc41f3b85b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:27:00.760438113Z [2024-05-11 02:27:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:27:00.827214367Z [2024-05-11 02:27:00,819: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:27:00.945418838Z [2024-05-11 02:27:00,941: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:27:01.301405019Z [2024-05-11 02:27:01,300: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:27:01.307608835Z [2024-05-11 02:27:01,307: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:27:01.356901956Z [2024-05-11 02:27:01,356: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:27:01.362850112Z [2024-05-11 02:27:01,362: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:27:01.362916244Z [2024-05-11 02:27:01,362: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:27:01.363011313Z [2024-05-11 02:27:01,362: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:27:01.363604636Z [2024-05-11 02:27:01,363: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:27:01.527470576Z [2024-05-11 02:27:01,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:27:02.097934672Z [2024-05-11 02:27:02,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9c3fea1-ae78-4843-86e5-6a591c81b116] succeeded in 1.8069817709983909s: None 2024-05-11T02:27:02.414371498Z [2024-05-11 02:27:02,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:27:02.417781249Z [2024-05-11 02:27:02,417: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:27:02.437985753Z [2024-05-11 02:27:02,437: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:27:02.439593468Z [2024-05-11 02:27:02,439: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:27:02.439785926Z [2024-05-11 02:27:02,439: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:27:02.440042951Z [2024-05-11 02:27:02,439: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:27:02.440203487Z [2024-05-11 02:27:02,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:27:02.440574302Z [2024-05-11 02:27:02,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:27:02.440749601Z [2024-05-11 02:27:02,440: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:27:02.520795903Z [2024-05-11 02:27:02,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:27:02.657329484Z [2024-05-11 02:27:02,656: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:27:02.660930651Z [2024-05-11 02:27:02,660: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:27:02.683629152Z [2024-05-11 02:27:02,683: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:27:02.686088742Z [2024-05-11 02:27:02,685: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:27:02.686351524Z [2024-05-11 02:27:02,686: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:27:02.686593121Z [2024-05-11 02:27:02,686: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:27:02.690035356Z [2024-05-11 02:27:02,686: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:27:02.690627391Z [2024-05-11 02:27:02,690: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:27:02.690844558Z [2024-05-11 02:27:02,690: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:27:02.806678974Z [2024-05-11 02:27:02,806: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:27:05.069828533Z [2024-05-11 02:27:05,069: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3c2bab5-92c1-48c5-abd6-17383eba1f75] succeeded in 4.77951770800064s: None 2024-05-11T02:27:05.163287857Z [2024-05-11 02:27:05,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0888185c-7558-4038-8007-dcc41f3b85b4] succeeded in 4.876261156001419s: None 2024-05-11T02:27:34.495181427Z [2024-05-11 02:27:34,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1615d2e0-ca34-47f8-afee-1cf91926d126] received 2024-05-11T02:27:34.504121188Z [2024-05-11 02:27:34,503: INFO/ForkPoolWorker-15] [1615d2e0-ca34-47f8-afee-1cf91926d126] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022733_983273', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:27:34.819822687Z [2024-05-11 02:27:34,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-11T02:27:35.147238769Z [2024-05-11 02:27:35,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:27:35.854003138Z [2024-05-11 02:27:35,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1615d2e0-ca34-47f8-afee-1cf91926d126] succeeded in 1.355828763998943s: None 2024-05-11T02:28:00.538733765Z [2024-05-11 02:28:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf1d660a-bbe8-49ea-89a0-1b4218413d37] received 2024-05-11T02:28:00.542513561Z [2024-05-11 02:28:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8f4872d-fcee-434f-a24b-41b02364120d] received 2024-05-11T02:28:00.551777948Z [2024-05-11 02:28:00,551: INFO/ForkPoolWorker-16] [c8f4872d-fcee-434f-a24b-41b02364120d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:28:00.563806952Z [2024-05-11 02:28:00,563: INFO/ForkPoolWorker-15] [bf1d660a-bbe8-49ea-89a0-1b4218413d37] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:28:00.586760283Z [2024-05-11 02:28:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0007419-04fd-46ee-ba70-698d14079edc] received 2024-05-11T02:28:00.604731738Z [2024-05-11 02:28:00,604: INFO/ForkPoolWorker-1] [d0007419-04fd-46ee-ba70-698d14079edc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:28:00.941732048Z [2024-05-11 02:28:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:28:00.966158437Z [2024-05-11 02:28:00,962: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:28:00.993943319Z [2024-05-11 02:28:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00438b82-3e14-4a46-bfa7-4e9a310fce85] received 2024-05-11T02:28:01.029245879Z [2024-05-11 02:28:01,027: INFO/ForkPoolWorker-2] [00438b82-3e14-4a46-bfa7-4e9a310fce85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:28:01.309789530Z [2024-05-11 02:28:01,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:28:01.483463480Z [2024-05-11 02:28:01,479: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:28:01.593599890Z [2024-05-11 02:28:01,593: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:28:01.664031763Z [2024-05-11 02:28:01,663: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:28:01.668309417Z [2024-05-11 02:28:01,667: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:28:01.749097790Z [2024-05-11 02:28:01,748: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:28:01.752891955Z [2024-05-11 02:28:01,752: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:28:01.753281510Z [2024-05-11 02:28:01,753: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:28:01.753453383Z [2024-05-11 02:28:01,753: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:28:01.754259720Z [2024-05-11 02:28:01,753: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:28:01.904243552Z [2024-05-11 02:28:01,903: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:28:02.393726607Z [2024-05-11 02:28:02,393: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf1d660a-bbe8-49ea-89a0-1b4218413d37] succeeded in 1.8499724499997683s: None 2024-05-11T02:28:02.612835610Z [2024-05-11 02:28:02,612: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[00438b82-3e14-4a46-bfa7-4e9a310fce85] succeeded in 1.6137107930007915s: None 2024-05-11T02:28:02.795760699Z [2024-05-11 02:28:02,795: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:28:02.807589208Z [2024-05-11 02:28:02,807: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:28:02.822577196Z [2024-05-11 02:28:02,822: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:28:02.826034665Z [2024-05-11 02:28:02,825: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:28:02.861366345Z [2024-05-11 02:28:02,861: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:28:02.863136506Z [2024-05-11 02:28:02,862: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:28:02.863490547Z [2024-05-11 02:28:02,863: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:28:02.863739241Z [2024-05-11 02:28:02,863: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:28:02.863949337Z [2024-05-11 02:28:02,863: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:28:02.864323815Z [2024-05-11 02:28:02,864: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:28:02.864945466Z [2024-05-11 02:28:02,864: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:28:02.890667439Z [2024-05-11 02:28:02,890: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:28:02.894706751Z [2024-05-11 02:28:02,894: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:28:02.894728240Z [2024-05-11 02:28:02,894: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:28:02.894986532Z [2024-05-11 02:28:02,894: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:28:02.895047566Z [2024-05-11 02:28:02,894: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:28:02.895339649Z [2024-05-11 02:28:02,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:28:02.895387533Z [2024-05-11 02:28:02,895: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:28:02.966883931Z [2024-05-11 02:28:02,966: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:28:03.039060457Z [2024-05-11 02:28:03,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:28:05.189734218Z [2024-05-11 02:28:05,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d0007419-04fd-46ee-ba70-698d14079edc] succeeded in 4.590152279999529s: None 2024-05-11T02:28:05.332964004Z [2024-05-11 02:28:05,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8f4872d-fcee-434f-a24b-41b02364120d] succeeded in 4.788993207999738s: None 2024-05-11T02:29:00.924744451Z [2024-05-11 02:29:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28e89337-b864-4710-8cd1-b6c9ed33dafb] received 2024-05-11T02:29:00.927883601Z [2024-05-11 02:29:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf21f90-83cb-4be2-a1ba-479f3d12d983] received 2024-05-11T02:29:00.942207460Z [2024-05-11 02:29:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[662c9ea4-d461-4b40-a704-7d77844ca31a] received 2024-05-11T02:29:00.943098071Z [2024-05-11 02:29:00,942: INFO/ForkPoolWorker-15] [28e89337-b864-4710-8cd1-b6c9ed33dafb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:29:00.943415086Z [2024-05-11 02:29:00,942: INFO/ForkPoolWorker-16] [dbf21f90-83cb-4be2-a1ba-479f3d12d983] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:29:00.965734635Z [2024-05-11 02:29:00,965: INFO/ForkPoolWorker-1] [662c9ea4-d461-4b40-a704-7d77844ca31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:29:01.324480604Z [2024-05-11 02:29:01,321: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:29:01.342964358Z [2024-05-11 02:29:01,339: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:29:01.401249292Z [2024-05-11 02:29:01,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:29:01.480738688Z [2024-05-11 02:29:01,480: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:29:01.484865060Z [2024-05-11 02:29:01,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:29:01.502518833Z [2024-05-11 02:29:01,502: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:29:01.503525340Z [2024-05-11 02:29:01,503: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:29:01.503664834Z [2024-05-11 02:29:01,503: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:29:01.504188403Z [2024-05-11 02:29:01,504: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:29:01.506688959Z [2024-05-11 02:29:01,506: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:29:01.606565833Z [2024-05-11 02:29:01,606: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:29:02.275609724Z [2024-05-11 02:29:02,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbf21f90-83cb-4be2-a1ba-479f3d12d983] succeeded in 1.344588695999846s: None 2024-05-11T02:29:02.551941870Z [2024-05-11 02:29:02,551: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:29:02.555416596Z [2024-05-11 02:29:02,554: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:29:02.584430990Z [2024-05-11 02:29:02,584: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:29:02.586090693Z [2024-05-11 02:29:02,585: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:29:02.586236177Z [2024-05-11 02:29:02,586: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:29:02.586514370Z [2024-05-11 02:29:02,586: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:29:02.586713260Z [2024-05-11 02:29:02,586: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:29:02.587244668Z [2024-05-11 02:29:02,586: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:29:02.587404783Z [2024-05-11 02:29:02,587: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:29:02.611829300Z [2024-05-11 02:29:02,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:29:02.615364423Z [2024-05-11 02:29:02,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:29:02.637005506Z [2024-05-11 02:29:02,636: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:29:02.642199237Z [2024-05-11 02:29:02,641: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:29:02.642305173Z [2024-05-11 02:29:02,642: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:29:02.642498752Z [2024-05-11 02:29:02,642: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:29:02.642594160Z [2024-05-11 02:29:02,642: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:29:02.643013454Z [2024-05-11 02:29:02,642: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:29:02.643067910Z [2024-05-11 02:29:02,642: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:29:02.673545878Z [2024-05-11 02:29:02,673: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:29:02.724698924Z [2024-05-11 02:29:02,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:29:04.311021254Z [2024-05-11 02:29:04,310: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[662c9ea4-d461-4b40-a704-7d77844ca31a] succeeded in 3.3650215689995093s: None 2024-05-11T02:29:04.617213487Z [2024-05-11 02:29:04,616: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28e89337-b864-4710-8cd1-b6c9ed33dafb] succeeded in 3.6907849990002433s: None 2024-05-11T02:29:34.155038595Z [2024-05-11 02:29:34,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1aabcae0-802f-4131-bb64-21c1921b9b82] received 2024-05-11T02:29:34.165273369Z [2024-05-11 02:29:34,164: INFO/ForkPoolWorker-15] [1aabcae0-802f-4131-bb64-21c1921b9b82] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240511022933_088190', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-11T02:29:34.454540999Z [2024-05-11 02:29:34,450: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-11T02:29:34.783225367Z [2024-05-11 02:29:34,782: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:29:35.312228658Z [2024-05-11 02:29:35,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1aabcae0-802f-4131-bb64-21c1921b9b82] succeeded in 1.1545307510004932s: None 2024-05-11T02:30:00.845244315Z [2024-05-11 02:30:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[205a69f8-f499-4ee2-bf6e-5fb32ea23050] received 2024-05-11T02:30:00.848696531Z [2024-05-11 02:30:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73cdefa4-4b7d-4255-bf65-cc39f43446f1] received 2024-05-11T02:30:00.851744161Z [2024-05-11 02:30:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abce8d0f-3039-470c-b79d-a82bc7652b02] received 2024-05-11T02:30:00.854912133Z [2024-05-11 02:30:00,854: INFO/ForkPoolWorker-15] [205a69f8-f499-4ee2-bf6e-5fb32ea23050] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:30:00.855218659Z [2024-05-11 02:30:00,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e750e30-bf1d-4ccc-98e7-e7f41b3be03c] received 2024-05-11T02:30:00.859606438Z [2024-05-11 02:30:00,859: INFO/ForkPoolWorker-16] [73cdefa4-4b7d-4255-bf65-cc39f43446f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:00.860810469Z [2024-05-11 02:30:00,860: INFO/ForkPoolWorker-1] [abce8d0f-3039-470c-b79d-a82bc7652b02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:30:00.865033371Z [2024-05-11 02:30:00,864: INFO/ForkPoolWorker-2] [2e750e30-bf1d-4ccc-98e7-e7f41b3be03c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:30:00.866827097Z [2024-05-11 02:30:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b5fe521-7cfa-4c37-a4a4-bbcbaecce578] received 2024-05-11T02:30:00.885906266Z [2024-05-11 02:30:00,885: INFO/ForkPoolWorker-3] [6b5fe521-7cfa-4c37-a4a4-bbcbaecce578] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:30:01.337114502Z [2024-05-11 02:30:01,297: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:30:01.337143753Z [2024-05-11 02:30:01,318: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:30:01.443479914Z [2024-05-11 02:30:01,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:30:01.501108944Z [2024-05-11 02:30:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:30:01.502654208Z [2024-05-11 02:30:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:30:01.616099122Z [2024-05-11 02:30:01,615: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:01.648242022Z [2024-05-11 02:30:01,647: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T02:30:01.660282814Z [2024-05-11 02:30:01,659: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:01.696997612Z [2024-05-11 02:30:01,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:30:01.698049400Z [2024-05-11 02:30:01,697: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:30:01.698173231Z [2024-05-11 02:30:01,698: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:30:01.698250117Z [2024-05-11 02:30:01,698: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T02:30:01.698459170Z [2024-05-11 02:30:01,698: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:30:01.865388305Z [2024-05-11 02:30:01,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:02.330786234Z [2024-05-11 02:30:02,330: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6b5fe521-7cfa-4c37-a4a4-bbcbaecce578] succeeded in 1.457731689000866s: None 2024-05-11T02:30:02.491320786Z [2024-05-11 02:30:02,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[205a69f8-f499-4ee2-bf6e-5fb32ea23050] succeeded in 1.6442929699987872s: None 2024-05-11T02:30:02.754837657Z [2024-05-11 02:30:02,754: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:30:02.758045494Z [2024-05-11 02:30:02,757: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:02.788063477Z [2024-05-11 02:30:02,787: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:30:02.789552077Z [2024-05-11 02:30:02,789: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:02.789698078Z [2024-05-11 02:30:02,789: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:02.789928093Z [2024-05-11 02:30:02,789: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:02.790022530Z [2024-05-11 02:30:02,789: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:30:02.790343638Z [2024-05-11 02:30:02,790: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:30:02.790787079Z [2024-05-11 02:30:02,790: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:02.866493602Z [2024-05-11 02:30:02,866: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:02.997007821Z [2024-05-11 02:30:02,996: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:30:03.027469182Z [2024-05-11 02:30:03,001: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:03.070725818Z [2024-05-11 02:30:03,070: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:30:03.075072370Z [2024-05-11 02:30:03,074: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:03.075793848Z [2024-05-11 02:30:03,075: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:03.076204374Z [2024-05-11 02:30:03,075: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:03.076387460Z [2024-05-11 02:30:03,076: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:30:03.076740551Z [2024-05-11 02:30:03,076: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:30:03.076937876Z [2024-05-11 02:30:03,076: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:03.137512740Z [2024-05-11 02:30:03,137: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:30:03.140903340Z [2024-05-11 02:30:03,140: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:03.179287072Z [2024-05-11 02:30:03,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:30:03.181037565Z [2024-05-11 02:30:03,180: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:03.181269728Z [2024-05-11 02:30:03,180: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:03.181538666Z [2024-05-11 02:30:03,181: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:03.183177196Z [2024-05-11 02:30:03,181: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:30:03.183570905Z [2024-05-11 02:30:03,183: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:30:03.183762499Z [2024-05-11 02:30:03,183: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:03.242334642Z [2024-05-11 02:30:03,242: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:03.266449176Z [2024-05-11 02:30:03,266: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:03.912097738Z [2024-05-11 02:30:03,911: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73cdefa4-4b7d-4255-bf65-cc39f43446f1] succeeded in 3.0595144229992s: None 2024-05-11T02:30:04.264600930Z [2024-05-11 02:30:04,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab0512f-6f67-4155-b989-25ce07318e13] received 2024-05-11T02:30:04.281061036Z [2024-05-11 02:30:04,280: INFO/ForkPoolWorker-15] [4ab0512f-6f67-4155-b989-25ce07318e13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:04.502429008Z [2024-05-11 02:30:04,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e750e30-bf1d-4ccc-98e7-e7f41b3be03c] succeeded in 3.6445758099998784s: None 2024-05-11T02:30:04.567475761Z [2024-05-11 02:30:04,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:30:05.300957223Z [2024-05-11 02:30:05,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abce8d0f-3039-470c-b79d-a82bc7652b02] succeeded in 4.446733269998731s: None 2024-05-11T02:30:05.743227182Z [2024-05-11 02:30:05,742: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:30:05.746473451Z [2024-05-11 02:30:05,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:05.783849412Z [2024-05-11 02:30:05,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:30:05.788131703Z [2024-05-11 02:30:05,787: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:05.788239800Z [2024-05-11 02:30:05,788: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:05.788414261Z [2024-05-11 02:30:05,788: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:05.788506697Z [2024-05-11 02:30:05,788: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:30:05.788766346Z [2024-05-11 02:30:05,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:30:05.789267449Z [2024-05-11 02:30:05,789: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:05.869856652Z [2024-05-11 02:30:05,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:06.423172341Z [2024-05-11 02:30:06,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ab0512f-6f67-4155-b989-25ce07318e13] succeeded in 2.155948843999795s: None 2024-05-11T02:30:06.992801587Z [2024-05-11 02:30:06,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44aefa8b-b3b7-41b7-a066-3bdc963aa78f] received 2024-05-11T02:30:06.999937672Z [2024-05-11 02:30:06,999: INFO/ForkPoolWorker-15] [44aefa8b-b3b7-41b7-a066-3bdc963aa78f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:30:07.339547998Z [2024-05-11 02:30:07,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:30:08.541619104Z [2024-05-11 02:30:08,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:30:08.545478910Z [2024-05-11 02:30:08,544: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:08.564995400Z [2024-05-11 02:30:08,564: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:30:08.566417502Z [2024-05-11 02:30:08,566: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:08.566475117Z [2024-05-11 02:30:08,566: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:08.566612970Z [2024-05-11 02:30:08,566: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:08.566644756Z [2024-05-11 02:30:08,566: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:30:08.567500701Z [2024-05-11 02:30:08,567: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:30:08.567514032Z [2024-05-11 02:30:08,567: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:08.666316374Z [2024-05-11 02:30:08,666: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:10.027126721Z [2024-05-11 02:30:10,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44aefa8b-b3b7-41b7-a066-3bdc963aa78f] succeeded in 3.032306940000126s: None 2024-05-11T02:30:10.918479768Z [2024-05-11 02:30:10,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[212bd0f0-dbe0-4d1f-ac5f-ec5e210863b2] received 2024-05-11T02:30:10.926188298Z [2024-05-11 02:30:10,925: INFO/ForkPoolWorker-15] [212bd0f0-dbe0-4d1f-ac5f-ec5e210863b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:30:11.214323994Z [2024-05-11 02:30:11,211: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:30:12.353472984Z [2024-05-11 02:30:12,353: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:30:12.356930071Z [2024-05-11 02:30:12,356: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:30:12.377515447Z [2024-05-11 02:30:12,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:30:12.378697948Z [2024-05-11 02:30:12,378: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:30:12.378715374Z [2024-05-11 02:30:12,378: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:30:12.378865039Z [2024-05-11 02:30:12,378: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:30:12.378889432Z [2024-05-11 02:30:12,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:30:12.379299541Z [2024-05-11 02:30:12,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:30:12.379309633Z [2024-05-11 02:30:12,379: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:30:12.456221598Z [2024-05-11 02:30:12,455: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:30:13.046438418Z [2024-05-11 02:30:13,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[212bd0f0-dbe0-4d1f-ac5f-ec5e210863b2] succeeded in 2.124945003999528s: None 2024-05-11T02:31:00.541622983Z [2024-05-11 02:31:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[120b4a08-adf5-4764-9efe-9830eace5b9a] received 2024-05-11T02:31:00.548174302Z [2024-05-11 02:31:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f08a4010-4f58-462b-a752-a89b8fe3c594] received 2024-05-11T02:31:00.551020261Z [2024-05-11 02:31:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[089ffb77-5e0c-410b-955d-27c5f6129ae3] received 2024-05-11T02:31:00.559069448Z [2024-05-11 02:31:00,558: INFO/ForkPoolWorker-1] [089ffb77-5e0c-410b-955d-27c5f6129ae3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:31:00.562830004Z [2024-05-11 02:31:00,562: INFO/ForkPoolWorker-15] [120b4a08-adf5-4764-9efe-9830eace5b9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:31:00.563456325Z [2024-05-11 02:31:00,562: INFO/ForkPoolWorker-16] [f08a4010-4f58-462b-a752-a89b8fe3c594] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:31:00.832471485Z [2024-05-11 02:31:00,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:31:00.844335187Z [2024-05-11 02:31:00,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:31:00.868905185Z [2024-05-11 02:31:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:31:01.016833246Z [2024-05-11 02:31:01,013: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:31:01.024272807Z [2024-05-11 02:31:01,023: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:31:01.089410159Z [2024-05-11 02:31:01,088: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:31:01.089685244Z [2024-05-11 02:31:01,089: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:31:01.089880213Z [2024-05-11 02:31:01,089: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:31:01.090112688Z [2024-05-11 02:31:01,089: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:31:01.090350238Z [2024-05-11 02:31:01,090: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:31:01.214351268Z [2024-05-11 02:31:01,214: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:31:01.798426541Z [2024-05-11 02:31:01,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f08a4010-4f58-462b-a752-a89b8fe3c594] succeeded in 1.2458534719989984s: None 2024-05-11T02:31:02.023376006Z [2024-05-11 02:31:02,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:31:02.026518455Z [2024-05-11 02:31:02,026: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:31:02.050931051Z [2024-05-11 02:31:02,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:31:02.052194098Z [2024-05-11 02:31:02,051: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:31:02.052219063Z [2024-05-11 02:31:02,052: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:31:02.052368156Z [2024-05-11 02:31:02,052: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:31:02.052516612Z [2024-05-11 02:31:02,052: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:31:02.052830843Z [2024-05-11 02:31:02,052: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:31:02.052888917Z [2024-05-11 02:31:02,052: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:31:02.105206881Z [2024-05-11 02:31:02,104: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:31:02.108386870Z [2024-05-11 02:31:02,107: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:31:02.137198123Z [2024-05-11 02:31:02,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:31:02.139994207Z [2024-05-11 02:31:02,138: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:31:02.140019735Z [2024-05-11 02:31:02,138: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:31:02.140024497Z [2024-05-11 02:31:02,138: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:31:02.140028639Z [2024-05-11 02:31:02,138: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:31:02.140031758Z [2024-05-11 02:31:02,139: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:31:02.140034827Z [2024-05-11 02:31:02,139: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:31:02.156902272Z [2024-05-11 02:31:02,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:31:02.271170392Z [2024-05-11 02:31:02,270: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:31:03.719950172Z [2024-05-11 02:31:03,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[089ffb77-5e0c-410b-955d-27c5f6129ae3] succeeded in 3.167857398000706s: None 2024-05-11T02:31:03.881660290Z [2024-05-11 02:31:03,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[120b4a08-adf5-4764-9efe-9830eace5b9a] succeeded in 3.3378777419984544s: None 2024-05-11T02:31:55.681684272Z [2024-05-11 02:31:55,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aec6936d-b444-4afa-8592-b5651029d488] received 2024-05-11T02:31:55.692509815Z [2024-05-11 02:31:55,692: INFO/ForkPoolWorker-15] [aec6936d-b444-4afa-8592-b5651029d488] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240511023154_237903', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-11T02:31:55.945800179Z [2024-05-11 02:31:55,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-11T02:31:56.194038619Z [2024-05-11 02:31:56,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:31:56.721196405Z [2024-05-11 02:31:56,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aec6936d-b444-4afa-8592-b5651029d488] succeeded in 1.0375092409994977s: None 2024-05-11T02:32:00.945963616Z [2024-05-11 02:32:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f41bec22-2de9-4984-8443-9520ff6dfe67] received 2024-05-11T02:32:00.947801034Z [2024-05-11 02:32:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e946e63b-9d6a-43c9-8b12-e71386485082] received 2024-05-11T02:32:00.953788729Z [2024-05-11 02:32:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[515088dc-2cd2-4309-b04a-8678be0af86d] received 2024-05-11T02:32:00.954567786Z [2024-05-11 02:32:00,954: INFO/ForkPoolWorker-16] [e946e63b-9d6a-43c9-8b12-e71386485082] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:32:00.955076330Z [2024-05-11 02:32:00,954: INFO/ForkPoolWorker-15] [f41bec22-2de9-4984-8443-9520ff6dfe67] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:32:00.963625058Z [2024-05-11 02:32:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4228395c-4057-4538-81a4-1aa3274e84d9] received 2024-05-11T02:32:00.970914047Z [2024-05-11 02:32:00,970: INFO/ForkPoolWorker-2] [4228395c-4057-4538-81a4-1aa3274e84d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:32:00.972972610Z [2024-05-11 02:32:00,972: INFO/ForkPoolWorker-1] [515088dc-2cd2-4309-b04a-8678be0af86d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:32:01.413471978Z [2024-05-11 02:32:01,410: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:32:01.416800714Z [2024-05-11 02:32:01,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:32:01.463721823Z [2024-05-11 02:32:01,460: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:32:01.516350042Z [2024-05-11 02:32:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:32:01.625099504Z [2024-05-11 02:32:01,624: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:32:01.629158346Z [2024-05-11 02:32:01,628: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:32:01.675043608Z [2024-05-11 02:32:01,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:32:01.677253076Z [2024-05-11 02:32:01,677: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:32:01.677361491Z [2024-05-11 02:32:01,677: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:32:01.677371918Z [2024-05-11 02:32:01,677: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:32:01.677555458Z [2024-05-11 02:32:01,677: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:32:01.763850704Z [2024-05-11 02:32:01,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:32:01.809558547Z [2024-05-11 02:32:01,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:32:02.475277980Z [2024-05-11 02:32:02,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e946e63b-9d6a-43c9-8b12-e71386485082] succeeded in 1.5260580070007563s: None 2024-05-11T02:32:02.479591934Z [2024-05-11 02:32:02,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f41bec22-2de9-4984-8443-9520ff6dfe67] succeeded in 1.532103752000694s: None 2024-05-11T02:32:02.719454151Z [2024-05-11 02:32:02,719: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:32:02.722828874Z [2024-05-11 02:32:02,722: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:32:02.748614458Z [2024-05-11 02:32:02,748: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:32:02.751672450Z [2024-05-11 02:32:02,751: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:32:02.751734847Z [2024-05-11 02:32:02,751: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:32:02.751908263Z [2024-05-11 02:32:02,751: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:32:02.751997377Z [2024-05-11 02:32:02,751: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:32:02.752357170Z [2024-05-11 02:32:02,752: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:32:02.752412037Z [2024-05-11 02:32:02,752: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:32:02.840821946Z [2024-05-11 02:32:02,840: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:32:02.855956956Z [2024-05-11 02:32:02,855: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:32:02.859318440Z [2024-05-11 02:32:02,858: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:32:02.886956501Z [2024-05-11 02:32:02,886: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:32:02.892652027Z [2024-05-11 02:32:02,892: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:32:02.892812890Z [2024-05-11 02:32:02,892: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:32:02.893061128Z [2024-05-11 02:32:02,892: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:32:02.893189226Z [2024-05-11 02:32:02,893: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:32:02.893495548Z [2024-05-11 02:32:02,893: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:32:02.893624053Z [2024-05-11 02:32:02,893: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:32:02.967207794Z [2024-05-11 02:32:02,966: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:32:05.032073383Z [2024-05-11 02:32:05,031: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[515088dc-2cd2-4309-b04a-8678be0af86d] succeeded in 4.066445382000893s: None 2024-05-11T02:32:05.466839640Z [2024-05-11 02:32:05,466: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4228395c-4057-4538-81a4-1aa3274e84d9] succeeded in 4.501730566000333s: None 2024-05-11T02:33:00.310022558Z [2024-05-11 02:33:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f5608ba-c3f1-43ae-b4cf-2287e83c846f] received 2024-05-11T02:33:00.318599361Z [2024-05-11 02:33:00,318: INFO/ForkPoolWorker-15] [1f5608ba-c3f1-43ae-b4cf-2287e83c846f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:33:00.323320865Z [2024-05-11 02:33:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2ad05a4-c2bc-4a56-95c5-2619410ce9d2] received 2024-05-11T02:33:00.326071471Z [2024-05-11 02:33:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a223f3f-3ae8-4c5c-9f49-29af71ca2970] received 2024-05-11T02:33:00.339425535Z [2024-05-11 02:33:00,339: INFO/ForkPoolWorker-16] [e2ad05a4-c2bc-4a56-95c5-2619410ce9d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:33:00.345375064Z [2024-05-11 02:33:00,345: INFO/ForkPoolWorker-1] [8a223f3f-3ae8-4c5c-9f49-29af71ca2970] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:33:00.688882403Z [2024-05-11 02:33:00,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:33:00.689673134Z [2024-05-11 02:33:00,686: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:33:00.704588599Z [2024-05-11 02:33:00,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:33:00.929395748Z [2024-05-11 02:33:00,928: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:33:00.933721800Z [2024-05-11 02:33:00,933: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:33:00.954826812Z [2024-05-11 02:33:00,954: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:33:00.956677875Z [2024-05-11 02:33:00,956: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:33:00.956876969Z [2024-05-11 02:33:00,956: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:33:00.956994778Z [2024-05-11 02:33:00,956: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:33:00.957273677Z [2024-05-11 02:33:00,957: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:33:01.066027617Z [2024-05-11 02:33:01,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:33:01.831802096Z [2024-05-11 02:33:01,831: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a223f3f-3ae8-4c5c-9f49-29af71ca2970] succeeded in 1.4982209540012263s: None 2024-05-11T02:33:02.113332088Z [2024-05-11 02:33:02,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:33:02.116775230Z [2024-05-11 02:33:02,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:33:02.137495578Z [2024-05-11 02:33:02,137: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:33:02.141005088Z [2024-05-11 02:33:02,140: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:33:02.147801333Z [2024-05-11 02:33:02,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:33:02.150020886Z [2024-05-11 02:33:02,149: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:33:02.150337954Z [2024-05-11 02:33:02,150: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:33:02.150742900Z [2024-05-11 02:33:02,150: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:33:02.151019799Z [2024-05-11 02:33:02,150: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:33:02.151588071Z [2024-05-11 02:33:02,151: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:33:02.152371817Z [2024-05-11 02:33:02,152: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:33:02.161815320Z [2024-05-11 02:33:02,161: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:33:02.164113655Z [2024-05-11 02:33:02,163: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:33:02.164642081Z [2024-05-11 02:33:02,164: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:33:02.165013245Z [2024-05-11 02:33:02,164: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:33:02.165177906Z [2024-05-11 02:33:02,165: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:33:02.165528274Z [2024-05-11 02:33:02,165: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:33:02.166051984Z [2024-05-11 02:33:02,165: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:33:02.238051333Z [2024-05-11 02:33:02,237: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:33:02.252255146Z [2024-05-11 02:33:02,251: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:33:03.936806976Z [2024-05-11 02:33:03,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2ad05a4-c2bc-4a56-95c5-2619410ce9d2] succeeded in 3.6096063629993296s: None 2024-05-11T02:33:04.143612128Z [2024-05-11 02:33:04,142: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f5608ba-c3f1-43ae-b4cf-2287e83c846f] succeeded in 3.8301593649994174s: None 2024-05-11T02:34:00.867602820Z [2024-05-11 02:34:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3ce66c7-f081-4c7a-b2a0-d8e473e66436] received 2024-05-11T02:34:00.869683180Z [2024-05-11 02:34:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7fa15be-3072-4737-a873-8164f66f2b6f] received 2024-05-11T02:34:00.872253351Z [2024-05-11 02:34:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1df33562-03b8-49de-aa67-61595058b33c] received 2024-05-11T02:34:00.877626943Z [2024-05-11 02:34:00,877: INFO/ForkPoolWorker-16] [b7fa15be-3072-4737-a873-8164f66f2b6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:34:00.878076672Z [2024-05-11 02:34:00,877: INFO/ForkPoolWorker-15] [d3ce66c7-f081-4c7a-b2a0-d8e473e66436] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:34:00.879110763Z [2024-05-11 02:34:00,878: INFO/ForkPoolWorker-1] [1df33562-03b8-49de-aa67-61595058b33c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:34:00.888068665Z [2024-05-11 02:34:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590abdc3-6976-48c4-b52d-1bb5cde37d0f] received 2024-05-11T02:34:00.907887320Z [2024-05-11 02:34:00,907: INFO/ForkPoolWorker-2] [590abdc3-6976-48c4-b52d-1bb5cde37d0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:34:01.372220663Z [2024-05-11 02:34:01,368: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:34:01.424894802Z [2024-05-11 02:34:01,416: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:34:01.523125940Z [2024-05-11 02:34:01,520: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:34:01.533411119Z [2024-05-11 02:34:01,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:34:01.805309105Z [2024-05-11 02:34:01,805: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:34:01.822736404Z [2024-05-11 02:34:01,820: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T02:34:01.829261292Z [2024-05-11 02:34:01,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:34:01.961057741Z [2024-05-11 02:34:01,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:34:01.971738371Z [2024-05-11 02:34:01,971: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:34:01.971795563Z [2024-05-11 02:34:01,971: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:34:01.971868833Z [2024-05-11 02:34:01,971: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T02:34:01.972131703Z [2024-05-11 02:34:01,972: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:34:02.236555973Z [2024-05-11 02:34:02,236: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:34:02.446941963Z [2024-05-11 02:34:02,446: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1df33562-03b8-49de-aa67-61595058b33c] succeeded in 1.5734320799983834s: None 2024-05-11T02:34:02.942840776Z [2024-05-11 02:34:02,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3ce66c7-f081-4c7a-b2a0-d8e473e66436] succeeded in 2.0732004069996037s: None 2024-05-11T02:34:02.963462362Z [2024-05-11 02:34:02,963: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:34:02.967240809Z [2024-05-11 02:34:02,966: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:34:02.990271012Z [2024-05-11 02:34:02,990: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:34:02.991877929Z [2024-05-11 02:34:02,991: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:34:02.992056560Z [2024-05-11 02:34:02,991: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:34:02.992308101Z [2024-05-11 02:34:02,992: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:34:02.992461782Z [2024-05-11 02:34:02,992: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:34:02.992787206Z [2024-05-11 02:34:02,992: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:34:02.992904187Z [2024-05-11 02:34:02,992: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:34:03.116806556Z [2024-05-11 02:34:03,116: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:34:03.760623543Z [2024-05-11 02:34:03,760: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:34:03.763960758Z [2024-05-11 02:34:03,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:34:03.790752303Z [2024-05-11 02:34:03,790: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:34:03.792578378Z [2024-05-11 02:34:03,792: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:34:03.792703737Z [2024-05-11 02:34:03,792: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:34:03.792938546Z [2024-05-11 02:34:03,792: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:34:03.793068363Z [2024-05-11 02:34:03,792: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:34:03.793549704Z [2024-05-11 02:34:03,793: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:34:03.793666241Z [2024-05-11 02:34:03,793: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:34:03.886731402Z [2024-05-11 02:34:03,886: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:34:05.618746091Z [2024-05-11 02:34:05,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7fa15be-3072-4737-a873-8164f66f2b6f] succeeded in 4.7469240659993375s: None 2024-05-11T02:34:05.781365181Z [2024-05-11 02:34:05,780: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[590abdc3-6976-48c4-b52d-1bb5cde37d0f] succeeded in 4.890400808999402s: None 2024-05-11T02:35:01.246269668Z [2024-05-11 02:35:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96bc7d1d-4e42-4f34-a09e-4cbbaf682dcb] received 2024-05-11T02:35:01.250187433Z [2024-05-11 02:35:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c0053f9-5f14-443d-bd47-b376eaf57e74] received 2024-05-11T02:35:01.252790914Z [2024-05-11 02:35:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee66bc0b-6dc4-4643-8b12-a2d4c7de993b] received 2024-05-11T02:35:01.258418014Z [2024-05-11 02:35:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1d5bdb9-a970-4874-88e4-e122a5fad42b] received 2024-05-11T02:35:01.259101569Z [2024-05-11 02:35:01,258: INFO/ForkPoolWorker-16] [5c0053f9-5f14-443d-bd47-b376eaf57e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:35:01.263203662Z [2024-05-11 02:35:01,262: INFO/ForkPoolWorker-1] [ee66bc0b-6dc4-4643-8b12-a2d4c7de993b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:35:01.267930295Z [2024-05-11 02:35:01,267: INFO/ForkPoolWorker-15] [96bc7d1d-4e42-4f34-a09e-4cbbaf682dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:01.277706410Z [2024-05-11 02:35:01,277: INFO/ForkPoolWorker-2] [d1d5bdb9-a970-4874-88e4-e122a5fad42b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:35:01.528243007Z [2024-05-11 02:35:01,524: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:35:01.638201391Z [2024-05-11 02:35:01,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:35:01.665345805Z [2024-05-11 02:35:01,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:35:01.711850794Z [2024-05-11 02:35:01,700: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:35:01.725363857Z [2024-05-11 02:35:01,724: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:35:01.729559513Z [2024-05-11 02:35:01,729: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:01.757783478Z [2024-05-11 02:35:01,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:35:01.759222730Z [2024-05-11 02:35:01,758: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:35:01.759439496Z [2024-05-11 02:35:01,759: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:35:01.759579394Z [2024-05-11 02:35:01,759: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:35:01.759998020Z [2024-05-11 02:35:01,759: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:35:01.861303026Z [2024-05-11 02:35:01,860: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:02.594248932Z [2024-05-11 02:35:02,593: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee66bc0b-6dc4-4643-8b12-a2d4c7de993b] succeeded in 1.339506258000256s: None 2024-05-11T02:35:03.064299110Z [2024-05-11 02:35:03,063: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:35:03.067714277Z [2024-05-11 02:35:03,067: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:03.102805444Z [2024-05-11 02:35:03,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:35:03.105030024Z [2024-05-11 02:35:03,104: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:03.105302133Z [2024-05-11 02:35:03,104: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:03.105614117Z [2024-05-11 02:35:03,105: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:03.105783273Z [2024-05-11 02:35:03,105: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:35:03.106262440Z [2024-05-11 02:35:03,106: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:35:03.106413347Z [2024-05-11 02:35:03,106: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:03.206581273Z [2024-05-11 02:35:03,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:03.217664784Z [2024-05-11 02:35:03,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:35:03.221416775Z [2024-05-11 02:35:03,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:03.235072285Z [2024-05-11 02:35:03,234: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:35:03.238840274Z [2024-05-11 02:35:03,238: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:03.259086207Z [2024-05-11 02:35:03,258: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:35:03.260783022Z [2024-05-11 02:35:03,260: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:03.260972943Z [2024-05-11 02:35:03,260: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:03.261194159Z [2024-05-11 02:35:03,260: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:03.261217664Z [2024-05-11 02:35:03,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:35:03.261541589Z [2024-05-11 02:35:03,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:35:03.261688975Z [2024-05-11 02:35:03,261: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:03.296752917Z [2024-05-11 02:35:03,296: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:35:03.298630097Z [2024-05-11 02:35:03,298: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:03.298726495Z [2024-05-11 02:35:03,298: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:03.298882711Z [2024-05-11 02:35:03,298: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:03.298936269Z [2024-05-11 02:35:03,298: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:35:03.299302712Z [2024-05-11 02:35:03,299: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:35:03.299447718Z [2024-05-11 02:35:03,299: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:03.387043311Z [2024-05-11 02:35:03,386: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:03.424018789Z [2024-05-11 02:35:03,423: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:03.991782727Z [2024-05-11 02:35:03,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b3562a0-4a21-45cb-9340-13691f7484c3] received 2024-05-11T02:35:03.999985179Z [2024-05-11 02:35:03,999: INFO/ForkPoolWorker-1] [2b3562a0-4a21-45cb-9340-13691f7484c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:04.141171714Z [2024-05-11 02:35:04,140: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96bc7d1d-4e42-4f34-a09e-4cbbaf682dcb] succeeded in 2.885555695000221s: None 2024-05-11T02:35:04.307985545Z [2024-05-11 02:35:04,303: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:35:05.081709658Z [2024-05-11 02:35:05,081: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d1d5bdb9-a970-4874-88e4-e122a5fad42b] succeeded in 3.811067348000506s: None 2024-05-11T02:35:05.142519140Z [2024-05-11 02:35:05,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c0053f9-5f14-443d-bd47-b376eaf57e74] succeeded in 3.8905909860004613s: None 2024-05-11T02:35:05.643603049Z [2024-05-11 02:35:05,643: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:35:05.648619064Z [2024-05-11 02:35:05,648: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:05.674917705Z [2024-05-11 02:35:05,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:35:05.676412906Z [2024-05-11 02:35:05,676: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:05.676437784Z [2024-05-11 02:35:05,676: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:05.676622592Z [2024-05-11 02:35:05,676: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:05.676679197Z [2024-05-11 02:35:05,676: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:35:05.676955953Z [2024-05-11 02:35:05,676: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:35:05.677927584Z [2024-05-11 02:35:05,677: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:05.786848816Z [2024-05-11 02:35:05,786: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:06.628587328Z [2024-05-11 02:35:06,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b3562a0-4a21-45cb-9340-13691f7484c3] succeeded in 2.634455211000386s: None 2024-05-11T02:35:06.914587669Z [2024-05-11 02:35:06,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38ec3a05-c1dd-4cec-89e4-c6f6eaae96b9] received 2024-05-11T02:35:06.930495599Z [2024-05-11 02:35:06,930: INFO/ForkPoolWorker-15] [38ec3a05-c1dd-4cec-89e4-c6f6eaae96b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:35:07.244269325Z [2024-05-11 02:35:07,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:35:08.350766449Z [2024-05-11 02:35:08,350: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:35:08.354024193Z [2024-05-11 02:35:08,353: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:08.379411733Z [2024-05-11 02:35:08,379: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:35:08.381373590Z [2024-05-11 02:35:08,380: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:08.381449414Z [2024-05-11 02:35:08,381: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:08.381663558Z [2024-05-11 02:35:08,381: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:08.381687121Z [2024-05-11 02:35:08,381: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:35:08.382270349Z [2024-05-11 02:35:08,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:35:08.382360335Z [2024-05-11 02:35:08,382: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:08.507610632Z [2024-05-11 02:35:08,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:09.147395650Z [2024-05-11 02:35:09,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38ec3a05-c1dd-4cec-89e4-c6f6eaae96b9] succeeded in 2.231001644000571s: None 2024-05-11T02:35:09.237899999Z [2024-05-11 02:35:09,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba9a72ea-7eb4-4d39-b888-77a231f1561a] received 2024-05-11T02:35:09.257766139Z [2024-05-11 02:35:09,257: INFO/ForkPoolWorker-15] [ba9a72ea-7eb4-4d39-b888-77a231f1561a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:35:09.525716937Z [2024-05-11 02:35:09,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:35:10.650271284Z [2024-05-11 02:35:10,649: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:35:10.653458873Z [2024-05-11 02:35:10,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:35:10.675734565Z [2024-05-11 02:35:10,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:35:10.677185592Z [2024-05-11 02:35:10,676: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:35:10.677206753Z [2024-05-11 02:35:10,677: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:35:10.677373763Z [2024-05-11 02:35:10,677: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:35:10.677391031Z [2024-05-11 02:35:10,677: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:35:10.677769564Z [2024-05-11 02:35:10,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:35:10.677911556Z [2024-05-11 02:35:10,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:35:10.778218792Z [2024-05-11 02:35:10,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:11.428991773Z [2024-05-11 02:35:11,428: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba9a72ea-7eb4-4d39-b888-77a231f1561a] succeeded in 2.1796586889995524s: None 2024-05-11T02:35:55.462705187Z [2024-05-11 02:35:55,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dd6722f-c4ea-4e7c-b744-c0aa669cda5f] received 2024-05-11T02:35:55.473552306Z [2024-05-11 02:35:55,473: INFO/ForkPoolWorker-15] [2dd6722f-c4ea-4e7c-b744-c0aa669cda5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240511023555_290744', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-11T02:35:55.744476826Z [2024-05-11 02:35:55,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-11T02:35:55.996862760Z [2024-05-11 02:35:55,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:35:56.479265024Z [2024-05-11 02:35:56,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dd6722f-c4ea-4e7c-b744-c0aa669cda5f] succeeded in 1.0121114640005544s: None 2024-05-11T02:36:00.475827680Z [2024-05-11 02:36:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e64cb94-d66a-4a7d-8ce4-cf0378a287ef] received 2024-05-11T02:36:00.484178462Z [2024-05-11 02:36:00,483: INFO/ForkPoolWorker-15] [1e64cb94-d66a-4a7d-8ce4-cf0378a287ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:36:00.486959948Z [2024-05-11 02:36:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12063f97-4025-44d3-b1e0-a45c2c0266ec] received 2024-05-11T02:36:00.492830886Z [2024-05-11 02:36:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93487163-4dcb-4643-bcf2-a9dd4303c3dc] received 2024-05-11T02:36:00.500816121Z [2024-05-11 02:36:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb7d5a7d-a9d8-465b-9ae1-afceef074026] received 2024-05-11T02:36:00.504752517Z [2024-05-11 02:36:00,504: INFO/ForkPoolWorker-1] [93487163-4dcb-4643-bcf2-a9dd4303c3dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:36:00.518732425Z [2024-05-11 02:36:00,518: INFO/ForkPoolWorker-16] [12063f97-4025-44d3-b1e0-a45c2c0266ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:36:00.526509269Z [2024-05-11 02:36:00,526: INFO/ForkPoolWorker-2] [eb7d5a7d-a9d8-465b-9ae1-afceef074026] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:36:01.037942839Z [2024-05-11 02:36:01,028: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:36:01.073598621Z [2024-05-11 02:36:01,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:36:01.118279433Z [2024-05-11 02:36:01,115: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:36:01.248165689Z [2024-05-11 02:36:01,244: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:36:01.433665813Z [2024-05-11 02:36:01,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:36:01.465187371Z [2024-05-11 02:36:01,464: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:36:01.469248823Z [2024-05-11 02:36:01,468: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:36:01.502821467Z [2024-05-11 02:36:01,502: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:36:01.504179908Z [2024-05-11 02:36:01,503: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:36:01.504327155Z [2024-05-11 02:36:01,504: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:36:01.504446952Z [2024-05-11 02:36:01,504: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:36:01.504696134Z [2024-05-11 02:36:01,504: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:36:01.645730607Z [2024-05-11 02:36:01,645: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:36:02.345055351Z [2024-05-11 02:36:02,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e64cb94-d66a-4a7d-8ce4-cf0378a287ef] succeeded in 1.8676386550014286s: None 2024-05-11T02:36:02.410163212Z [2024-05-11 02:36:02,409: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb7d5a7d-a9d8-465b-9ae1-afceef074026] succeeded in 1.9079989420006314s: None 2024-05-11T02:36:02.752550606Z [2024-05-11 02:36:02,752: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:36:02.755739334Z [2024-05-11 02:36:02,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:36:02.777233936Z [2024-05-11 02:36:02,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:36:02.779665498Z [2024-05-11 02:36:02,779: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:36:02.779694576Z [2024-05-11 02:36:02,779: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:36:02.779864957Z [2024-05-11 02:36:02,779: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:36:02.779920151Z [2024-05-11 02:36:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:36:02.780573637Z [2024-05-11 02:36:02,780: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:36:02.780586621Z [2024-05-11 02:36:02,780: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:36:02.873558204Z [2024-05-11 02:36:02,873: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:36:02.874202901Z [2024-05-11 02:36:02,873: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:36:02.876662025Z [2024-05-11 02:36:02,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:36:02.894632586Z [2024-05-11 02:36:02,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:36:02.898779416Z [2024-05-11 02:36:02,898: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:36:02.898797087Z [2024-05-11 02:36:02,898: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:36:02.898908737Z [2024-05-11 02:36:02,898: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:36:02.898921308Z [2024-05-11 02:36:02,898: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:36:02.899297956Z [2024-05-11 02:36:02,899: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:36:02.899307384Z [2024-05-11 02:36:02,899: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:36:02.978839952Z [2024-05-11 02:36:02,978: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:36:04.540137021Z [2024-05-11 02:36:04,539: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[93487163-4dcb-4643-bcf2-a9dd4303c3dc] succeeded in 4.045012438000413s: None 2024-05-11T02:36:06.357045108Z [2024-05-11 02:36:06,356: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12063f97-4025-44d3-b1e0-a45c2c0266ec] succeeded in 5.868243409999195s: None 2024-05-11T02:37:01.155061364Z [2024-05-11 02:37:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7723585d-d6f0-4f82-8a2d-b5314e12418a] received 2024-05-11T02:37:01.169650446Z [2024-05-11 02:37:01,169: INFO/ForkPoolWorker-15] [7723585d-d6f0-4f82-8a2d-b5314e12418a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:37:01.192124239Z [2024-05-11 02:37:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c554635-e4eb-4aae-b697-53856749d6cc] received 2024-05-11T02:37:01.198423282Z [2024-05-11 02:37:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0c71ae0-fb7c-4efa-8272-8d11077e8bd9] received 2024-05-11T02:37:01.206496897Z [2024-05-11 02:37:01,206: INFO/ForkPoolWorker-1] [c0c71ae0-fb7c-4efa-8272-8d11077e8bd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:37:01.209397546Z [2024-05-11 02:37:01,209: INFO/ForkPoolWorker-16] [5c554635-e4eb-4aae-b697-53856749d6cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:37:01.478833107Z [2024-05-11 02:37:01,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:37:01.480105603Z [2024-05-11 02:37:01,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:37:01.609847868Z [2024-05-11 02:37:01,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:37:01.622525065Z [2024-05-11 02:37:01,622: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:37:01.626283727Z [2024-05-11 02:37:01,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:37:01.655292668Z [2024-05-11 02:37:01,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:37:01.656680092Z [2024-05-11 02:37:01,656: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:37:01.656794543Z [2024-05-11 02:37:01,656: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:37:01.656907622Z [2024-05-11 02:37:01,656: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:37:01.657147712Z [2024-05-11 02:37:01,656: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:37:01.746966803Z [2024-05-11 02:37:01,746: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:37:02.398711186Z [2024-05-11 02:37:02,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c554635-e4eb-4aae-b697-53856749d6cc] succeeded in 1.204606302000684s: None 2024-05-11T02:37:02.664844858Z [2024-05-11 02:37:02,664: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:37:02.668251012Z [2024-05-11 02:37:02,667: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:37:02.695841204Z [2024-05-11 02:37:02,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:37:02.697413418Z [2024-05-11 02:37:02,697: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:37:02.697631833Z [2024-05-11 02:37:02,697: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:37:02.697944752Z [2024-05-11 02:37:02,697: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:37:02.698070512Z [2024-05-11 02:37:02,697: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:37:02.698363529Z [2024-05-11 02:37:02,698: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:37:02.698511493Z [2024-05-11 02:37:02,698: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:37:02.772169930Z [2024-05-11 02:37:02,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:37:02.776235736Z [2024-05-11 02:37:02,775: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:37:02.781273203Z [2024-05-11 02:37:02,780: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:37:02.803949360Z [2024-05-11 02:37:02,803: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:37:02.805317543Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:37:02.805343431Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:37:02.805496636Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:37:02.805596538Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:37:02.805988278Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:37:02.806001007Z [2024-05-11 02:37:02,805: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:37:02.946132550Z [2024-05-11 02:37:02,945: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:37:04.502345639Z [2024-05-11 02:37:04,501: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0c71ae0-fb7c-4efa-8272-8d11077e8bd9] succeeded in 3.3004071900013514s: None 2024-05-11T02:37:04.747927728Z [2024-05-11 02:37:04,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7723585d-d6f0-4f82-8a2d-b5314e12418a] succeeded in 3.587743103000321s: None 2024-05-11T02:38:00.898140046Z [2024-05-11 02:38:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90439c26-9d89-433c-be10-fca029ecb1dc] received 2024-05-11T02:38:00.899799030Z [2024-05-11 02:38:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e15e9415-1bac-4c6a-a6ab-cc8c8f745da5] received 2024-05-11T02:38:00.901507182Z [2024-05-11 02:38:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdea6675-9180-4ff8-b51d-6a7736e18882] received 2024-05-11T02:38:00.911380423Z [2024-05-11 02:38:00,911: INFO/ForkPoolWorker-16] [e15e9415-1bac-4c6a-a6ab-cc8c8f745da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:38:00.913060982Z [2024-05-11 02:38:00,912: INFO/ForkPoolWorker-1] [fdea6675-9180-4ff8-b51d-6a7736e18882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:38:00.917385206Z [2024-05-11 02:38:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f32fe370-e4af-4626-8c0b-56a569af6b75] received 2024-05-11T02:38:00.929158544Z [2024-05-11 02:38:00,928: INFO/ForkPoolWorker-2] [f32fe370-e4af-4626-8c0b-56a569af6b75] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:38:00.933827010Z [2024-05-11 02:38:00,933: INFO/ForkPoolWorker-15] [90439c26-9d89-433c-be10-fca029ecb1dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:38:01.297510601Z [2024-05-11 02:38:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:38:01.314475214Z [2024-05-11 02:38:01,310: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:38:01.411531103Z [2024-05-11 02:38:01,408: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:38:01.457710150Z [2024-05-11 02:38:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:38:01.559649825Z [2024-05-11 02:38:01,559: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:38:01.584406786Z [2024-05-11 02:38:01,583: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:38:01.598090956Z [2024-05-11 02:38:01,597: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:38:01.651003851Z [2024-05-11 02:38:01,650: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:38:01.662840460Z [2024-05-11 02:38:01,662: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:38:01.662870855Z [2024-05-11 02:38:01,662: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:38:01.662893468Z [2024-05-11 02:38:01,662: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:38:01.663127062Z [2024-05-11 02:38:01,663: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:38:01.817429802Z [2024-05-11 02:38:01,817: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:38:02.152941903Z [2024-05-11 02:38:02,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90439c26-9d89-433c-be10-fca029ecb1dc] succeeded in 1.2532296259996656s: None 2024-05-11T02:38:02.371029680Z [2024-05-11 02:38:02,370: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f32fe370-e4af-4626-8c0b-56a569af6b75] succeeded in 1.4487335609992442s: None 2024-05-11T02:38:02.666100652Z [2024-05-11 02:38:02,665: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:38:02.669430459Z [2024-05-11 02:38:02,668: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:38:02.672504180Z [2024-05-11 02:38:02,672: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:38:02.675710676Z [2024-05-11 02:38:02,675: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:38:02.694836265Z [2024-05-11 02:38:02,694: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:38:02.696228792Z [2024-05-11 02:38:02,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:38:02.697535764Z [2024-05-11 02:38:02,697: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:38:02.697678011Z [2024-05-11 02:38:02,697: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:38:02.697808630Z [2024-05-11 02:38:02,697: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:38:02.697962413Z [2024-05-11 02:38:02,697: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:38:02.698223142Z [2024-05-11 02:38:02,698: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:38:02.698315079Z [2024-05-11 02:38:02,698: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:38:02.699411517Z [2024-05-11 02:38:02,699: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:38:02.699588359Z [2024-05-11 02:38:02,699: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:38:02.699791675Z [2024-05-11 02:38:02,699: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:38:02.699958442Z [2024-05-11 02:38:02,699: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:38:02.700275022Z [2024-05-11 02:38:02,700: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:38:02.700495630Z [2024-05-11 02:38:02,700: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:38:02.776995941Z [2024-05-11 02:38:02,776: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:38:02.777040140Z [2024-05-11 02:38:02,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:38:04.246983497Z [2024-05-11 02:38:04,245: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fdea6675-9180-4ff8-b51d-6a7736e18882] succeeded in 3.3435505569996167s: None 2024-05-11T02:38:04.696826847Z [2024-05-11 02:38:04,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e15e9415-1bac-4c6a-a6ab-cc8c8f745da5] succeeded in 3.7945207049997407s: None 2024-05-11T02:39:00.870073452Z [2024-05-11 02:39:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23784163-6efe-4838-a5c5-941f76d634da] received 2024-05-11T02:39:00.876726816Z [2024-05-11 02:39:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[975a4072-6fb6-4122-85b8-5a9a3e5d61a0] received 2024-05-11T02:39:00.878701109Z [2024-05-11 02:39:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abf0ffd3-3433-4dba-a7a9-54637e42c53d] received 2024-05-11T02:39:00.879646319Z [2024-05-11 02:39:00,879: INFO/ForkPoolWorker-15] [23784163-6efe-4838-a5c5-941f76d634da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:39:00.882502990Z [2024-05-11 02:39:00,882: INFO/ForkPoolWorker-16] [975a4072-6fb6-4122-85b8-5a9a3e5d61a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:39:00.893685323Z [2024-05-11 02:39:00,892: INFO/ForkPoolWorker-1] [abf0ffd3-3433-4dba-a7a9-54637e42c53d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:39:01.253729448Z [2024-05-11 02:39:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:39:01.279029915Z [2024-05-11 02:39:01,275: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:39:01.288305050Z [2024-05-11 02:39:01,285: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:39:01.415517328Z [2024-05-11 02:39:01,415: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:39:01.420003059Z [2024-05-11 02:39:01,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:39:01.448544835Z [2024-05-11 02:39:01,448: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:39:01.449958613Z [2024-05-11 02:39:01,449: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:39:01.450232659Z [2024-05-11 02:39:01,450: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:39:01.450401192Z [2024-05-11 02:39:01,450: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:39:01.451640378Z [2024-05-11 02:39:01,451: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:39:01.547322524Z [2024-05-11 02:39:01,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:39:02.219112304Z [2024-05-11 02:39:02,218: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[975a4072-6fb6-4122-85b8-5a9a3e5d61a0] succeeded in 1.342616715000986s: None 2024-05-11T02:39:02.465420351Z [2024-05-11 02:39:02,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:39:02.468655522Z [2024-05-11 02:39:02,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:39:02.492295749Z [2024-05-11 02:39:02,492: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:39:02.493774839Z [2024-05-11 02:39:02,493: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:39:02.493919574Z [2024-05-11 02:39:02,493: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:39:02.494124615Z [2024-05-11 02:39:02,493: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:39:02.494258147Z [2024-05-11 02:39:02,494: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:39:02.494649109Z [2024-05-11 02:39:02,494: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:39:02.494767674Z [2024-05-11 02:39:02,494: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:39:02.518983841Z [2024-05-11 02:39:02,518: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:39:02.523609018Z [2024-05-11 02:39:02,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:39:02.548100186Z [2024-05-11 02:39:02,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:39:02.550083011Z [2024-05-11 02:39:02,549: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:39:02.550237879Z [2024-05-11 02:39:02,550: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:39:02.550435820Z [2024-05-11 02:39:02,550: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:39:02.550573689Z [2024-05-11 02:39:02,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:39:02.550902933Z [2024-05-11 02:39:02,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:39:02.551377755Z [2024-05-11 02:39:02,551: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:39:02.574083373Z [2024-05-11 02:39:02,573: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:39:02.645075868Z [2024-05-11 02:39:02,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:39:05.382172057Z [2024-05-11 02:39:05,381: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abf0ffd3-3433-4dba-a7a9-54637e42c53d] succeeded in 4.500142691998917s: None 2024-05-11T02:39:06.263843361Z [2024-05-11 02:39:06,263: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23784163-6efe-4838-a5c5-941f76d634da] succeeded in 5.391515018000064s: None 2024-05-11T02:40:00.689253873Z [2024-05-11 02:40:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa9b40c1-7585-45aa-9c6c-02d4f6be04da] received 2024-05-11T02:40:00.690914894Z [2024-05-11 02:40:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8087892d-c459-4cae-bc1f-520e39806782] received 2024-05-11T02:40:00.694844712Z [2024-05-11 02:40:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c52481c7-ce01-481c-8759-8a8ea0c597c2] received 2024-05-11T02:40:00.696750700Z [2024-05-11 02:40:00,696: INFO/ForkPoolWorker-16] [8087892d-c459-4cae-bc1f-520e39806782] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:40:00.701688614Z [2024-05-11 02:40:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d20b3f5-01d6-4172-ac50-b88903eec265] received 2024-05-11T02:40:00.708427674Z [2024-05-11 02:40:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[497543dc-e6a6-4e94-bf44-ea895b1e30cd] received 2024-05-11T02:40:00.709855732Z [2024-05-11 02:40:00,709: INFO/ForkPoolWorker-1] [c52481c7-ce01-481c-8759-8a8ea0c597c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:00.717353724Z [2024-05-11 02:40:00,717: INFO/ForkPoolWorker-3] [497543dc-e6a6-4e94-bf44-ea895b1e30cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:40:00.724168049Z [2024-05-11 02:40:00,723: INFO/ForkPoolWorker-15] [fa9b40c1-7585-45aa-9c6c-02d4f6be04da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:40:00.731591822Z [2024-05-11 02:40:00,731: INFO/ForkPoolWorker-2] [9d20b3f5-01d6-4172-ac50-b88903eec265] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:40:01.002578220Z [2024-05-11 02:40:00,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:40:01.197076161Z [2024-05-11 02:40:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:40:01.219494629Z [2024-05-11 02:40:01,215: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:40:01.245156867Z [2024-05-11 02:40:01,241: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:40:01.329642035Z [2024-05-11 02:40:01,329: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:40:01.343730374Z [2024-05-11 02:40:01,343: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:01.346969889Z [2024-05-11 02:40:01,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:40:01.398805769Z [2024-05-11 02:40:01,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:40:01.400303216Z [2024-05-11 02:40:01,400: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:40:01.400509379Z [2024-05-11 02:40:01,400: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:40:01.400639581Z [2024-05-11 02:40:01,400: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:40:01.400928154Z [2024-05-11 02:40:01,400: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:40:01.548717345Z [2024-05-11 02:40:01,548: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:01.589368876Z [2024-05-11 02:40:01,589: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:02.147314038Z [2024-05-11 02:40:02,146: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8087892d-c459-4cae-bc1f-520e39806782] succeeded in 1.4541103539995675s: None 2024-05-11T02:40:02.289427149Z [2024-05-11 02:40:02,289: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[497543dc-e6a6-4e94-bf44-ea895b1e30cd] succeeded in 1.5792395130010846s: None 2024-05-11T02:40:02.701867936Z [2024-05-11 02:40:02,701: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:40:02.705334146Z [2024-05-11 02:40:02,704: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:02.726912407Z [2024-05-11 02:40:02,726: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:40:02.728464746Z [2024-05-11 02:40:02,728: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:02.728593280Z [2024-05-11 02:40:02,728: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:02.728767021Z [2024-05-11 02:40:02,728: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:02.728861122Z [2024-05-11 02:40:02,728: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:40:02.729127034Z [2024-05-11 02:40:02,728: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:40:02.729545804Z [2024-05-11 02:40:02,729: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:02.751660384Z [2024-05-11 02:40:02,751: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:40:02.755284984Z [2024-05-11 02:40:02,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:02.789213287Z [2024-05-11 02:40:02,788: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:40:02.790414116Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:02.790428292Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:02.790641438Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:02.790647526Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:40:02.791955126Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:40:02.791967482Z [2024-05-11 02:40:02,790: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:02.830952184Z [2024-05-11 02:40:02,830: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:40:02.834318856Z [2024-05-11 02:40:02,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:02.835936823Z [2024-05-11 02:40:02,835: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:02.858626612Z [2024-05-11 02:40:02,858: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:40:02.862035324Z [2024-05-11 02:40:02,861: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:02.862155362Z [2024-05-11 02:40:02,861: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:02.862385679Z [2024-05-11 02:40:02,862: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:02.862430778Z [2024-05-11 02:40:02,862: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:40:02.862683713Z [2024-05-11 02:40:02,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:40:02.862799306Z [2024-05-11 02:40:02,862: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:02.929910719Z [2024-05-11 02:40:02,929: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:02.959994930Z [2024-05-11 02:40:02,959: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:03.559834373Z [2024-05-11 02:40:03,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c52481c7-ce01-481c-8759-8a8ea0c597c2] succeeded in 2.856673041000249s: None 2024-05-11T02:40:03.665362220Z [2024-05-11 02:40:03,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15de0cc5-bf42-4169-b682-8a7600e0424f] received 2024-05-11T02:40:03.692530362Z [2024-05-11 02:40:03,692: INFO/ForkPoolWorker-16] [15de0cc5-bf42-4169-b682-8a7600e0424f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:03.961677928Z [2024-05-11 02:40:03,958: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:40:04.403194608Z [2024-05-11 02:40:04,402: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9d20b3f5-01d6-4172-ac50-b88903eec265] succeeded in 3.6927452410000114s: None 2024-05-11T02:40:04.966991551Z [2024-05-11 02:40:04,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa9b40c1-7585-45aa-9c6c-02d4f6be04da] succeeded in 4.273962601000676s: None 2024-05-11T02:40:05.186179541Z [2024-05-11 02:40:05,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:40:05.188684232Z [2024-05-11 02:40:05,186: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:05.211537286Z [2024-05-11 02:40:05,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:40:05.212609291Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:05.212622954Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:05.212728665Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:05.212754013Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:40:05.213026395Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:40:05.213085444Z [2024-05-11 02:40:05,212: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:05.295428154Z [2024-05-11 02:40:05,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:05.982042324Z [2024-05-11 02:40:05,981: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15de0cc5-bf42-4169-b682-8a7600e0424f] succeeded in 2.3140444130003743s: None 2024-05-11T02:40:06.834306197Z [2024-05-11 02:40:06,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d0e6ce3-0af0-4da7-993a-b4f95eb25239] received 2024-05-11T02:40:06.858778953Z [2024-05-11 02:40:06,858: INFO/ForkPoolWorker-15] [7d0e6ce3-0af0-4da7-993a-b4f95eb25239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:40:07.172385072Z [2024-05-11 02:40:07,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:40:08.332568865Z [2024-05-11 02:40:08,332: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:40:08.336229423Z [2024-05-11 02:40:08,335: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:08.358845596Z [2024-05-11 02:40:08,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:40:08.360386890Z [2024-05-11 02:40:08,360: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:08.360598722Z [2024-05-11 02:40:08,360: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:08.360843067Z [2024-05-11 02:40:08,360: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:08.361018273Z [2024-05-11 02:40:08,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:40:08.361374231Z [2024-05-11 02:40:08,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:40:08.361575181Z [2024-05-11 02:40:08,361: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:08.446410464Z [2024-05-11 02:40:08,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:09.068663911Z [2024-05-11 02:40:09,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d0e6ce3-0af0-4da7-993a-b4f95eb25239] succeeded in 2.22720466499959s: None 2024-05-11T02:40:09.194113530Z [2024-05-11 02:40:09,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[334eca45-fb97-4e95-a422-3cbac69e74d1] received 2024-05-11T02:40:09.200100082Z [2024-05-11 02:40:09,199: INFO/ForkPoolWorker-15] [334eca45-fb97-4e95-a422-3cbac69e74d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:40:09.483867437Z [2024-05-11 02:40:09,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:40:10.547000105Z [2024-05-11 02:40:10,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:40:10.549971268Z [2024-05-11 02:40:10,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:40:10.570394197Z [2024-05-11 02:40:10,570: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:40:10.571887601Z [2024-05-11 02:40:10,571: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:40:10.571952840Z [2024-05-11 02:40:10,571: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:40:10.571978021Z [2024-05-11 02:40:10,571: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:40:10.572004416Z [2024-05-11 02:40:10,571: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:40:10.572227059Z [2024-05-11 02:40:10,572: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:40:10.572277257Z [2024-05-11 02:40:10,572: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:40:10.659125348Z [2024-05-11 02:40:10,658: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:40:11.363883554Z [2024-05-11 02:40:11,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[334eca45-fb97-4e95-a422-3cbac69e74d1] succeeded in 2.1679282679997414s: None 2024-05-11T02:41:00.652616297Z [2024-05-11 02:41:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e74d7bcd-c4be-4307-9f9f-02c1285379db] received 2024-05-11T02:41:00.655563645Z [2024-05-11 02:41:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b51210d8-0dc8-4279-8018-ad36aebe1c9e] received 2024-05-11T02:41:00.657239876Z [2024-05-11 02:41:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72ad4b09-49fe-42f3-bc0c-d3a20c93a118] received 2024-05-11T02:41:00.666137079Z [2024-05-11 02:41:00,665: INFO/ForkPoolWorker-15] [e74d7bcd-c4be-4307-9f9f-02c1285379db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:41:00.666698209Z [2024-05-11 02:41:00,666: INFO/ForkPoolWorker-1] [72ad4b09-49fe-42f3-bc0c-d3a20c93a118] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:41:00.666795839Z [2024-05-11 02:41:00,666: INFO/ForkPoolWorker-16] [b51210d8-0dc8-4279-8018-ad36aebe1c9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:41:00.965812984Z [2024-05-11 02:41:00,962: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:41:00.969325224Z [2024-05-11 02:41:00,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:41:01.054215409Z [2024-05-11 02:41:01,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:41:01.219079616Z [2024-05-11 02:41:01,218: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-11T02:41:01.223568552Z [2024-05-11 02:41:01,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:41:01.250643960Z [2024-05-11 02:41:01,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:41:01.251962317Z [2024-05-11 02:41:01,251: INFO/ForkPoolWorker-15] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:41:01.252233793Z [2024-05-11 02:41:01,251: INFO/ForkPoolWorker-15] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:41:01.252426956Z [2024-05-11 02:41:01,252: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-11T02:41:01.252729481Z [2024-05-11 02:41:01,252: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:41:01.365788222Z [2024-05-11 02:41:01,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:41:02.001670752Z [2024-05-11 02:41:02,001: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e74d7bcd-c4be-4307-9f9f-02c1285379db] succeeded in 1.3474860040005296s: None 2024-05-11T02:41:02.265275981Z [2024-05-11 02:41:02,264: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:41:02.269297117Z [2024-05-11 02:41:02,268: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:41:02.291883507Z [2024-05-11 02:41:02,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:41:02.293305261Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:41:02.293321773Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:41:02.293474693Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:41:02.293504274Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:41:02.293763851Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:41:02.293891019Z [2024-05-11 02:41:02,293: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:41:02.396690026Z [2024-05-11 02:41:02,396: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:41:02.520904736Z [2024-05-11 02:41:02,520: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:41:02.524096602Z [2024-05-11 02:41:02,523: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:41:02.541090581Z [2024-05-11 02:41:02,540: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:41:02.542346727Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:41:02.542358966Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:41:02.542490103Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:41:02.542501215Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:41:02.542748086Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:41:02.542780828Z [2024-05-11 02:41:02,542: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:41:02.637376065Z [2024-05-11 02:41:02,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:41:04.486955159Z [2024-05-11 02:41:04,486: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72ad4b09-49fe-42f3-bc0c-d3a20c93a118] succeeded in 3.8278100460011046s: None 2024-05-11T02:41:05.304613531Z [2024-05-11 02:41:05,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b51210d8-0dc8-4279-8018-ad36aebe1c9e] succeeded in 4.646538811999562s: None 2024-05-11T02:42:01.255411320Z [2024-05-11 02:42:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9f1f6bd-edf4-439f-b224-92fbb77027d2] received 2024-05-11T02:42:01.258768363Z [2024-05-11 02:42:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d72eef1f-ba70-49ec-a11f-70c4101645e9] received 2024-05-11T02:42:01.260009661Z [2024-05-11 02:42:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a779d310-c9f0-433e-b2ce-881a38d9b1c8] received 2024-05-11T02:42:01.269445074Z [2024-05-11 02:42:01,268: INFO/ForkPoolWorker-1] [a779d310-c9f0-433e-b2ce-881a38d9b1c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:42:01.281945624Z [2024-05-11 02:42:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed4ba6b2-a551-44cb-bb36-914b24cabc56] received 2024-05-11T02:42:01.282424527Z [2024-05-11 02:42:01,282: INFO/ForkPoolWorker-15] [e9f1f6bd-edf4-439f-b224-92fbb77027d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:42:01.290177545Z [2024-05-11 02:42:01,289: INFO/ForkPoolWorker-16] [d72eef1f-ba70-49ec-a11f-70c4101645e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:42:01.291828817Z [2024-05-11 02:42:01,291: INFO/ForkPoolWorker-2] [ed4ba6b2-a551-44cb-bb36-914b24cabc56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:42:01.754619767Z [2024-05-11 02:42:01,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:42:01.779897801Z [2024-05-11 02:42:01,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:42:01.892524978Z [2024-05-11 02:42:01,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:42:01.898951393Z [2024-05-11 02:42:01,895: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:42:02.061003073Z [2024-05-11 02:42:02,060: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:42:02.065834465Z [2024-05-11 02:42:02,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:42:02.091098255Z [2024-05-11 02:42:02,090: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:42:02.107823165Z [2024-05-11 02:42:02,107: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:42:02.114670733Z [2024-05-11 02:42:02,114: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:42:02.114826225Z [2024-05-11 02:42:02,114: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:42:02.114913037Z [2024-05-11 02:42:02,114: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:42:02.115163259Z [2024-05-11 02:42:02,115: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:42:02.259976936Z [2024-05-11 02:42:02,259: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:42:02.768079412Z [2024-05-11 02:42:02,767: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a779d310-c9f0-433e-b2ce-881a38d9b1c8] succeeded in 1.5067565839999588s: None 2024-05-11T02:42:02.882452470Z [2024-05-11 02:42:02,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d72eef1f-ba70-49ec-a11f-70c4101645e9] succeeded in 1.6208142320010666s: None 2024-05-11T02:42:03.118963338Z [2024-05-11 02:42:03,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:42:03.122465766Z [2024-05-11 02:42:03,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:42:03.145497218Z [2024-05-11 02:42:03,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:42:03.146879853Z [2024-05-11 02:42:03,146: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:42:03.147062770Z [2024-05-11 02:42:03,146: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:42:03.147263236Z [2024-05-11 02:42:03,147: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:42:03.147433096Z [2024-05-11 02:42:03,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:42:03.147940382Z [2024-05-11 02:42:03,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:42:03.148175278Z [2024-05-11 02:42:03,147: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:42:03.227077101Z [2024-05-11 02:42:03,226: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:42:03.483296301Z [2024-05-11 02:42:03,482: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:42:03.487248526Z [2024-05-11 02:42:03,486: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:42:03.538287323Z [2024-05-11 02:42:03,538: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:42:03.540666159Z [2024-05-11 02:42:03,540: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:42:03.540705263Z [2024-05-11 02:42:03,540: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:42:03.540934235Z [2024-05-11 02:42:03,540: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:42:03.541005762Z [2024-05-11 02:42:03,540: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:42:03.541414896Z [2024-05-11 02:42:03,541: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:42:03.541480243Z [2024-05-11 02:42:03,541: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:42:03.614325171Z [2024-05-11 02:42:03,614: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:42:05.614887256Z [2024-05-11 02:42:05,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9f1f6bd-edf4-439f-b224-92fbb77027d2] succeeded in 4.355636702999618s: None 2024-05-11T02:42:06.118895665Z [2024-05-11 02:42:06,118: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed4ba6b2-a551-44cb-bb36-914b24cabc56] succeeded in 4.835509436999928s: None 2024-05-11T02:43:01.083685024Z [2024-05-11 02:43:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e99e667-7500-45b7-bf00-6c67bca09130] received 2024-05-11T02:43:01.093965663Z [2024-05-11 02:43:01,090: INFO/ForkPoolWorker-15] [5e99e667-7500-45b7-bf00-6c67bca09130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:43:01.094002248Z [2024-05-11 02:43:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed3bc492-0cdd-46e0-a2fc-df11a6d7f9a5] received 2024-05-11T02:43:01.094006141Z [2024-05-11 02:43:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb14b4f8-31fd-4ef8-8198-96d02f18008b] received 2024-05-11T02:43:01.107912300Z [2024-05-11 02:43:01,107: INFO/ForkPoolWorker-16] [ed3bc492-0cdd-46e0-a2fc-df11a6d7f9a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:43:01.135016833Z [2024-05-11 02:43:01,134: INFO/ForkPoolWorker-1] [cb14b4f8-31fd-4ef8-8198-96d02f18008b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:43:01.460624635Z [2024-05-11 02:43:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:43:01.483988327Z [2024-05-11 02:43:01,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:43:01.493167242Z [2024-05-11 02:43:01,490: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:43:01.629510292Z [2024-05-11 02:43:01,629: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:43:01.633356118Z [2024-05-11 02:43:01,632: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:43:01.655516435Z [2024-05-11 02:43:01,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:43:01.661825432Z [2024-05-11 02:43:01,661: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:43:01.662192116Z [2024-05-11 02:43:01,661: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:43:01.662412628Z [2024-05-11 02:43:01,662: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:43:01.662745676Z [2024-05-11 02:43:01,662: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:43:01.750996454Z [2024-05-11 02:43:01,750: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:43:02.343666417Z [2024-05-11 02:43:02,343: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed3bc492-0cdd-46e0-a2fc-df11a6d7f9a5] succeeded in 1.2497196870008338s: None 2024-05-11T02:43:02.677778801Z [2024-05-11 02:43:02,677: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:43:02.681185541Z [2024-05-11 02:43:02,680: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:43:02.705498010Z [2024-05-11 02:43:02,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:43:02.707187459Z [2024-05-11 02:43:02,706: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:43:02.707357652Z [2024-05-11 02:43:02,707: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:43:02.707612047Z [2024-05-11 02:43:02,707: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:43:02.707798335Z [2024-05-11 02:43:02,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:43:02.708310858Z [2024-05-11 02:43:02,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:43:02.708480079Z [2024-05-11 02:43:02,708: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:43:02.721154192Z [2024-05-11 02:43:02,720: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:43:02.724395115Z [2024-05-11 02:43:02,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:43:02.745644816Z [2024-05-11 02:43:02,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:43:02.746867482Z [2024-05-11 02:43:02,746: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:43:02.746884777Z [2024-05-11 02:43:02,746: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:43:02.746992284Z [2024-05-11 02:43:02,746: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:43:02.747007130Z [2024-05-11 02:43:02,746: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:43:02.747313903Z [2024-05-11 02:43:02,747: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:43:02.747330311Z [2024-05-11 02:43:02,747: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:43:02.811763584Z [2024-05-11 02:43:02,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:43:02.820316338Z [2024-05-11 02:43:02,820: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:43:04.269382818Z [2024-05-11 02:43:04,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e99e667-7500-45b7-bf00-6c67bca09130] succeeded in 3.186061347998475s: None 2024-05-11T02:43:06.011999455Z [2024-05-11 02:43:06,011: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb14b4f8-31fd-4ef8-8198-96d02f18008b] succeeded in 4.908007996000379s: None 2024-05-11T02:44:01.120797425Z [2024-05-11 02:44:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2df8bd5b-911d-4b72-9a69-9d9c2a2917e4] received 2024-05-11T02:44:01.126965719Z [2024-05-11 02:44:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac39e1f1-0ebb-408f-b07b-080ef03954a7] received 2024-05-11T02:44:01.129162831Z [2024-05-11 02:44:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50598136-5d8d-44a6-b4d5-9ad19a685313] received 2024-05-11T02:44:01.130812921Z [2024-05-11 02:44:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[544f418b-c7b7-48c8-9073-5661902e8c79] received 2024-05-11T02:44:01.136494731Z [2024-05-11 02:44:01,136: INFO/ForkPoolWorker-1] [50598136-5d8d-44a6-b4d5-9ad19a685313] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:44:01.138222042Z [2024-05-11 02:44:01,137: INFO/ForkPoolWorker-2] [544f418b-c7b7-48c8-9073-5661902e8c79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:44:01.170414438Z [2024-05-11 02:44:01,170: INFO/ForkPoolWorker-15] [2df8bd5b-911d-4b72-9a69-9d9c2a2917e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:44:01.174127915Z [2024-05-11 02:44:01,173: INFO/ForkPoolWorker-16] [ac39e1f1-0ebb-408f-b07b-080ef03954a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:44:01.516152735Z [2024-05-11 02:44:01,512: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:44:01.535114917Z [2024-05-11 02:44:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:44:01.540343858Z [2024-05-11 02:44:01,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:44:01.590078159Z [2024-05-11 02:44:01,586: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:44:01.665918314Z [2024-05-11 02:44:01,665: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:44:01.669841897Z [2024-05-11 02:44:01,669: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:44:01.700560062Z [2024-05-11 02:44:01,700: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:44:01.702324040Z [2024-05-11 02:44:01,702: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:44:01.702463406Z [2024-05-11 02:44:01,702: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:44:01.702556182Z [2024-05-11 02:44:01,702: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:44:01.702778563Z [2024-05-11 02:44:01,702: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:44:01.803320240Z [2024-05-11 02:44:01,802: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:44:01.836449322Z [2024-05-11 02:44:01,836: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:44:02.399897408Z [2024-05-11 02:44:02,399: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50598136-5d8d-44a6-b4d5-9ad19a685313] succeeded in 1.2692698779992497s: None 2024-05-11T02:44:02.433436396Z [2024-05-11 02:44:02,433: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac39e1f1-0ebb-408f-b07b-080ef03954a7] succeeded in 1.281273976999728s: None 2024-05-11T02:44:02.822478960Z [2024-05-11 02:44:02,822: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:44:02.826088179Z [2024-05-11 02:44:02,825: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:44:02.848281576Z [2024-05-11 02:44:02,848: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:44:02.849808192Z [2024-05-11 02:44:02,849: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:44:02.849854038Z [2024-05-11 02:44:02,849: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:44:02.850151092Z [2024-05-11 02:44:02,849: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:44:02.850435552Z [2024-05-11 02:44:02,850: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:44:02.851311314Z [2024-05-11 02:44:02,851: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:44:02.851423968Z [2024-05-11 02:44:02,851: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:44:02.941904825Z [2024-05-11 02:44:02,941: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:44:02.962119324Z [2024-05-11 02:44:02,961: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:44:02.965148640Z [2024-05-11 02:44:02,964: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:44:02.987643411Z [2024-05-11 02:44:02,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:44:02.990332471Z [2024-05-11 02:44:02,989: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:44:02.990777623Z [2024-05-11 02:44:02,990: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:44:02.991186993Z [2024-05-11 02:44:02,990: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:44:02.991418742Z [2024-05-11 02:44:02,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:44:02.992044404Z [2024-05-11 02:44:02,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:44:02.992318565Z [2024-05-11 02:44:02,992: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:44:03.093801433Z [2024-05-11 02:44:03,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:44:05.548913406Z [2024-05-11 02:44:05,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2df8bd5b-911d-4b72-9a69-9d9c2a2917e4] succeeded in 4.425817084998926s: None 2024-05-11T02:44:05.603115533Z [2024-05-11 02:44:05,602: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[544f418b-c7b7-48c8-9073-5661902e8c79] succeeded in 4.470682690000103s: None 2024-05-11T02:45:01.058196490Z [2024-05-11 02:45:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79e25702-50e8-460c-a5ad-039adc84233e] received 2024-05-11T02:45:01.059282509Z [2024-05-11 02:45:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3346b8c-61e3-4a3c-a11a-a2b75af70e7e] received 2024-05-11T02:45:01.074232229Z [2024-05-11 02:45:01,071: INFO/ForkPoolWorker-16] [b3346b8c-61e3-4a3c-a11a-a2b75af70e7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:45:01.076152886Z [2024-05-11 02:45:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49b0b232-38ea-4b2b-91a5-468f0ec66e4a] received 2024-05-11T02:45:01.078998416Z [2024-05-11 02:45:01,066: INFO/ForkPoolWorker-15] [79e25702-50e8-460c-a5ad-039adc84233e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:01.079015201Z [2024-05-11 02:45:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8def8b94-aa71-4844-9752-9dc2dc710e6f] received 2024-05-11T02:45:01.083710058Z [2024-05-11 02:45:01,083: INFO/ForkPoolWorker-1] [49b0b232-38ea-4b2b-91a5-468f0ec66e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:45:01.137287000Z [2024-05-11 02:45:01,137: INFO/ForkPoolWorker-2] [8def8b94-aa71-4844-9752-9dc2dc710e6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:45:01.474575930Z [2024-05-11 02:45:01,471: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:45:01.477348008Z [2024-05-11 02:45:01,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:45:01.534936444Z [2024-05-11 02:45:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:45:01.628628492Z [2024-05-11 02:45:01,625: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:45:01.700114263Z [2024-05-11 02:45:01,699: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:45:01.704136447Z [2024-05-11 02:45:01,703: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:01.724370481Z [2024-05-11 02:45:01,724: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:45:01.725389720Z [2024-05-11 02:45:01,725: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:45:01.725545832Z [2024-05-11 02:45:01,725: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:45:01.725691895Z [2024-05-11 02:45:01,725: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:45:01.726002092Z [2024-05-11 02:45:01,725: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:45:01.840814830Z [2024-05-11 02:45:01,840: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:02.354543470Z [2024-05-11 02:45:02,354: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8def8b94-aa71-4844-9752-9dc2dc710e6f] succeeded in 1.2316862320003565s: None 2024-05-11T02:45:02.662570833Z [2024-05-11 02:45:02,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:45:02.665835254Z [2024-05-11 02:45:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:02.685282037Z [2024-05-11 02:45:02,684: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:45:02.688753438Z [2024-05-11 02:45:02,688: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:02.695839024Z [2024-05-11 02:45:02,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:45:02.697951717Z [2024-05-11 02:45:02,697: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:02.697972245Z [2024-05-11 02:45:02,697: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:02.698041538Z [2024-05-11 02:45:02,697: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:02.698119404Z [2024-05-11 02:45:02,698: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:45:02.698319193Z [2024-05-11 02:45:02,698: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:45:02.698416434Z [2024-05-11 02:45:02,698: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:02.708457201Z [2024-05-11 02:45:02,708: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:45:02.709564914Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:02.709642328Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:02.709677527Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:02.709758517Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:45:02.709971794Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:45:02.710000180Z [2024-05-11 02:45:02,709: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:02.785955125Z [2024-05-11 02:45:02,785: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:02.788375920Z [2024-05-11 02:45:02,788: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:02.913206513Z [2024-05-11 02:45:02,912: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:45:02.916600637Z [2024-05-11 02:45:02,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:02.942332343Z [2024-05-11 02:45:02,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:45:02.943778687Z [2024-05-11 02:45:02,943: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:02.944004838Z [2024-05-11 02:45:02,943: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:02.944262502Z [2024-05-11 02:45:02,944: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:02.944445132Z [2024-05-11 02:45:02,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:45:02.944804395Z [2024-05-11 02:45:02,944: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:45:02.944995501Z [2024-05-11 02:45:02,944: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:03.072492619Z [2024-05-11 02:45:03,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:03.298089643Z [2024-05-11 02:45:03,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79e25702-50e8-460c-a5ad-039adc84233e] succeeded in 2.237674877000245s: None 2024-05-11T02:45:03.838379945Z [2024-05-11 02:45:03,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdb46d87-f6d6-46c8-9f41-bd255ca35dfd] received 2024-05-11T02:45:03.848002628Z [2024-05-11 02:45:03,847: INFO/ForkPoolWorker-15] [fdb46d87-f6d6-46c8-9f41-bd255ca35dfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:04.140809400Z [2024-05-11 02:45:04,137: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:45:04.323004900Z [2024-05-11 02:45:04,322: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49b0b232-38ea-4b2b-91a5-468f0ec66e4a] succeeded in 3.2458210650002s: None 2024-05-11T02:45:05.066717609Z [2024-05-11 02:45:05,066: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3346b8c-61e3-4a3c-a11a-a2b75af70e7e] succeeded in 4.003731087001142s: None 2024-05-11T02:45:05.294579458Z [2024-05-11 02:45:05,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:45:05.297783174Z [2024-05-11 02:45:05,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:05.314567455Z [2024-05-11 02:45:05,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:45:05.315670111Z [2024-05-11 02:45:05,315: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:05.315738317Z [2024-05-11 02:45:05,315: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:05.315883303Z [2024-05-11 02:45:05,315: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:05.315934001Z [2024-05-11 02:45:05,315: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:45:05.316132230Z [2024-05-11 02:45:05,316: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:45:05.316180474Z [2024-05-11 02:45:05,316: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:05.399087920Z [2024-05-11 02:45:05,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:05.925280017Z [2024-05-11 02:45:05,924: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdb46d87-f6d6-46c8-9f41-bd255ca35dfd] succeeded in 2.08382614599941s: None 2024-05-11T02:45:06.059003325Z [2024-05-11 02:45:06,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[755297df-b316-4c3b-a242-46ca9b43f16b] received 2024-05-11T02:45:06.068327846Z [2024-05-11 02:45:06,068: INFO/ForkPoolWorker-15] [755297df-b316-4c3b-a242-46ca9b43f16b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:45:06.326811903Z [2024-05-11 02:45:06,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:45:07.554726019Z [2024-05-11 02:45:07,554: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:45:07.558205933Z [2024-05-11 02:45:07,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:07.580512504Z [2024-05-11 02:45:07,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:45:07.582181785Z [2024-05-11 02:45:07,581: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:07.582379702Z [2024-05-11 02:45:07,582: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:07.582645578Z [2024-05-11 02:45:07,582: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:07.582828833Z [2024-05-11 02:45:07,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:45:07.583359322Z [2024-05-11 02:45:07,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:45:07.583572941Z [2024-05-11 02:45:07,583: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:07.690317984Z [2024-05-11 02:45:07,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:08.169850952Z [2024-05-11 02:45:08,169: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[755297df-b316-4c3b-a242-46ca9b43f16b] succeeded in 2.108733241999289s: None 2024-05-11T02:45:08.763928800Z [2024-05-11 02:45:08,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d31ca596-a1e4-4102-a710-03e78a49cfdf] received 2024-05-11T02:45:08.775023343Z [2024-05-11 02:45:08,774: INFO/ForkPoolWorker-15] [d31ca596-a1e4-4102-a710-03e78a49cfdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:45:09.056772032Z [2024-05-11 02:45:09,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:45:10.293024347Z [2024-05-11 02:45:10,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:45:10.295910763Z [2024-05-11 02:45:10,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:45:10.347434621Z [2024-05-11 02:45:10,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:45:10.349032632Z [2024-05-11 02:45:10,348: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:45:10.349172404Z [2024-05-11 02:45:10,348: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:45:10.349437136Z [2024-05-11 02:45:10,349: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:45:10.349610108Z [2024-05-11 02:45:10,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:45:10.350042420Z [2024-05-11 02:45:10,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:45:10.350666216Z [2024-05-11 02:45:10,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:45:10.433206716Z [2024-05-11 02:45:10,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:45:11.036093748Z [2024-05-11 02:45:11,035: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d31ca596-a1e4-4102-a710-03e78a49cfdf] succeeded in 2.2682948149995354s: None 2024-05-11T02:46:00.256459308Z [2024-05-11 02:46:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59a45fee-d529-4715-8cc4-21e58dfd9b24] received 2024-05-11T02:46:00.258891194Z [2024-05-11 02:46:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daa80570-5604-490c-a173-c867bee29080] received 2024-05-11T02:46:00.267419786Z [2024-05-11 02:46:00,267: INFO/ForkPoolWorker-16] [daa80570-5604-490c-a173-c867bee29080] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:46:00.268807653Z [2024-05-11 02:46:00,268: INFO/ForkPoolWorker-15] [59a45fee-d529-4715-8cc4-21e58dfd9b24] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:46:00.275904347Z [2024-05-11 02:46:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6549ff5b-de3e-4788-b800-f737c114efb4] received 2024-05-11T02:46:00.286211263Z [2024-05-11 02:46:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7617ccbb-f7d5-40de-9b3a-864efa2a9f4d] received 2024-05-11T02:46:00.290950151Z [2024-05-11 02:46:00,290: INFO/ForkPoolWorker-1] [6549ff5b-de3e-4788-b800-f737c114efb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:46:00.310618614Z [2024-05-11 02:46:00,310: INFO/ForkPoolWorker-2] [7617ccbb-f7d5-40de-9b3a-864efa2a9f4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:46:00.592391910Z [2024-05-11 02:46:00,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:46:00.620585290Z [2024-05-11 02:46:00,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:46:00.873114094Z [2024-05-11 02:46:00,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:46:00.889421996Z [2024-05-11 02:46:00,885: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:46:00.926702155Z [2024-05-11 02:46:00,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:46:01.088439698Z [2024-05-11 02:46:01,086: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:46:01.155240059Z [2024-05-11 02:46:01,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:46:01.225667168Z [2024-05-11 02:46:01,225: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:46:01.229908186Z [2024-05-11 02:46:01,229: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:46:01.230339185Z [2024-05-11 02:46:01,229: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:46:01.230533171Z [2024-05-11 02:46:01,230: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:46:01.230999529Z [2024-05-11 02:46:01,230: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:46:01.346669783Z [2024-05-11 02:46:01,346: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:46:01.595469068Z [2024-05-11 02:46:01,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59a45fee-d529-4715-8cc4-21e58dfd9b24] succeeded in 1.3351322830003483s: None 2024-05-11T02:46:01.969033720Z [2024-05-11 02:46:01,968: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7617ccbb-f7d5-40de-9b3a-864efa2a9f4d] succeeded in 1.6801043920004304s: None 2024-05-11T02:46:02.058898465Z [2024-05-11 02:46:02,058: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:46:02.062269556Z [2024-05-11 02:46:02,061: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:46:02.085711147Z [2024-05-11 02:46:02,085: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:46:02.086890404Z [2024-05-11 02:46:02,086: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:46:02.086904109Z [2024-05-11 02:46:02,086: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:46:02.087124441Z [2024-05-11 02:46:02,086: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:46:02.087151185Z [2024-05-11 02:46:02,087: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:46:02.087547725Z [2024-05-11 02:46:02,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:46:02.087567175Z [2024-05-11 02:46:02,087: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:46:02.179483671Z [2024-05-11 02:46:02,179: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:46:02.197305158Z [2024-05-11 02:46:02,196: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:46:02.200562533Z [2024-05-11 02:46:02,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:46:02.215758209Z [2024-05-11 02:46:02,215: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:46:02.216973671Z [2024-05-11 02:46:02,216: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:46:02.217045666Z [2024-05-11 02:46:02,216: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:46:02.217225644Z [2024-05-11 02:46:02,217: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:46:02.217344271Z [2024-05-11 02:46:02,217: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:46:02.217640072Z [2024-05-11 02:46:02,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:46:02.217742788Z [2024-05-11 02:46:02,217: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:46:02.289848332Z [2024-05-11 02:46:02,289: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:46:03.639336274Z [2024-05-11 02:46:03,638: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6549ff5b-de3e-4788-b800-f737c114efb4] succeeded in 3.360184612998637s: None 2024-05-11T02:46:05.153901561Z [2024-05-11 02:46:05,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[daa80570-5604-490c-a173-c867bee29080] succeeded in 4.891796745998363s: None 2024-05-11T02:47:00.622814930Z [2024-05-11 02:47:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ff56d38-c81c-4a17-8403-5e6f5b4a807b] received 2024-05-11T02:47:00.625984958Z [2024-05-11 02:47:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c6d0378-e0ea-4155-87e5-c89a82dedeb3] received 2024-05-11T02:47:00.631351123Z [2024-05-11 02:47:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6d419b-7226-45f4-8273-2d5719a35f4a] received 2024-05-11T02:47:00.632785464Z [2024-05-11 02:47:00,632: INFO/ForkPoolWorker-16] [9c6d0378-e0ea-4155-87e5-c89a82dedeb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:47:00.633576522Z [2024-05-11 02:47:00,633: INFO/ForkPoolWorker-15] [4ff56d38-c81c-4a17-8403-5e6f5b4a807b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:47:00.640680736Z [2024-05-11 02:47:00,640: INFO/ForkPoolWorker-1] [ce6d419b-7226-45f4-8273-2d5719a35f4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:47:00.911350219Z [2024-05-11 02:47:00,908: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:47:00.937098345Z [2024-05-11 02:47:00,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:47:00.961625803Z [2024-05-11 02:47:00,958: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:47:01.165354288Z [2024-05-11 02:47:01,164: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:47:01.169980746Z [2024-05-11 02:47:01,169: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:47:01.201925469Z [2024-05-11 02:47:01,201: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:47:01.202968712Z [2024-05-11 02:47:01,202: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:47:01.203190519Z [2024-05-11 02:47:01,202: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:47:01.203343164Z [2024-05-11 02:47:01,203: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:47:01.203691220Z [2024-05-11 02:47:01,203: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:47:01.306037041Z [2024-05-11 02:47:01,305: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:47:01.826844336Z [2024-05-11 02:47:01,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce6d419b-7226-45f4-8273-2d5719a35f4a] succeeded in 1.1930389560002368s: None 2024-05-11T02:47:02.108024774Z [2024-05-11 02:47:02,107: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:47:02.111249067Z [2024-05-11 02:47:02,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:47:02.135398239Z [2024-05-11 02:47:02,135: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:47:02.136669266Z [2024-05-11 02:47:02,136: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:47:02.136687314Z [2024-05-11 02:47:02,136: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:47:02.136809946Z [2024-05-11 02:47:02,136: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:47:02.136859992Z [2024-05-11 02:47:02,136: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:47:02.137137637Z [2024-05-11 02:47:02,136: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:47:02.137261543Z [2024-05-11 02:47:02,137: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:47:02.200924121Z [2024-05-11 02:47:02,200: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:47:02.204293184Z [2024-05-11 02:47:02,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:47:02.211079115Z [2024-05-11 02:47:02,210: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:47:02.223346272Z [2024-05-11 02:47:02,223: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:47:02.224650948Z [2024-05-11 02:47:02,224: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:47:02.224764303Z [2024-05-11 02:47:02,224: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:47:02.224875308Z [2024-05-11 02:47:02,224: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:47:02.224937454Z [2024-05-11 02:47:02,224: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:47:02.225195199Z [2024-05-11 02:47:02,225: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:47:02.225275937Z [2024-05-11 02:47:02,225: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:47:02.312060501Z [2024-05-11 02:47:02,311: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:47:03.847995675Z [2024-05-11 02:47:03,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c6d0378-e0ea-4155-87e5-c89a82dedeb3] succeeded in 3.220191648999389s: None 2024-05-11T02:47:04.215134044Z [2024-05-11 02:47:04,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ff56d38-c81c-4a17-8403-5e6f5b4a807b] succeeded in 3.5900953029995435s: None 2024-05-11T02:48:01.093786761Z [2024-05-11 02:48:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d0ac40e-79a8-41c0-abae-0d6b3652143c] received 2024-05-11T02:48:01.098445933Z [2024-05-11 02:48:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29bcd69e-18e3-41fb-b408-4ebb31f559c3] received 2024-05-11T02:48:01.106633804Z [2024-05-11 02:48:01,106: INFO/ForkPoolWorker-15] [8d0ac40e-79a8-41c0-abae-0d6b3652143c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:48:01.122552973Z [2024-05-11 02:48:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4858d34e-64cf-469a-b759-fd41368d6448] received 2024-05-11T02:48:01.126253840Z [2024-05-11 02:48:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6440d4d9-ff0d-48a0-948c-f16c05b8e3f4] received 2024-05-11T02:48:01.130823550Z [2024-05-11 02:48:01,130: INFO/ForkPoolWorker-16] [29bcd69e-18e3-41fb-b408-4ebb31f559c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:48:01.144962153Z [2024-05-11 02:48:01,144: INFO/ForkPoolWorker-1] [4858d34e-64cf-469a-b759-fd41368d6448] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:48:01.148724081Z [2024-05-11 02:48:01,148: INFO/ForkPoolWorker-2] [6440d4d9-ff0d-48a0-948c-f16c05b8e3f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:48:01.414926261Z [2024-05-11 02:48:01,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:48:01.491956770Z [2024-05-11 02:48:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:48:01.512938882Z [2024-05-11 02:48:01,506: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:48:01.709627837Z [2024-05-11 02:48:01,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:48:01.730847572Z [2024-05-11 02:48:01,730: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:48:01.735088882Z [2024-05-11 02:48:01,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:48:01.747948929Z [2024-05-11 02:48:01,744: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:48:01.800571725Z [2024-05-11 02:48:01,800: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:48:01.804155403Z [2024-05-11 02:48:01,803: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:48:01.804275223Z [2024-05-11 02:48:01,804: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:48:01.804353058Z [2024-05-11 02:48:01,804: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:48:01.804581823Z [2024-05-11 02:48:01,804: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:48:01.951761136Z [2024-05-11 02:48:01,951: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:48:02.399239183Z [2024-05-11 02:48:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d0ac40e-79a8-41c0-abae-0d6b3652143c] succeeded in 1.3015980689997377s: None 2024-05-11T02:48:02.673369048Z [2024-05-11 02:48:02,672: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6440d4d9-ff0d-48a0-948c-f16c05b8e3f4] succeeded in 1.5341050030001497s: None 2024-05-11T02:48:02.963889483Z [2024-05-11 02:48:02,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:48:02.967006370Z [2024-05-11 02:48:02,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:48:02.985009834Z [2024-05-11 02:48:02,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:48:02.986259463Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:48:02.986312805Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:48:02.986487773Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:48:02.986511157Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:48:02.986775868Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:48:02.987201551Z [2024-05-11 02:48:02,986: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:48:03.077291300Z [2024-05-11 02:48:03,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:48:03.221646840Z [2024-05-11 02:48:03,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:48:03.224867515Z [2024-05-11 02:48:03,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:48:03.244536840Z [2024-05-11 02:48:03,244: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:48:03.245986404Z [2024-05-11 02:48:03,245: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:48:03.246017048Z [2024-05-11 02:48:03,245: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:48:03.246228858Z [2024-05-11 02:48:03,246: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:48:03.246248605Z [2024-05-11 02:48:03,246: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:48:03.246604722Z [2024-05-11 02:48:03,246: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:48:03.246679433Z [2024-05-11 02:48:03,246: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:48:03.317262032Z [2024-05-11 02:48:03,316: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:48:05.377688504Z [2024-05-11 02:48:05,377: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29bcd69e-18e3-41fb-b408-4ebb31f559c3] succeeded in 4.2762970679978025s: None 2024-05-11T02:48:05.571493135Z [2024-05-11 02:48:05,570: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4858d34e-64cf-469a-b759-fd41368d6448] succeeded in 4.443904490002751s: None 2024-05-11T02:49:00.526549642Z [2024-05-11 02:49:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d04eefe1-a35b-431d-a3f4-69b94655ca4d] received 2024-05-11T02:49:00.533593238Z [2024-05-11 02:49:00,533: INFO/ForkPoolWorker-15] [d04eefe1-a35b-431d-a3f4-69b94655ca4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:49:00.548324264Z [2024-05-11 02:49:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38166401-2c38-4d0d-adeb-1f713c7e6806] received 2024-05-11T02:49:00.554610661Z [2024-05-11 02:49:00,554: INFO/ForkPoolWorker-16] [38166401-2c38-4d0d-adeb-1f713c7e6806] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:49:00.555500986Z [2024-05-11 02:49:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2fac9a9-22db-44ba-ba06-0d81a7c86e2d] received 2024-05-11T02:49:00.565252574Z [2024-05-11 02:49:00,564: INFO/ForkPoolWorker-1] [c2fac9a9-22db-44ba-ba06-0d81a7c86e2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:49:00.820609153Z [2024-05-11 02:49:00,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:49:00.903780271Z [2024-05-11 02:49:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:49:00.918922944Z [2024-05-11 02:49:00,915: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:49:01.108222002Z [2024-05-11 02:49:01,107: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:49:01.115079648Z [2024-05-11 02:49:01,114: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:49:01.151571670Z [2024-05-11 02:49:01,151: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:49:01.152754558Z [2024-05-11 02:49:01,152: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:49:01.152819613Z [2024-05-11 02:49:01,152: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:49:01.152866356Z [2024-05-11 02:49:01,152: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:49:01.153058560Z [2024-05-11 02:49:01,152: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:49:01.265973388Z [2024-05-11 02:49:01,265: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:49:01.806339764Z [2024-05-11 02:49:01,805: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38166401-2c38-4d0d-adeb-1f713c7e6806] succeeded in 1.2563986329987529s: None 2024-05-11T02:49:02.183238800Z [2024-05-11 02:49:02,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:49:02.186491943Z [2024-05-11 02:49:02,186: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:49:02.206976334Z [2024-05-11 02:49:02,206: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:49:02.208378492Z [2024-05-11 02:49:02,208: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:49:02.208510913Z [2024-05-11 02:49:02,208: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:49:02.208725680Z [2024-05-11 02:49:02,208: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:49:02.208850332Z [2024-05-11 02:49:02,208: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:49:02.209172475Z [2024-05-11 02:49:02,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:49:02.209302531Z [2024-05-11 02:49:02,209: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:49:02.316955919Z [2024-05-11 02:49:02,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:49:02.380797704Z [2024-05-11 02:49:02,380: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:49:02.385093366Z [2024-05-11 02:49:02,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:49:02.407322232Z [2024-05-11 02:49:02,407: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:49:02.408720754Z [2024-05-11 02:49:02,408: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:49:02.408907096Z [2024-05-11 02:49:02,408: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:49:02.409126182Z [2024-05-11 02:49:02,408: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:49:02.409273372Z [2024-05-11 02:49:02,409: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:49:02.409610375Z [2024-05-11 02:49:02,409: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:49:02.409812824Z [2024-05-11 02:49:02,409: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:49:02.503407391Z [2024-05-11 02:49:02,503: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:49:04.236065670Z [2024-05-11 02:49:04,235: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2fac9a9-22db-44ba-ba06-0d81a7c86e2d] succeeded in 3.678374936000182s: None 2024-05-11T02:49:04.673264718Z [2024-05-11 02:49:04,672: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d04eefe1-a35b-431d-a3f4-69b94655ca4d] succeeded in 4.144223223000154s: None 2024-05-11T02:50:00.414605746Z [2024-05-11 02:50:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5249a21-598f-4a35-8dbd-997a3086b126] received 2024-05-11T02:50:00.417436192Z [2024-05-11 02:50:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[151bbd6e-b0cc-48eb-a688-317053f8f2fd] received 2024-05-11T02:50:00.423392995Z [2024-05-11 02:50:00,423: INFO/ForkPoolWorker-16] [151bbd6e-b0cc-48eb-a688-317053f8f2fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:50:00.425154867Z [2024-05-11 02:50:00,424: INFO/ForkPoolWorker-15] [c5249a21-598f-4a35-8dbd-997a3086b126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:00.426544311Z [2024-05-11 02:50:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3939e867-b486-4fb9-86bc-94fda9598cfe] received 2024-05-11T02:50:00.431339648Z [2024-05-11 02:50:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[601018cb-75f7-46da-add9-b748ff980fd8] received 2024-05-11T02:50:00.433372392Z [2024-05-11 02:50:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47c48e97-44cb-49d6-b335-b014b5c8fff0] received 2024-05-11T02:50:00.433434901Z [2024-05-11 02:50:00,433: INFO/ForkPoolWorker-1] [3939e867-b486-4fb9-86bc-94fda9598cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:50:00.448246975Z [2024-05-11 02:50:00,447: INFO/ForkPoolWorker-2] [601018cb-75f7-46da-add9-b748ff980fd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:50:00.454946296Z [2024-05-11 02:50:00,454: INFO/ForkPoolWorker-3] [47c48e97-44cb-49d6-b335-b014b5c8fff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:50:00.824896124Z [2024-05-11 02:50:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:50:00.878583037Z [2024-05-11 02:50:00,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:50:01.176986623Z [2024-05-11 02:50:01,176: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:01.237842376Z [2024-05-11 02:50:01,221: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:50:01.242419517Z [2024-05-11 02:50:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:50:01.315312790Z [2024-05-11 02:50:01,298: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:50:01.823129388Z [2024-05-11 02:50:01,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[151bbd6e-b0cc-48eb-a688-317053f8f2fd] succeeded in 1.403812705000746s: None 2024-05-11T02:50:01.874163160Z [2024-05-11 02:50:01,873: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-11T02:50:01.887428883Z [2024-05-11 02:50:01,885: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:01.942104173Z [2024-05-11 02:50:01,941: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-11T02:50:01.944317537Z [2024-05-11 02:50:01,943: INFO/ForkPoolWorker-3] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:50:01.944674765Z [2024-05-11 02:50:01,944: INFO/ForkPoolWorker-3] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:50:01.944854939Z [2024-05-11 02:50:01,944: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-11T02:50:01.945175320Z [2024-05-11 02:50:01,945: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:50:02.088372555Z [2024-05-11 02:50:02,088: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:02.717609946Z [2024-05-11 02:50:02,717: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[47c48e97-44cb-49d6-b335-b014b5c8fff0] succeeded in 2.2821950249999645s: None 2024-05-11T02:50:02.806828037Z [2024-05-11 02:50:02,806: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:50:02.810305544Z [2024-05-11 02:50:02,809: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:02.840686162Z [2024-05-11 02:50:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:50:02.842213009Z [2024-05-11 02:50:02,841: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:02.842413772Z [2024-05-11 02:50:02,842: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:02.842603760Z [2024-05-11 02:50:02,842: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:02.842740540Z [2024-05-11 02:50:02,842: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:50:02.843047018Z [2024-05-11 02:50:02,842: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:50:02.843532041Z [2024-05-11 02:50:02,843: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:02.932193492Z [2024-05-11 02:50:02,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:03.162484757Z [2024-05-11 02:50:03,162: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:50:03.166053296Z [2024-05-11 02:50:03,165: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:03.194121715Z [2024-05-11 02:50:03,193: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:50:03.195784129Z [2024-05-11 02:50:03,195: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:50:03.195941099Z [2024-05-11 02:50:03,195: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:03.196125601Z [2024-05-11 02:50:03,195: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:03.196437249Z [2024-05-11 02:50:03,196: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:03.196720613Z [2024-05-11 02:50:03,196: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:50:03.197172399Z [2024-05-11 02:50:03,196: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:50:03.197720067Z [2024-05-11 02:50:03,197: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:03.200706966Z [2024-05-11 02:50:03,200: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:03.217892868Z [2024-05-11 02:50:03,217: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:50:03.221991776Z [2024-05-11 02:50:03,221: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:03.223301403Z [2024-05-11 02:50:03,223: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:03.223482828Z [2024-05-11 02:50:03,223: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:03.223576710Z [2024-05-11 02:50:03,223: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:50:03.223986296Z [2024-05-11 02:50:03,223: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:50:03.224496315Z [2024-05-11 02:50:03,223: INFO/ForkPoolWorker-2] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:03.305081639Z [2024-05-11 02:50:03,304: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:03.314407126Z [2024-05-11 02:50:03,314: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:03.603088380Z [2024-05-11 02:50:03,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95537a7e-adea-41eb-886c-ceaffcd4d8e4] received 2024-05-11T02:50:03.611779604Z [2024-05-11 02:50:03,611: INFO/ForkPoolWorker-16] [95537a7e-adea-41eb-886c-ceaffcd4d8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'split_metrics', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:03.666858177Z [2024-05-11 02:50:03,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5249a21-598f-4a35-8dbd-997a3086b126] succeeded in 3.2480735610006377s: None 2024-05-11T02:50:03.911231046Z [2024-05-11 02:50:03,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:50:04.845617965Z [2024-05-11 02:50:04,845: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[601018cb-75f7-46da-add9-b748ff980fd8] succeeded in 4.4112618820036005s: None 2024-05-11T02:50:04.996572478Z [2024-05-11 02:50:04,996: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:50:05.000393488Z [2024-05-11 02:50:04,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:05.034279942Z [2024-05-11 02:50:05,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:50:05.036671138Z [2024-05-11 02:50:05,036: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:05.036946783Z [2024-05-11 02:50:05,036: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:05.037296408Z [2024-05-11 02:50:05,036: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:05.037514117Z [2024-05-11 02:50:05,037: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:50:05.038017869Z [2024-05-11 02:50:05,037: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:50:05.038309162Z [2024-05-11 02:50:05,037: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:05.135427814Z [2024-05-11 02:50:05,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:05.563301497Z [2024-05-11 02:50:05,562: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3939e867-b486-4fb9-86bc-94fda9598cfe] succeeded in 5.134474944999965s: None 2024-05-11T02:50:05.939782068Z [2024-05-11 02:50:05,939: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95537a7e-adea-41eb-886c-ceaffcd4d8e4] succeeded in 2.3333888060005847s: None 2024-05-11T02:50:06.556478879Z [2024-05-11 02:50:06,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc965282-2505-4236-a89f-d127e1e3e023] received 2024-05-11T02:50:06.568993936Z [2024-05-11 02:50:06,568: INFO/ForkPoolWorker-15] [fc965282-2505-4236-a89f-d127e1e3e023] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'collect_metrics', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-11T02:50:06.896863454Z [2024-05-11 02:50:06,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:50:07.988263277Z [2024-05-11 02:50:07,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:50:07.991423712Z [2024-05-11 02:50:07,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:08.010386198Z [2024-05-11 02:50:08,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:50:08.011601541Z [2024-05-11 02:50:08,011: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:08.011618337Z [2024-05-11 02:50:08,011: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:08.011785984Z [2024-05-11 02:50:08,011: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:08.011801884Z [2024-05-11 02:50:08,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:50:08.012036306Z [2024-05-11 02:50:08,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:50:08.012154176Z [2024-05-11 02:50:08,012: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:08.111364894Z [2024-05-11 02:50:08,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:09.920833307Z [2024-05-11 02:50:09,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc965282-2505-4236-a89f-d127e1e3e023] succeeded in 3.3609199009988515s: None 2024-05-11T02:50:10.436645497Z [2024-05-11 02:50:10,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f2f49fc-5050-48bf-a930-2914d07b009d] received 2024-05-11T02:50:10.442918967Z [2024-05-11 02:50:10,442: INFO/ForkPoolWorker-15] [1f2f49fc-5050-48bf-a930-2914d07b009d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'send_prometheus', 'scheduled__2024-05-11T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-11T02:50:10.712723927Z [2024-05-11 02:50:10,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-11T02:50:11.786937022Z [2024-05-11 02:50:11,786: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:50:11.790269198Z [2024-05-11 02:50:11,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:50:11.809739286Z [2024-05-11 02:50:11,809: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:50:11.814054383Z [2024-05-11 02:50:11,811: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:50:11.814072973Z [2024-05-11 02:50:11,811: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:50:11.814077099Z [2024-05-11 02:50:11,811: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:50:11.814081368Z [2024-05-11 02:50:11,811: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:50:11.814099524Z [2024-05-11 02:50:11,811: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-11T02:50:11.814103681Z [2024-05-11 02:50:11,812: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:50:11.896764392Z [2024-05-11 02:50:11,896: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:50:12.543999835Z [2024-05-11 02:50:12,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f2f49fc-5050-48bf-a930-2914d07b009d] succeeded in 2.1054713039993658s: None 2024-05-11T02:51:00.193827049Z [2024-05-11 02:51:00,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee16ce7a-91b4-4961-9584-ae94ee0f5d30] received 2024-05-11T02:51:00.205294660Z [2024-05-11 02:51:00,204: INFO/ForkPoolWorker-15] [ee16ce7a-91b4-4961-9584-ae94ee0f5d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:51:00.209257860Z [2024-05-11 02:51:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eef1941c-80da-4d0e-b60d-f5ed6f6dc332] received 2024-05-11T02:51:00.215910642Z [2024-05-11 02:51:00,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1eddcc99-c32a-4f86-ae57-a63408e2a107] received 2024-05-11T02:51:00.216377166Z [2024-05-11 02:51:00,216: INFO/ForkPoolWorker-16] [eef1941c-80da-4d0e-b60d-f5ed6f6dc332] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:51:00.247013803Z [2024-05-11 02:51:00,246: INFO/ForkPoolWorker-1] [1eddcc99-c32a-4f86-ae57-a63408e2a107] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:51:00.547023986Z [2024-05-11 02:51:00,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:51:00.564545035Z [2024-05-11 02:51:00,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:51:00.717331424Z [2024-05-11 02:51:00,714: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:51:00.776804058Z [2024-05-11 02:51:00,776: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:51:00.780640787Z [2024-05-11 02:51:00,780: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:51:00.803104944Z [2024-05-11 02:51:00,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:51:00.804033682Z [2024-05-11 02:51:00,803: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:51:00.804096466Z [2024-05-11 02:51:00,803: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:51:00.804157351Z [2024-05-11 02:51:00,804: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:51:00.804331179Z [2024-05-11 02:51:00,804: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:51:00.886425862Z [2024-05-11 02:51:00,886: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:51:01.488732031Z [2024-05-11 02:51:01,488: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eef1941c-80da-4d0e-b60d-f5ed6f6dc332] succeeded in 1.2769723429992155s: None 2024-05-11T02:51:01.734706905Z [2024-05-11 02:51:01,734: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:51:01.737995566Z [2024-05-11 02:51:01,737: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:51:01.762914630Z [2024-05-11 02:51:01,762: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:51:01.767130565Z [2024-05-11 02:51:01,766: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:51:01.767368044Z [2024-05-11 02:51:01,767: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:51:01.767620679Z [2024-05-11 02:51:01,767: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:51:01.767838129Z [2024-05-11 02:51:01,767: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:51:01.768235088Z [2024-05-11 02:51:01,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:51:01.768946868Z [2024-05-11 02:51:01,768: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:51:01.874378789Z [2024-05-11 02:51:01,874: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:51:02.025913492Z [2024-05-11 02:51:02,025: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:51:02.029028617Z [2024-05-11 02:51:02,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:51:02.056608349Z [2024-05-11 02:51:02,056: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:51:02.058312241Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:51:02.058326816Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:51:02.058494656Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:51:02.058516508Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:51:02.058907488Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:51:02.058915564Z [2024-05-11 02:51:02,058: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:51:02.165989392Z [2024-05-11 02:51:02,165: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:51:03.750562627Z [2024-05-11 02:51:03,750: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1eddcc99-c32a-4f86-ae57-a63408e2a107] succeeded in 3.532224476999545s: None 2024-05-11T02:51:03.867164800Z [2024-05-11 02:51:03,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee16ce7a-91b4-4961-9584-ae94ee0f5d30] succeeded in 3.6680031930009136s: None 2024-05-11T02:52:00.641282018Z [2024-05-11 02:52:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76ce123d-3591-412a-804d-426ec01b19b7] received 2024-05-11T02:52:00.647918007Z [2024-05-11 02:52:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[813072cd-7621-4fd4-96bc-9793b08cee8b] received 2024-05-11T02:52:00.652949887Z [2024-05-11 02:52:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d14b38d6-2fb9-41b7-91b6-32e481949dde] received 2024-05-11T02:52:00.658476673Z [2024-05-11 02:52:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c2f1183-fc64-4111-8920-45d21427592b] received 2024-05-11T02:52:00.664055051Z [2024-05-11 02:52:00,663: INFO/ForkPoolWorker-15] [76ce123d-3591-412a-804d-426ec01b19b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:52:00.665685126Z [2024-05-11 02:52:00,665: INFO/ForkPoolWorker-16] [813072cd-7621-4fd4-96bc-9793b08cee8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:52:00.668198794Z [2024-05-11 02:52:00,667: INFO/ForkPoolWorker-1] [d14b38d6-2fb9-41b7-91b6-32e481949dde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:52:00.671484714Z [2024-05-11 02:52:00,671: INFO/ForkPoolWorker-2] [5c2f1183-fc64-4111-8920-45d21427592b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:52:00.937761339Z [2024-05-11 02:52:00,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:52:00.963506284Z [2024-05-11 02:52:00,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:52:00.976581857Z [2024-05-11 02:52:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:52:01.106127487Z [2024-05-11 02:52:01,098: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:52:01.279377098Z [2024-05-11 02:52:01,278: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-11T02:52:01.283416496Z [2024-05-11 02:52:01,282: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:52:01.315236346Z [2024-05-11 02:52:01,314: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:52:01.318755325Z [2024-05-11 02:52:01,318: INFO/ForkPoolWorker-2] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:52:01.319085914Z [2024-05-11 02:52:01,318: INFO/ForkPoolWorker-2] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:52:01.319318818Z [2024-05-11 02:52:01,319: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-11T02:52:01.319760724Z [2024-05-11 02:52:01,319: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:52:01.402453186Z [2024-05-11 02:52:01,402: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:52:01.439109185Z [2024-05-11 02:52:01,438: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:52:02.027849958Z [2024-05-11 02:52:02,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76ce123d-3591-412a-804d-426ec01b19b7] succeeded in 1.3834344669994607s: None 2024-05-11T02:52:02.115791413Z [2024-05-11 02:52:02,115: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5c2f1183-fc64-4111-8920-45d21427592b] succeeded in 1.453162567999243s: None 2024-05-11T02:52:02.474535643Z [2024-05-11 02:52:02,474: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:52:02.477748826Z [2024-05-11 02:52:02,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:52:02.502180829Z [2024-05-11 02:52:02,501: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:52:02.503637298Z [2024-05-11 02:52:02,503: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:52:02.503665413Z [2024-05-11 02:52:02,503: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:52:02.503819700Z [2024-05-11 02:52:02,503: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:52:02.503826743Z [2024-05-11 02:52:02,503: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:52:02.504084026Z [2024-05-11 02:52:02,503: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:52:02.504094313Z [2024-05-11 02:52:02,504: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:52:02.577830888Z [2024-05-11 02:52:02,577: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:52:02.760119320Z [2024-05-11 02:52:02,759: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-11T02:52:02.763441203Z [2024-05-11 02:52:02,762: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:52:02.787336937Z [2024-05-11 02:52:02,787: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:52:02.789401733Z [2024-05-11 02:52:02,789: INFO/ForkPoolWorker-1] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:52:02.789562757Z [2024-05-11 02:52:02,789: INFO/ForkPoolWorker-1] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:52:02.789779695Z [2024-05-11 02:52:02,789: INFO/ForkPoolWorker-1] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:52:02.789957852Z [2024-05-11 02:52:02,789: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-11T02:52:02.790487215Z [2024-05-11 02:52:02,790: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:52:02.790694847Z [2024-05-11 02:52:02,790: INFO/ForkPoolWorker-1] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:52:02.881337002Z [2024-05-11 02:52:02,881: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:52:04.401636028Z [2024-05-11 02:52:04,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d14b38d6-2fb9-41b7-91b6-32e481949dde] succeeded in 3.745346904001053s: None 2024-05-11T02:52:04.520848678Z [2024-05-11 02:52:04,520: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[813072cd-7621-4fd4-96bc-9793b08cee8b] succeeded in 3.869650783999532s: None 2024-05-11T02:53:00.943586756Z [2024-05-11 02:53:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77e2cf39-089a-45c6-9860-609f5005b158] received 2024-05-11T02:53:00.950043344Z [2024-05-11 02:53:00,949: INFO/ForkPoolWorker-15] [77e2cf39-089a-45c6-9860-609f5005b158] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:53:00.954014754Z [2024-05-11 02:53:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c05e55b2-9f04-4de8-be7e-1d3f7b389efd] received 2024-05-11T02:53:00.960276531Z [2024-05-11 02:53:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceabf1f1-0454-47c6-b604-7bad915aedf4] received 2024-05-11T02:53:00.961090824Z [2024-05-11 02:53:00,960: INFO/ForkPoolWorker-16] [c05e55b2-9f04-4de8-be7e-1d3f7b389efd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:53:00.968090978Z [2024-05-11 02:53:00,967: INFO/ForkPoolWorker-1] [ceabf1f1-0454-47c6-b604-7bad915aedf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:53:01.286927262Z [2024-05-11 02:53:01,283: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:53:01.384312958Z [2024-05-11 02:53:01,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:53:01.429503824Z [2024-05-11 02:53:01,426: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:53:01.449957391Z [2024-05-11 02:53:01,449: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-11T02:53:01.454004286Z [2024-05-11 02:53:01,453: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:53:01.482770241Z [2024-05-11 02:53:01,482: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-11T02:53:01.486651345Z [2024-05-11 02:53:01,486: INFO/ForkPoolWorker-1] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:53:01.486825365Z [2024-05-11 02:53:01,486: INFO/ForkPoolWorker-1] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:53:01.486947967Z [2024-05-11 02:53:01,486: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-11T02:53:01.487215789Z [2024-05-11 02:53:01,487: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:53:01.613144889Z [2024-05-11 02:53:01,612: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:53:02.249453364Z [2024-05-11 02:53:02,248: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ceabf1f1-0454-47c6-b604-7bad915aedf4] succeeded in 1.2866106889996445s: None 2024-05-11T02:53:02.530789341Z [2024-05-11 02:53:02,530: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:53:02.534108110Z [2024-05-11 02:53:02,533: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:53:02.561071624Z [2024-05-11 02:53:02,560: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:53:02.563706841Z [2024-05-11 02:53:02,563: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:53:02.563878417Z [2024-05-11 02:53:02,563: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:53:02.564176754Z [2024-05-11 02:53:02,563: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:53:02.564262274Z [2024-05-11 02:53:02,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:53:02.565146470Z [2024-05-11 02:53:02,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:53:02.565359743Z [2024-05-11 02:53:02,565: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:53:02.603708204Z [2024-05-11 02:53:02,603: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-11T02:53:02.607260294Z [2024-05-11 02:53:02,606: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:53:02.634722897Z [2024-05-11 02:53:02,634: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:53:02.638135106Z [2024-05-11 02:53:02,637: INFO/ForkPoolWorker-16] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:53:02.638233879Z [2024-05-11 02:53:02,637: INFO/ForkPoolWorker-16] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:53:02.639739881Z [2024-05-11 02:53:02,638: INFO/ForkPoolWorker-16] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:53:02.640025706Z [2024-05-11 02:53:02,639: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-11T02:53:02.640958720Z [2024-05-11 02:53:02,640: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:53:02.641215825Z [2024-05-11 02:53:02,640: INFO/ForkPoolWorker-16] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:53:02.682084876Z [2024-05-11 02:53:02,681: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:53:02.734257122Z [2024-05-11 02:53:02,733: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:53:04.731928471Z [2024-05-11 02:53:04,731: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c05e55b2-9f04-4de8-be7e-1d3f7b389efd] succeeded in 3.775805143999605s: None 2024-05-11T02:53:05.376038730Z [2024-05-11 02:53:05,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77e2cf39-089a-45c6-9860-609f5005b158] succeeded in 4.4306293450026715s: None 2024-05-11T02:54:00.243436283Z [2024-05-11 02:54:00,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc1b42b6-559f-49ab-a609-87159cfdff6f] received 2024-05-11T02:54:00.246843306Z [2024-05-11 02:54:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7d0ffe9-9dc3-4ec2-8974-38d6b5871865] received 2024-05-11T02:54:00.260805615Z [2024-05-11 02:54:00,260: INFO/ForkPoolWorker-15] [bc1b42b6-559f-49ab-a609-87159cfdff6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-11T02:54:00.274536920Z [2024-05-11 02:54:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06ef39b2-f54e-4f18-8a4b-f3b2e42cae3d] received 2024-05-11T02:54:00.283868527Z [2024-05-11 02:54:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23248ed7-8df2-4071-a93d-fb35a6bc70ca] received 2024-05-11T02:54:00.296602376Z [2024-05-11 02:54:00,296: INFO/ForkPoolWorker-1] [06ef39b2-f54e-4f18-8a4b-f3b2e42cae3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-11T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-11T02:54:00.318153816Z [2024-05-11 02:54:00,316: INFO/ForkPoolWorker-16] [b7d0ffe9-9dc3-4ec2-8974-38d6b5871865] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-11T02:54:00.326044031Z [2024-05-11 02:54:00,324: INFO/ForkPoolWorker-2] [23248ed7-8df2-4071-a93d-fb35a6bc70ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-11T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-11T02:54:00.801167961Z [2024-05-11 02:54:00,757: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-11T02:54:01.028084095Z [2024-05-11 02:54:01,009: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-11T02:54:01.274589525Z [2024-05-11 02:54:01,274: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-11T02:54:01.278789768Z [2024-05-11 02:54:01,278: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:54:01.311122472Z [2024-05-11 02:54:01,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-11T02:54:01.314941762Z [2024-05-11 02:54:01,310: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-11T02:54:01.315450935Z [2024-05-11 02:54:01,315: INFO/ForkPoolWorker-16] Read SDNC 2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 (sdnc-osm) 2024-05-11T02:54:01.315624297Z [2024-05-11 02:54:01,315: INFO/ForkPoolWorker-16] [{'_id': '2ba84b9e-9c9b-44a7-ade4-03dec5b9de72', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-11T02:54:01.315790796Z [2024-05-11 02:54:01,315: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-11T02:54:01.316066813Z [2024-05-11 02:54:01,315: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2ba84b9e-9c9b-44a7-ade4-03dec5b9de72 2024-05-11T02:54:01.622122984Z [2024-05-11 02:54:01,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:54:01.797546792Z [2024-05-11 02:54:01,794: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-11T02:54:02.179756119Z [2024-05-11 02:54:02,179: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:54:02.823227934Z [2024-05-11 02:54:02,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7d0ffe9-9dc3-4ec2-8974-38d6b5871865] succeeded in 2.5726704760018038s: None 2024-05-11T02:54:03.209797099Z [2024-05-11 02:54:03,209: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06ef39b2-f54e-4f18-8a4b-f3b2e42cae3d] succeeded in 2.9234866730002977s: None 2024-05-11T02:54:03.223712163Z [2024-05-11 02:54:03,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-11T02:54:03.227997331Z [2024-05-11 02:54:03,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:54:03.236145712Z [2024-05-11 02:54:03,235: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-11T02:54:03.239790857Z [2024-05-11 02:54:03,239: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'YJpUkX0W3qpp2xaH4twXf6q2Vtdz2KHH'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-11T02:54:03.265209262Z [2024-05-11 02:54:03,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-11T02:54:03.266768059Z [2024-05-11 02:54:03,266: INFO/ForkPoolWorker-15] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:54:03.267330357Z [2024-05-11 02:54:03,266: INFO/ForkPoolWorker-15] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:54:03.268627549Z [2024-05-11 02:54:03,267: INFO/ForkPoolWorker-15] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:54:03.268638301Z [2024-05-11 02:54:03,267: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-11T02:54:03.268642575Z [2024-05-11 02:54:03,267: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-11T02:54:03.268645720Z [2024-05-11 02:54:03,268: INFO/ForkPoolWorker-15] Creating DAG vim_status_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:54:03.270359713Z [2024-05-11 02:54:03,270: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-11T02:54:03.273510830Z [2024-05-11 02:54:03,273: INFO/ForkPoolWorker-2] Read VIM e7aaff0e-4fea-42ad-91d5-3514d698b506 (_system-osm-vim) 2024-05-11T02:54:03.273520261Z [2024-05-11 02:54:03,273: INFO/ForkPoolWorker-2] Read VIM 63db62ad-4458-4fb8-8a8b-037276c5a19f (osm) 2024-05-11T02:54:03.273610035Z [2024-05-11 02:54:03,273: INFO/ForkPoolWorker-2] [{'_id': 'e7aaff0e-4fea-42ad-91d5-3514d698b506', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '63db62ad-4458-4fb8-8a8b-037276c5a19f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-11T02:54:03.273673323Z [2024-05-11 02:54:03,273: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-11T02:54:03.274112850Z [2024-05-11 02:54:03,273: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-11T02:54:03.274415366Z [2024-05-11 02:54:03,274: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_63db62ad-4458-4fb8-8a8b-037276c5a19f 2024-05-11T02:54:03.409932387Z [2024-05-11 02:54:03,408: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:54:03.509667964Z [2024-05-11 02:54:03,496: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-11T02:54:05.104202369Z [2024-05-11 02:54:05,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc1b42b6-559f-49ab-a609-87159cfdff6f] succeeded in 4.858284916001139s: None 2024-05-11T02:54:05.280418499Z [2024-05-11 02:54:05,278: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23248ed7-8df2-4071-a93d-fb35a6bc70ca] succeeded in 4.982152174998191s: None 2024-05-10T22:25:24.617666812Z 2024-05-10T22:25:24.629843280Z Cleaning logs every 900 seconds 2024-05-10T22:25:24.629879345Z Trimming airflow logs to 15 days. 2024-05-10T22:30:00.694175872Z Trimming airflow logs to 15 days. 2024-05-10T22:30:01.721675083Z Trimming airflow logs to 15 days. 2024-05-10T22:45:00.751957896Z Trimming airflow logs to 15 days. 2024-05-10T22:45:01.778358584Z Trimming airflow logs to 15 days. 2024-05-10T23:00:00.830837037Z Trimming airflow logs to 15 days. 2024-05-10T23:00:01.879289027Z Trimming airflow logs to 15 days. 2024-05-10T23:15:00.970302523Z Trimming airflow logs to 15 days. 2024-05-10T23:30:00.013281714Z Trimming airflow logs to 15 days. 2024-05-10T23:30:01.076382458Z Trimming airflow logs to 15 days. 2024-05-10T23:45:00.136241515Z Trimming airflow logs to 15 days. 2024-05-10T23:45:01.236827165Z Trimming airflow logs to 15 days. 2024-05-11T00:00:00.342231886Z Trimming airflow logs to 15 days. 2024-05-11T00:00:01.391787784Z Trimming airflow logs to 15 days. 2024-05-11T00:15:00.468385243Z Trimming airflow logs to 15 days. 2024-05-11T00:15:01.525659490Z Trimming airflow logs to 15 days. 2024-05-11T00:30:00.603048634Z Trimming airflow logs to 15 days. 2024-05-11T00:30:01.654047944Z Trimming airflow logs to 15 days. 2024-05-11T00:45:00.740731331Z Trimming airflow logs to 15 days. 2024-05-11T00:45:01.826464391Z Trimming airflow logs to 15 days. 2024-05-11T01:00:00.908977349Z Trimming airflow logs to 15 days. 2024-05-11T01:00:01.993991599Z Trimming airflow logs to 15 days. 2024-05-11T01:15:00.078082687Z Trimming airflow logs to 15 days. 2024-05-11T01:15:01.199435570Z Trimming airflow logs to 15 days. 2024-05-11T01:30:00.309968080Z Trimming airflow logs to 15 days. 2024-05-11T01:30:01.450130127Z Trimming airflow logs to 15 days. 2024-05-11T01:45:00.534633604Z Trimming airflow logs to 15 days. 2024-05-11T01:45:01.676954989Z Trimming airflow logs to 15 days. 2024-05-11T02:00:00.795989080Z Trimming airflow logs to 15 days. 2024-05-11T02:15:00.338252485Z Trimming airflow logs to 15 days. 2024-05-11T02:15:01.414016807Z Trimming airflow logs to 15 days. 2024-05-11T02:30:00.539801514Z Trimming airflow logs to 15 days. 2024-05-11T02:30:01.617788967Z Trimming airflow logs to 15 days. 2024-05-11T02:45:00.708475248Z Trimming airflow logs to 15 days. 2024-05-11T02:45:01.802930709Z Trimming airflow logs to 15 days.