2024-03-27T23:50:03.961728871Z ... 2024-03-27T23:50:04.614253494Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-27T23:50:05.433687575Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-27T23:50:24.953556375Z 2024-03-27T23:50:26.521747966Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-27T23:50:30.411740050Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-27T23:50:34.797773739Z [2024-03-27 23:50:34 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-03-27T23:50:34.836195917Z [2024-03-27 23:50:34 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-03-27T23:50:34.836229243Z [2024-03-27 23:50:34 +0000] [16] [INFO] Using worker: sync 2024-03-27T23:50:34.870754459Z [2024-03-27 23:50:34 +0000] [17] [INFO] Booting worker with pid: 17 2024-03-27T23:50:34.979318290Z [2024-03-27 23:50:34 +0000] [18] [INFO] Booting worker with pid: 18 2024-03-27T23:50:37.121923977Z 2024-03-27T23:50:37.121943380Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-03-27T23:50:37.121947499Z --- ***** ----- 2024-03-27T23:50:37.121951117Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-03-27 23:50:37 2024-03-27T23:50:37.121954219Z - *** --- * --- 2024-03-27T23:50:37.121957565Z - ** ---------- [config] 2024-03-27T23:50:37.121960912Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f2eb353c310 2024-03-27T23:50:37.121964002Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-03-27T23:50:37.121967136Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-03-27T23:50:37.121972076Z - *** --- * --- .> concurrency: 16 (prefork) 2024-03-27T23:50:37.121975336Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-03-27T23:50:37.121978593Z --- ***** ----- 2024-03-27T23:50:37.121981692Z -------------- [queues] 2024-03-27T23:50:37.121984866Z .> default exchange=default(direct) key=default 2024-03-27T23:50:37.121988168Z 2024-03-27T23:50:37.121991081Z 2024-03-27T23:50:37.121994121Z [tasks] 2024-03-27T23:50:37.121997242Z . airflow.executors.celery_executor.execute_command 2024-03-27T23:50:37.122000237Z 2024-03-27T23:50:42.559862913Z [2024-03-27 23:50:42,556: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-03-27T23:50:42.562742930Z [2024-03-27 23:50:42,562: INFO/MainProcess] mingle: searching for neighbors 2024-03-27T23:50:43.577405503Z [2024-03-27 23:50:43,577: INFO/MainProcess] mingle: all alone 2024-03-27T23:50:43.616306673Z [2024-03-27 23:50:43,616: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-03-27T23:51:37.807204086Z [2024-03-27 23:51:37,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0347dbd-9e75-4e69-88f8-bf907bfcba9b] received 2024-03-27T23:51:37.893113485Z [2024-03-27 23:51:37,892: INFO/ForkPoolWorker-15] [f0347dbd-9e75-4e69-88f8-bf907bfcba9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:51:38.337607664Z [2024-03-27 23:51:38,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:51:38.929185197Z [2024-03-27 23:51:38,928: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:52:09.715266959Z [2024-03-27 23:52:09,714: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0347dbd-9e75-4e69-88f8-bf907bfcba9b] succeeded in 31.904440808000004s: None 2024-03-27T23:52:20.324079025Z [2024-03-27 23:52:20,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cd5a88e-aab1-4c91-9357-2528ecf0bcce] received 2024-03-27T23:52:20.331969261Z [2024-03-27 23:52:20,331: INFO/ForkPoolWorker-15] [5cd5a88e-aab1-4c91-9357-2528ecf0bcce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:52:20.611735238Z [2024-03-27 23:52:20,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:52:20.837424988Z [2024-03-27 23:52:20,837: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:52:43.219838876Z [2024-03-27 23:52:43,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cd5a88e-aab1-4c91-9357-2528ecf0bcce] succeeded in 22.89405743000009s: None 2024-03-27T23:52:44.903286297Z [2024-03-27 23:52:44,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee55f51d-c9a9-4cc9-84ed-2ff95d6c5012] received 2024-03-27T23:52:44.919959005Z [2024-03-27 23:52:44,919: INFO/ForkPoolWorker-15] [ee55f51d-c9a9-4cc9-84ed-2ff95d6c5012] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:52:45.316968906Z [2024-03-27 23:52:45,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:52:45.541292946Z [2024-03-27 23:52:45,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:52:46.011988481Z [2024-03-27 23:52:46,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee55f51d-c9a9-4cc9-84ed-2ff95d6c5012] succeeded in 1.1002351049999106s: None 2024-03-27T23:54:00.579399483Z [2024-03-27 23:54:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[021ff26b-6665-4f3f-ad5a-85fe5fe1dea2] received 2024-03-27T23:54:00.589954918Z [2024-03-27 23:54:00,589: INFO/ForkPoolWorker-15] [021ff26b-6665-4f3f-ad5a-85fe5fe1dea2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:54:00.889936162Z [2024-03-27 23:54:00,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:54:01.166255004Z [2024-03-27 23:54:01,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:54:01.708584726Z [2024-03-27 23:54:01,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[021ff26b-6665-4f3f-ad5a-85fe5fe1dea2] succeeded in 1.1276443560000189s: None 2024-03-27T23:56:00.984972998Z [2024-03-27 23:56:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4716e46c-56a4-4ff2-9e96-5c334bab185c] received 2024-03-27T23:56:00.991071745Z [2024-03-27 23:56:00,990: INFO/ForkPoolWorker-15] [4716e46c-56a4-4ff2-9e96-5c334bab185c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:56:01.293977079Z [2024-03-27 23:56:01,290: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:56:01.552684529Z [2024-03-27 23:56:01,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:56:02.122899035Z [2024-03-27 23:56:02,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4716e46c-56a4-4ff2-9e96-5c334bab185c] succeeded in 1.1363612920000605s: None 2024-03-27T23:57:56.185126689Z [2024-03-27 23:57:56,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13071f12-aeb1-4a45-bb98-da79a956b771] received 2024-03-27T23:57:56.194839843Z [2024-03-27 23:57:56,194: INFO/ForkPoolWorker-15] [13071f12-aeb1-4a45-bb98-da79a956b771] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:57:56.494290065Z [2024-03-27 23:57:56,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:57:57.677241516Z [2024-03-27 23:57:57,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:57:57.680548415Z [2024-03-27 23:57:57,680: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:57:57.706424539Z [2024-03-27 23:57:57,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:57:57.707410930Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:57:57.707626981Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:57:57.707751572Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:57:57.707814749Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:57:57.707847642Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:57:57.707857604Z [2024-03-27 23:57:57,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:57:57.814169152Z [2024-03-27 23:57:57,813: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:57:58.494472484Z [2024-03-27 23:57:58,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13071f12-aeb1-4a45-bb98-da79a956b771] succeeded in 2.30728869699999s: None 2024-03-27T23:57:58.950381660Z [2024-03-27 23:57:58,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[755f2f9d-79c3-4d3d-9087-fa963e94d939] received 2024-03-27T23:57:58.957148720Z [2024-03-27 23:57:58,956: INFO/ForkPoolWorker-15] [755f2f9d-79c3-4d3d-9087-fa963e94d939] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:57:59.228513020Z [2024-03-27 23:57:59,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:58:00.207891320Z [2024-03-27 23:58:00,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca74eacf-d103-48a4-971d-173233617379] received 2024-03-27T23:58:00.280289111Z [2024-03-27 23:58:00,279: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:58:00.286068815Z [2024-03-27 23:58:00,285: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:00.293252337Z [2024-03-27 23:58:00,292: INFO/ForkPoolWorker-16] [ca74eacf-d103-48a4-971d-173233617379] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-27T23:58:00.318164420Z [2024-03-27 23:58:00,317: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:58:00.319459604Z [2024-03-27 23:58:00,319: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:58:00.319598535Z [2024-03-27 23:58:00,319: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:58:00.319799195Z [2024-03-27 23:58:00,319: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:58:00.319895943Z [2024-03-27 23:58:00,319: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:58:00.320282542Z [2024-03-27 23:58:00,320: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:58:00.320418359Z [2024-03-27 23:58:00,320: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:58:00.390974379Z [2024-03-27 23:58:00,390: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:00.739777303Z [2024-03-27 23:58:00,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-27T23:58:01.048704613Z [2024-03-27 23:58:01,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[755f2f9d-79c3-4d3d-9087-fa963e94d939] succeeded in 2.0963854090000495s: None 2024-03-27T23:58:01.055420051Z [2024-03-27 23:58:01,055: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:01.605359163Z [2024-03-27 23:58:01,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e81fff6-50c9-47ba-9448-1e97c24c9d42] received 2024-03-27T23:58:01.609860413Z [2024-03-27 23:58:01,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08b57213-4204-4eda-bebe-e7b1b99a786f] received 2024-03-27T23:58:01.618242882Z [2024-03-27 23:58:01,617: INFO/ForkPoolWorker-15] [0e81fff6-50c9-47ba-9448-1e97c24c9d42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-27T23:58:01.628059381Z [2024-03-27 23:58:01,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95040746-abbe-4d2f-8246-89f836f0c88c] received 2024-03-27T23:58:01.689641491Z [2024-03-27 23:58:01,689: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca74eacf-d103-48a4-971d-173233617379] succeeded in 1.4785765049999782s: None 2024-03-27T23:58:01.699400682Z [2024-03-27 23:58:01,698: INFO/ForkPoolWorker-1] [08b57213-4204-4eda-bebe-e7b1b99a786f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-27T23:58:01.700520312Z [2024-03-27 23:58:01,700: INFO/ForkPoolWorker-2] [95040746-abbe-4d2f-8246-89f836f0c88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-27T23:58:01.991841564Z [2024-03-27 23:58:01,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-27T23:58:02.052031493Z [2024-03-27 23:58:02,048: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:58:02.090577555Z [2024-03-27 23:58:02,086: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-27T23:58:03.351774809Z [2024-03-27 23:58:03,351: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-27T23:58:03.360469694Z [2024-03-27 23:58:03,359: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:03.397620746Z [2024-03-27 23:58:03,395: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-27T23:58:03.397844511Z [2024-03-27 23:58:03,397: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:58:03.397857879Z [2024-03-27 23:58:03,397: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:58:03.398256096Z [2024-03-27 23:58:03,397: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:58:03.398271964Z [2024-03-27 23:58:03,397: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-27T23:58:03.398287060Z [2024-03-27 23:58:03,398: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-27T23:58:03.398308558Z [2024-03-27 23:58:03,398: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:58:03.439666050Z [2024-03-27 23:58:03,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:58:03.443785358Z [2024-03-27 23:58:03,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:03.473138146Z [2024-03-27 23:58:03,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:58:03.475307039Z [2024-03-27 23:58:03,474: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:58:03.475326853Z [2024-03-27 23:58:03,475: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:58:03.475441623Z [2024-03-27 23:58:03,475: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:58:03.475476203Z [2024-03-27 23:58:03,475: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:58:03.475888270Z [2024-03-27 23:58:03,475: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-27T23:58:03.475929287Z [2024-03-27 23:58:03,475: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:58:03.487576107Z [2024-03-27 23:58:03,486: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:03.566647891Z [2024-03-27 23:58:03,566: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:03.635314891Z [2024-03-27 23:58:03,634: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-27T23:58:03.638799112Z [2024-03-27 23:58:03,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:03.663274670Z [2024-03-27 23:58:03,663: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-27T23:58:03.664733811Z [2024-03-27 23:58:03,664: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:58:03.664801616Z [2024-03-27 23:58:03,664: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:58:03.664914491Z [2024-03-27 23:58:03,664: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:58:03.664936198Z [2024-03-27 23:58:03,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-27T23:58:03.665159392Z [2024-03-27 23:58:03,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:58:03.665167589Z [2024-03-27 23:58:03,665: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:58:03.771625654Z [2024-03-27 23:58:03,771: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:04.261583602Z [2024-03-27 23:58:04,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423b4a6e-9e9e-4b9f-96f1-71e6f6b7c9da] received 2024-03-27T23:58:04.272091212Z [2024-03-27 23:58:04,271: INFO/ForkPoolWorker-16] [423b4a6e-9e9e-4b9f-96f1-71e6f6b7c9da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:58:04.341836434Z [2024-03-27 23:58:04,341: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08b57213-4204-4eda-bebe-e7b1b99a786f] succeeded in 2.728929065999864s: None 2024-03-27T23:58:04.580274352Z [2024-03-27 23:58:04,577: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:58:05.252529096Z [2024-03-27 23:58:05,252: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e81fff6-50c9-47ba-9448-1e97c24c9d42] succeeded in 3.6409759470000154s: None 2024-03-27T23:58:05.762660541Z [2024-03-27 23:58:05,762: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-27T23:58:05.766094330Z [2024-03-27 23:58:05,765: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:05.789603378Z [2024-03-27 23:58:05,789: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-27T23:58:05.790827899Z [2024-03-27 23:58:05,790: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:58:05.790943172Z [2024-03-27 23:58:05,790: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:58:05.791148482Z [2024-03-27 23:58:05,790: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-27T23:58:05.791235906Z [2024-03-27 23:58:05,791: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-27T23:58:05.791509603Z [2024-03-27 23:58:05,791: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:58:05.791664262Z [2024-03-27 23:58:05,791: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:58:05.870127592Z [2024-03-27 23:58:05,869: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:06.296709446Z [2024-03-27 23:58:06,296: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95040746-abbe-4d2f-8246-89f836f0c88c] succeeded in 4.662847398999929s: None 2024-03-27T23:58:06.436034814Z [2024-03-27 23:58:06,434: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[423b4a6e-9e9e-4b9f-96f1-71e6f6b7c9da] succeeded in 2.1715722950000327s: None 2024-03-27T23:58:17.985521579Z [2024-03-27 23:58:17,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c3127d-39e3-45c1-8673-372ddbaad80f] received 2024-03-27T23:58:17.992407924Z [2024-03-27 23:58:17,991: INFO/ForkPoolWorker-15] [62c3127d-39e3-45c1-8673-372ddbaad80f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-27T23:58:18.296381506Z [2024-03-27 23:58:18,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-27T23:58:18.520178136Z [2024-03-27 23:58:18,519: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-27T23:58:18.531634726Z [2024-03-27 23:58:18,531: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:58:18.568429360Z [2024-03-27 23:58:18,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:58:18.569381032Z [2024-03-27 23:58:18,569: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-27T23:58:18.569569071Z [2024-03-27 23:58:18,569: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-27T23:58:18.569708545Z [2024-03-27 23:58:18,569: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-27T23:58:18.569946409Z [2024-03-27 23:58:18,569: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-27T23:58:18.658066704Z [2024-03-27 23:58:18,657: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:58:19.268988292Z [2024-03-27 23:58:19,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62c3127d-39e3-45c1-8673-372ddbaad80f] succeeded in 1.2820866749998459s: None 2024-03-27T23:59:00.650272039Z [2024-03-27 23:59:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfa37ae9-1b23-47ec-a66c-4b73b07e5ebc] received 2024-03-27T23:59:00.652416881Z [2024-03-27 23:59:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0464583a-0fc5-404d-a8d3-9a5d115cb79e] received 2024-03-27T23:59:00.661637836Z [2024-03-27 23:59:00,660: INFO/ForkPoolWorker-16] [0464583a-0fc5-404d-a8d3-9a5d115cb79e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-27T23:59:00.662824238Z [2024-03-27 23:59:00,661: INFO/ForkPoolWorker-15] [dfa37ae9-1b23-47ec-a66c-4b73b07e5ebc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-27T23:59:00.674094097Z [2024-03-27 23:59:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f529d6dd-f683-4e4b-8675-45df0d630aab] received 2024-03-27T23:59:00.679742775Z [2024-03-27 23:59:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82c87d45-0709-4665-b0f7-5078180330c0] received 2024-03-27T23:59:00.681425989Z [2024-03-27 23:59:00,681: INFO/ForkPoolWorker-1] [f529d6dd-f683-4e4b-8675-45df0d630aab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:00.687618488Z [2024-03-27 23:59:00,687: INFO/ForkPoolWorker-2] [82c87d45-0709-4665-b0f7-5078180330c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-27T23:59:00.967482917Z [2024-03-27 23:59:00,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-27T23:59:01.010005193Z [2024-03-27 23:59:01,006: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:01.016608418Z [2024-03-27 23:59:01,013: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-27T23:59:01.102034412Z [2024-03-27 23:59:01,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-27T23:59:01.264459407Z [2024-03-27 23:59:01,264: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-27T23:59:01.268270751Z [2024-03-27 23:59:01,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:01.331633028Z [2024-03-27 23:59:01,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:01.338479162Z [2024-03-27 23:59:01,338: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-27T23:59:01.338696971Z [2024-03-27 23:59:01,338: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-27T23:59:01.338901644Z [2024-03-27 23:59:01,338: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-27T23:59:01.339351943Z [2024-03-27 23:59:01,339: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-27T23:59:01.448476078Z [2024-03-27 23:59:01,448: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:02.193344611Z [2024-03-27 23:59:02,192: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfa37ae9-1b23-47ec-a66c-4b73b07e5ebc] succeeded in 1.5393506619998334s: None 2024-03-27T23:59:02.460510093Z [2024-03-27 23:59:02,460: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-27T23:59:02.464378308Z [2024-03-27 23:59:02,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:02.488127832Z [2024-03-27 23:59:02,487: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-27T23:59:02.489306538Z [2024-03-27 23:59:02,488: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-27T23:59:02.490174482Z [2024-03-27 23:59:02,489: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:02.490197803Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:02.490214157Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:02.490374863Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:02.490436147Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-27T23:59:02.490772006Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-27T23:59:02.490796528Z [2024-03-27 23:59:02,490: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:02.493301473Z [2024-03-27 23:59:02,492: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:02.495988772Z [2024-03-27 23:59:02,495: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:02.519258051Z [2024-03-27 23:59:02,519: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-27T23:59:02.521009808Z [2024-03-27 23:59:02,520: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:02.521293395Z [2024-03-27 23:59:02,521: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:02.521585497Z [2024-03-27 23:59:02,521: INFO/ForkPoolWorker-2] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:02.522412987Z [2024-03-27 23:59:02,521: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:02.522605979Z [2024-03-27 23:59:02,522: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-27T23:59:02.523218299Z [2024-03-27 23:59:02,523: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-27T23:59:02.523604660Z [2024-03-27 23:59:02,523: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:02.528324092Z [2024-03-27 23:59:02,528: INFO/ForkPoolWorker-2] Creating DAG vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:02.613017811Z [2024-03-27 23:59:02,612: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:02.623397636Z [2024-03-27 23:59:02,623: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:02.802444194Z [2024-03-27 23:59:02,802: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-27T23:59:02.806897288Z [2024-03-27 23:59:02,806: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:02.860010074Z [2024-03-27 23:59:02,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-27T23:59:02.865871495Z [2024-03-27 23:59:02,865: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:02.866101688Z [2024-03-27 23:59:02,865: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:02.866319810Z [2024-03-27 23:59:02,866: INFO/ForkPoolWorker-1] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:02.866773907Z [2024-03-27 23:59:02,866: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:02.866980437Z [2024-03-27 23:59:02,866: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-27T23:59:02.867659089Z [2024-03-27 23:59:02,867: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:02.867821355Z [2024-03-27 23:59:02,867: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:02.879455845Z [2024-03-27 23:59:02,879: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:02.999790928Z [2024-03-27 23:59:02,999: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:03.771372384Z [2024-03-27 23:59:03,770: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f529d6dd-f683-4e4b-8675-45df0d630aab] succeeded in 3.0952943850002157s: None 2024-03-27T23:59:03.966077727Z [2024-03-27 23:59:03,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5330cde0-2ebb-4ac7-aa8b-7697b13bd272] received 2024-03-27T23:59:03.975648393Z [2024-03-27 23:59:03,975: INFO/ForkPoolWorker-15] [5330cde0-2ebb-4ac7-aa8b-7697b13bd272] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'split_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:04.416863410Z [2024-03-27 23:59:04,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:04.584841005Z [2024-03-27 23:59:04,584: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82c87d45-0709-4665-b0f7-5078180330c0] succeeded in 3.901032240999939s: None 2024-03-27T23:59:04.775272820Z [2024-03-27 23:59:04,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0464583a-0fc5-404d-a8d3-9a5d115cb79e] succeeded in 4.120686970000179s: None 2024-03-27T23:59:05.994733446Z [2024-03-27 23:59:05,994: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:05.998391031Z [2024-03-27 23:59:05,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:06.021435695Z [2024-03-27 23:59:06,021: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:06.023223404Z [2024-03-27 23:59:06,022: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:06.023367633Z [2024-03-27 23:59:06,023: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:06.023595067Z [2024-03-27 23:59:06,023: INFO/ForkPoolWorker-15] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:06.023697697Z [2024-03-27 23:59:06,023: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:06.023909909Z [2024-03-27 23:59:06,023: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:06.024290157Z [2024-03-27 23:59:06,024: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:06.024422800Z [2024-03-27 23:59:06,024: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:06.031552757Z [2024-03-27 23:59:06,031: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:06.114179078Z [2024-03-27 23:59:06,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:06.519419156Z [2024-03-27 23:59:06,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6ea5401-e329-4c94-aff4-8dc6ab9fd268] received 2024-03-27T23:59:06.525105590Z [2024-03-27 23:59:06,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d7f873b-f733-45e5-84f0-da90db31cbe4] received 2024-03-27T23:59:06.531433246Z [2024-03-27 23:59:06,531: INFO/ForkPoolWorker-16] [b6ea5401-e329-4c94-aff4-8dc6ab9fd268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-27T23:59:06.539767155Z [2024-03-27 23:59:06,539: INFO/ForkPoolWorker-1] [2d7f873b-f733-45e5-84f0-da90db31cbe4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-27T23:59:06.875066890Z [2024-03-27 23:59:06,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-27T23:59:06.888046639Z [2024-03-27 23:59:06,887: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5330cde0-2ebb-4ac7-aa8b-7697b13bd272] succeeded in 2.919408876000034s: None 2024-03-27T23:59:06.924310384Z [2024-03-27 23:59:06,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-27T23:59:07.318282543Z [2024-03-27 23:59:07,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02838693-baf2-46bd-940e-dd9892564b88] received 2024-03-27T23:59:07.341889624Z [2024-03-27 23:59:07,341: INFO/ForkPoolWorker-15] [02838693-baf2-46bd-940e-dd9892564b88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'collect_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-27T23:59:07.698095549Z [2024-03-27 23:59:07,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:08.240697893Z [2024-03-27 23:59:08,234: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-27T23:59:08.252103755Z [2024-03-27 23:59:08,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:08.280347637Z [2024-03-27 23:59:08,280: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-27T23:59:08.281643920Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:08.281800056Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:08.281809607Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:08.281872051Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:08.281903697Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-27T23:59:08.282079504Z [2024-03-27 23:59:08,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-27T23:59:08.282100005Z [2024-03-27 23:59:08,282: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:08.287999389Z [2024-03-27 23:59:08,287: INFO/ForkPoolWorker-1] Creating DAG vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:08.357288972Z [2024-03-27 23:59:08,356: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:08.675350449Z [2024-03-27 23:59:08,674: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-27T23:59:08.687134304Z [2024-03-27 23:59:08,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:08.750503173Z [2024-03-27 23:59:08,750: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-27T23:59:08.757655425Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:08.757672473Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:08.757682161Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:08.757838588Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:08.757878989Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-27T23:59:08.758105616Z [2024-03-27 23:59:08,757: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-27T23:59:08.758144677Z [2024-03-27 23:59:08,758: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:08.779389206Z [2024-03-27 23:59:08,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:08.992352114Z [2024-03-27 23:59:08,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:09.651997681Z [2024-03-27 23:59:09,651: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:09.658013139Z [2024-03-27 23:59:09,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:09.685371647Z [2024-03-27 23:59:09,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:09.686826809Z [2024-03-27 23:59:09,686: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:09.686877997Z [2024-03-27 23:59:09,686: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:09.686923361Z [2024-03-27 23:59:09,686: INFO/ForkPoolWorker-15] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:09.687032864Z [2024-03-27 23:59:09,686: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:09.687073934Z [2024-03-27 23:59:09,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:09.687283599Z [2024-03-27 23:59:09,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:09.687324553Z [2024-03-27 23:59:09,687: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:09.694281806Z [2024-03-27 23:59:09,694: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:09.872086538Z [2024-03-27 23:59:09,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:09.970772441Z [2024-03-27 23:59:09,970: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2d7f873b-f733-45e5-84f0-da90db31cbe4] succeeded in 3.4424084269999184s: None 2024-03-27T23:59:10.427420111Z [2024-03-27 23:59:10,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02838693-baf2-46bd-940e-dd9892564b88] succeeded in 3.100307088000136s: None 2024-03-27T23:59:10.670748229Z [2024-03-27 23:59:10,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a5f6034-5e02-4fdb-81ac-09d73fd25481] received 2024-03-27T23:59:10.679646559Z [2024-03-27 23:59:10,679: INFO/ForkPoolWorker-15] [2a5f6034-5e02-4fdb-81ac-09d73fd25481] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'send_prometheus', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:11.021528810Z [2024-03-27 23:59:11,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:11.286730946Z [2024-03-27 23:59:11,285: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6ea5401-e329-4c94-aff4-8dc6ab9fd268] succeeded in 4.7645967519999886s: None 2024-03-27T23:59:12.225427134Z [2024-03-27 23:59:12,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:12.229634410Z [2024-03-27 23:59:12,228: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:12.257751124Z [2024-03-27 23:59:12,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:12.260329751Z [2024-03-27 23:59:12,259: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:12.260363900Z [2024-03-27 23:59:12,260: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:12.260386876Z [2024-03-27 23:59:12,260: INFO/ForkPoolWorker-15] Read VIM ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 (basic01_144943) 2024-03-27T23:59:12.260637745Z [2024-03-27 23:59:12,260: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'name': 'basic01_144943', 'vim_type': 'openstack'}] 2024-03-27T23:59:12.260682813Z [2024-03-27 23:59:12,260: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:12.261190433Z [2024-03-27 23:59:12,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:12.261265149Z [2024-03-27 23:59:12,261: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:12.271579888Z [2024-03-27 23:59:12,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5 2024-03-27T23:59:12.355573079Z [2024-03-27 23:59:12,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:12.954967394Z [2024-03-27 23:59:12,954: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a5f6034-5e02-4fdb-81ac-09d73fd25481] succeeded in 2.282186231999958s: None 2024-03-27T23:59:32.932413798Z [2024-03-27 23:59:32,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f29f7113-0a34-4acc-8641-df755ee5b284] received 2024-03-27T23:59:32.944622660Z [2024-03-27 23:59:32,944: INFO/ForkPoolWorker-15] [f29f7113-0a34-4acc-8641-df755ee5b284] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:33.231578499Z [2024-03-27 23:59:33,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:34.377759172Z [2024-03-27 23:59:34,377: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:34.381095596Z [2024-03-27 23:59:34,380: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:34.398271202Z [2024-03-27 23:59:34,397: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:34.399993074Z [2024-03-27 23:59:34,399: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:34.400016589Z [2024-03-27 23:59:34,399: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:34.400054032Z [2024-03-27 23:59:34,399: INFO/ForkPoolWorker-15] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:34.400075620Z [2024-03-27 23:59:34,399: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:34.400085012Z [2024-03-27 23:59:34,399: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:34.400355045Z [2024-03-27 23:59:34,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:34.400367911Z [2024-03-27 23:59:34,400: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:34.406263947Z [2024-03-27 23:59:34,405: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:34.504987822Z [2024-03-27 23:59:34,504: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:35.209215539Z [2024-03-27 23:59:35,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f29f7113-0a34-4acc-8641-df755ee5b284] succeeded in 2.2744571250000263s: None 2024-03-27T23:59:35.562951504Z [2024-03-27 23:59:35,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7275b6f3-34df-4350-8aef-b6e4b4ffd319] received 2024-03-27T23:59:35.583996055Z [2024-03-27 23:59:35,581: INFO/ForkPoolWorker-15] [7275b6f3-34df-4350-8aef-b6e4b4ffd319] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'split_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:35.905117740Z [2024-03-27 23:59:35,901: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:37.030216417Z [2024-03-27 23:59:37,029: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:37.033402720Z [2024-03-27 23:59:37,032: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:37.071086073Z [2024-03-27 23:59:37,070: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:37.072970855Z [2024-03-27 23:59:37,072: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:37.073143463Z [2024-03-27 23:59:37,072: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:37.073302882Z [2024-03-27 23:59:37,073: INFO/ForkPoolWorker-15] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:37.073593899Z [2024-03-27 23:59:37,073: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:37.073776753Z [2024-03-27 23:59:37,073: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:37.074170082Z [2024-03-27 23:59:37,074: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:37.074328692Z [2024-03-27 23:59:37,074: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:37.083888144Z [2024-03-27 23:59:37,083: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:37.235388389Z [2024-03-27 23:59:37,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:37.858656332Z [2024-03-27 23:59:37,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7275b6f3-34df-4350-8aef-b6e4b4ffd319] succeeded in 2.2928597900001932s: None 2024-03-27T23:59:38.591191496Z [2024-03-27 23:59:38,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6597e2c1-90ff-4616-b7c2-441bb5a9d818] received 2024-03-27T23:59:38.592723666Z [2024-03-27 23:59:38,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d96705c-a86a-4830-a5df-b678e9c0887a] received 2024-03-27T23:59:38.594430449Z [2024-03-27 23:59:38,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a0a24c0-2600-4b6c-8d13-0d35c4f9f0f8] received 2024-03-27T23:59:38.600639580Z [2024-03-27 23:59:38,600: INFO/ForkPoolWorker-16] [1d96705c-a86a-4830-a5df-b678e9c0887a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-27T23:59:38.608199429Z [2024-03-27 23:59:38,607: INFO/ForkPoolWorker-1] [2a0a24c0-2600-4b6c-8d13-0d35c4f9f0f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'collect_metrics', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-27T23:59:38.613257185Z [2024-03-27 23:59:38,613: INFO/ForkPoolWorker-15] [6597e2c1-90ff-4616-b7c2-441bb5a9d818] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-27T23:59:38.876670672Z [2024-03-27 23:59:38,873: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-27T23:59:38.898835048Z [2024-03-27 23:59:38,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-27T23:59:38.931273829Z [2024-03-27 23:59:38,927: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:39.970576219Z [2024-03-27 23:59:39,970: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-27T23:59:39.973996947Z [2024-03-27 23:59:39,973: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:40.008252654Z [2024-03-27 23:59:40,008: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-27T23:59:40.010088854Z [2024-03-27 23:59:40,009: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:40.010106098Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:40.010285621Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:40.010471311Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:40.010527582Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-27T23:59:40.010867170Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-27T23:59:40.010879740Z [2024-03-27 23:59:40,010: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:40.016570094Z [2024-03-27 23:59:40,016: INFO/ForkPoolWorker-15] Creating DAG vim_status_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:40.040876026Z [2024-03-27 23:59:40,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-27T23:59:40.044456724Z [2024-03-27 23:59:40,043: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:40.068437166Z [2024-03-27 23:59:40,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-27T23:59:40.070528918Z [2024-03-27 23:59:40,070: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:40.070544110Z [2024-03-27 23:59:40,070: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:40.070740430Z [2024-03-27 23:59:40,070: INFO/ForkPoolWorker-16] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:40.070936908Z [2024-03-27 23:59:40,070: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:40.071078379Z [2024-03-27 23:59:40,070: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-27T23:59:40.071384816Z [2024-03-27 23:59:40,071: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-27T23:59:40.071535161Z [2024-03-27 23:59:40,071: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:40.077115487Z [2024-03-27 23:59:40,076: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:40.112407756Z [2024-03-27 23:59:40,111: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-27T23:59:40.115677015Z [2024-03-27 23:59:40,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:40.118697942Z [2024-03-27 23:59:40,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:40.168388365Z [2024-03-27 23:59:40,168: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-27T23:59:40.171448670Z [2024-03-27 23:59:40,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:40.171927631Z [2024-03-27 23:59:40,171: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:40.172162494Z [2024-03-27 23:59:40,171: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:40.172347247Z [2024-03-27 23:59:40,172: INFO/ForkPoolWorker-1] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:40.172846999Z [2024-03-27 23:59:40,172: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:40.173195535Z [2024-03-27 23:59:40,172: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-27T23:59:40.173808722Z [2024-03-27 23:59:40,173: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:40.173975884Z [2024-03-27 23:59:40,173: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:40.193956532Z [2024-03-27 23:59:40,193: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:40.295531427Z [2024-03-27 23:59:40,295: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:40.903779090Z [2024-03-27 23:59:40,903: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a0a24c0-2600-4b6c-8d13-0d35c4f9f0f8] succeeded in 2.307727949000082s: None 2024-03-27T23:59:41.100491896Z [2024-03-27 23:59:41,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7d00065-566f-4f79-b53e-3193fcc21644] received 2024-03-27T23:59:41.108123486Z [2024-03-27 23:59:41,107: INFO/ForkPoolWorker-1] [a7d00065-566f-4f79-b53e-3193fcc21644] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'send_prometheus', 'scheduled__2024-03-27T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-27T23:59:41.378784874Z [2024-03-27 23:59:41,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-27T23:59:41.620208268Z [2024-03-27 23:59:41,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6597e2c1-90ff-4616-b7c2-441bb5a9d818] succeeded in 3.025762646999965s: None 2024-03-27T23:59:41.954630147Z [2024-03-27 23:59:41,954: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d96705c-a86a-4830-a5df-b678e9c0887a] succeeded in 3.3605968839999605s: None 2024-03-27T23:59:42.512165678Z [2024-03-27 23:59:42,511: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-27T23:59:42.515482759Z [2024-03-27 23:59:42,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-27T23:59:42.537270134Z [2024-03-27 23:59:42,537: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-27T23:59:42.538939438Z [2024-03-27 23:59:42,538: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-27T23:59:42.539129775Z [2024-03-27 23:59:42,538: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-27T23:59:42.539334129Z [2024-03-27 23:59:42,539: INFO/ForkPoolWorker-1] Read VIM 28ce5a1c-c069-48dc-b943-696c30dae783 (basic01_650375) 2024-03-27T23:59:42.539643858Z [2024-03-27 23:59:42,539: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '28ce5a1c-c069-48dc-b943-696c30dae783', 'name': 'basic01_650375', 'vim_type': 'openstack'}] 2024-03-27T23:59:42.539845546Z [2024-03-27 23:59:42,539: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-27T23:59:42.540237586Z [2024-03-27 23:59:42,540: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-27T23:59:42.540444263Z [2024-03-27 23:59:42,540: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-27T23:59:42.547286227Z [2024-03-27 23:59:42,547: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783 2024-03-27T23:59:42.632732500Z [2024-03-27 23:59:42,632: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-27T23:59:43.270375126Z [2024-03-27 23:59:43,269: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7d00065-566f-4f79-b53e-3193fcc21644] succeeded in 2.167069710000078s: None 2024-03-28T00:00:00.463814122Z [2024-03-28 00:00:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92d99da2-fdf6-4357-8d88-840184650145] received 2024-03-28T00:00:00.468114408Z [2024-03-28 00:00:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71cefca5-3635-49e1-a3d3-1833063c959a] received 2024-03-28T00:00:00.471251990Z [2024-03-28 00:00:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf2fa77-ac2d-44f9-91c1-cf937644aeb0] received 2024-03-28T00:00:00.473957778Z [2024-03-28 00:00:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc] received 2024-03-28T00:00:00.476575990Z [2024-03-28 00:00:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17a56b6c-cfc7-4e8b-bff7-e20d8a2bac4f] received 2024-03-28T00:00:00.478807137Z [2024-03-28 00:00:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14482dd3-7f5d-4eea-8640-14f563a99eb2] received 2024-03-28T00:00:00.480659568Z [2024-03-28 00:00:00,480: INFO/ForkPoolWorker-16] [71cefca5-3635-49e1-a3d3-1833063c959a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:00:00.487294331Z [2024-03-28 00:00:00,487: INFO/ForkPoolWorker-15] [92d99da2-fdf6-4357-8d88-840184650145] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:00:00.487795570Z [2024-03-28 00:00:00,487: INFO/ForkPoolWorker-1] [eaf2fa77-ac2d-44f9-91c1-cf937644aeb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:00.499694493Z [2024-03-28 00:00:00,499: INFO/ForkPoolWorker-2] [fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:00:00.507136850Z [2024-03-28 00:00:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e134951-4019-4b67-a052-f15bdc12a897] received 2024-03-28T00:00:00.512918091Z [2024-03-28 00:00:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[223ccc21-e147-4ff1-a4a0-d57eea095e62] received 2024-03-28T00:00:00.520721321Z [2024-03-28 00:00:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c25f1c8e-73c5-47b1-a723-657b73f1caef] received 2024-03-28T00:00:00.526120446Z [2024-03-28 00:00:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d01ff501-76ab-4923-9863-1cbaed26d032] received 2024-03-28T00:00:00.580856124Z [2024-03-28 00:00:00,580: INFO/ForkPoolWorker-6] [223ccc21-e147-4ff1-a4a0-d57eea095e62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:00:00.602210779Z [2024-03-28 00:00:00,601: INFO/ForkPoolWorker-7] [c25f1c8e-73c5-47b1-a723-657b73f1caef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-27T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:00:00.625404610Z [2024-03-28 00:00:00,624: INFO/ForkPoolWorker-3] [17a56b6c-cfc7-4e8b-bff7-e20d8a2bac4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:00:00.643941907Z [2024-03-28 00:00:00,643: INFO/ForkPoolWorker-5] [3e134951-4019-4b67-a052-f15bdc12a897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:00.734734647Z [2024-03-28 00:00:00,734: INFO/ForkPoolWorker-4] [14482dd3-7f5d-4eea-8640-14f563a99eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:00:00.838872960Z [2024-03-28 00:00:00,829: INFO/ForkPoolWorker-8] [d01ff501-76ab-4923-9863-1cbaed26d032] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:00:01.383168262Z [2024-03-28 00:00:01,379: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:00:01.596332035Z [2024-03-28 00:00:01,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:00:01.666249413Z [2024-03-28 00:00:01,665: INFO/ForkPoolWorker-7] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:01.695486274Z [2024-03-28 00:00:01,637: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:01.768257977Z [2024-03-28 00:00:01,767: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:00:01.772383225Z [2024-03-28 00:00:01,771: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:01.876001887Z [2024-03-28 00:00:01,875: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:00:01.884676811Z [2024-03-28 00:00:01,884: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:00:01.884829177Z [2024-03-28 00:00:01,884: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:00:01.884969707Z [2024-03-28 00:00:01,884: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:00:01.885283353Z [2024-03-28 00:00:01,885: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:00:02.122673887Z [2024-03-28 00:00:02,118: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:02.171133978Z [2024-03-28 00:00:02,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:02.187452915Z [2024-03-28 00:00:02,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edca2ec9-7c90-4dd5-bedb-2dbf80a71848] received 2024-03-28T00:00:02.195823626Z [2024-03-28 00:00:02,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:02.251615508Z [2024-03-28 00:00:02,251: INFO/ForkPoolWorker-9] [edca2ec9-7c90-4dd5-bedb-2dbf80a71848] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:02.301262327Z [2024-03-28 00:00:02,248: INFO/ForkPoolWorker-8] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:02.466338482Z [2024-03-28 00:00:02,461: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:02.680871922Z [2024-03-28 00:00:02,638: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:02.836366246Z [2024-03-28 00:00:02,811: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:02.903825773Z [2024-03-28 00:00:02,899: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:03.056075628Z [2024-03-28 00:00:03,051: INFO/ForkPoolWorker-9] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:03.499427743Z [2024-03-28 00:00:03,498: INFO/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[c25f1c8e-73c5-47b1-a723-657b73f1caef] succeeded in 2.975685393000049s: None 2024-03-28T00:00:04.102185042Z [2024-03-28 00:00:04,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71cefca5-3635-49e1-a3d3-1833063c959a] succeeded in 3.630888339999956s: None 2024-03-28T00:00:05.428193910Z [2024-03-28 00:00:05,427: INFO/ForkPoolWorker-8] Getting VIM list 2024-03-28T00:00:05.431870776Z [2024-03-28 00:00:05,431: INFO/ForkPoolWorker-8] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:05.483961535Z [2024-03-28 00:00:05,483: INFO/ForkPoolWorker-8] Connected to database osm version 1.2 2024-03-28T00:00:05.486928438Z [2024-03-28 00:00:05,486: INFO/ForkPoolWorker-8] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:05.487029503Z [2024-03-28 00:00:05,486: INFO/ForkPoolWorker-8] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:05.488044072Z [2024-03-28 00:00:05,487: INFO/ForkPoolWorker-8] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:05.488159110Z [2024-03-28 00:00:05,488: INFO/ForkPoolWorker-8] Getting VIM list OK 2024-03-28T00:00:05.488482076Z [2024-03-28 00:00:05,488: INFO/ForkPoolWorker-8] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:05.488899877Z [2024-03-28 00:00:05,488: INFO/ForkPoolWorker-8] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:05.495602305Z [2024-03-28 00:00:05,495: WARNING/ForkPoolWorker-8] Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:05.496890154Z [2024-03-28 00:00:05,496: INFO/ForkPoolWorker-8] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:05.507131067Z [2024-03-28 00:00:05,506: INFO/ForkPoolWorker-8] Getting VIM list 2024-03-28T00:00:05.512139398Z [2024-03-28 00:00:05,511: INFO/ForkPoolWorker-8] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:05.599044175Z [2024-03-28 00:00:05,598: INFO/ForkPoolWorker-8] Connected to database osm version 1.2 2024-03-28T00:00:05.600061579Z [2024-03-28 00:00:05,599: INFO/ForkPoolWorker-8] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:05.600290797Z [2024-03-28 00:00:05,600: INFO/ForkPoolWorker-8] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:05.600476002Z [2024-03-28 00:00:05,600: INFO/ForkPoolWorker-8] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:05.600598654Z [2024-03-28 00:00:05,600: INFO/ForkPoolWorker-8] Getting VIM list OK 2024-03-28T00:00:05.600913563Z [2024-03-28 00:00:05,600: INFO/ForkPoolWorker-8] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:05.601044613Z [2024-03-28 00:00:05,600: INFO/ForkPoolWorker-8] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:05.604777895Z [2024-03-28 00:00:05,604: ERROR/ForkPoolWorker-8] [d01ff501-76ab-4923-9863-1cbaed26d032] Failed to execute task Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:05.604798958Z Traceback (most recent call last): 2024-03-28T00:00:05.604803360Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:05.604807573Z args.func(args) 2024-03-28T00:00:05.604811473Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:05.604815585Z return func(*args, **kwargs) 2024-03-28T00:00:05.604818860Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:05.604822274Z return f(*args, **kwargs) 2024-03-28T00:00:05.604825416Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:05.604828553Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:05.604831667Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:05.604835227Z raise AirflowException( 2024-03-28T00:00:05.604839099Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:05.669868229Z [2024-03-28 00:00:05,669: ERROR/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[d01ff501-76ab-4923-9863-1cbaed26d032] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d01ff501-76ab-4923-9863-1cbaed26d032') 2024-03-28T00:00:05.669897874Z Traceback (most recent call last): 2024-03-28T00:00:05.669903775Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:05.669908483Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:05.669912849Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:05.669917320Z return self.run(*args, **kwargs) 2024-03-28T00:00:05.669923550Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:05.669929088Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:05.669932672Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:05.669937671Z raise AirflowException(msg) 2024-03-28T00:00:05.669953261Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d01ff501-76ab-4923-9863-1cbaed26d032 2024-03-28T00:00:06.261673401Z [2024-03-28 00:00:06,260: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T00:00:06.274083513Z [2024-03-28 00:00:06,273: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:06.373707777Z [2024-03-28 00:00:06,372: INFO/ForkPoolWorker-5] Getting VIM list 2024-03-28T00:00:06.379226792Z [2024-03-28 00:00:06,378: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:06.396902820Z [2024-03-28 00:00:06,396: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T00:00:06.407017799Z [2024-03-28 00:00:06,406: INFO/ForkPoolWorker-4] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:06.407225401Z [2024-03-28 00:00:06,406: INFO/ForkPoolWorker-4] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:06.407522899Z [2024-03-28 00:00:06,407: INFO/ForkPoolWorker-4] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:06.407740074Z [2024-03-28 00:00:06,407: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T00:00:06.409878766Z [2024-03-28 00:00:06,409: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:06.414159525Z [2024-03-28 00:00:06,413: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:06.420051669Z [2024-03-28 00:00:06,419: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T00:00:06.425022442Z [2024-03-28 00:00:06,424: INFO/ForkPoolWorker-5] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:06.425472964Z [2024-03-28 00:00:06,425: INFO/ForkPoolWorker-5] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:06.425851826Z [2024-03-28 00:00:06,425: INFO/ForkPoolWorker-5] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:06.425990002Z [2024-03-28 00:00:06,425: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-03-28T00:00:06.426341738Z [2024-03-28 00:00:06,426: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:06.426495233Z [2024-03-28 00:00:06,426: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:06.438208465Z [2024-03-28 00:00:06,437: WARNING/ForkPoolWorker-5] Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:06.439081411Z [2024-03-28 00:00:06,438: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:06.440300487Z [2024-03-28 00:00:06,440: INFO/ForkPoolWorker-5] Getting VIM list 2024-03-28T00:00:06.443803216Z [2024-03-28 00:00:06,443: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:06.492472500Z [2024-03-28 00:00:06,492: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T00:00:06.494299804Z [2024-03-28 00:00:06,494: INFO/ForkPoolWorker-5] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:06.494406972Z [2024-03-28 00:00:06,494: INFO/ForkPoolWorker-5] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:06.494771453Z [2024-03-28 00:00:06,494: INFO/ForkPoolWorker-5] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:06.494877126Z [2024-03-28 00:00:06,494: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-03-28T00:00:06.495168864Z [2024-03-28 00:00:06,495: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:06.495308811Z [2024-03-28 00:00:06,495: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:06.500053814Z [2024-03-28 00:00:06,499: ERROR/ForkPoolWorker-5] [3e134951-4019-4b67-a052-f15bdc12a897] Failed to execute task Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:06.500084879Z Traceback (most recent call last): 2024-03-28T00:00:06.500089135Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:06.500092841Z args.func(args) 2024-03-28T00:00:06.500096487Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:06.500100388Z return func(*args, **kwargs) 2024-03-28T00:00:06.500103711Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:06.500106821Z return f(*args, **kwargs) 2024-03-28T00:00:06.500109934Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:06.500126410Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:06.500131261Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:06.500135590Z raise AirflowException( 2024-03-28T00:00:06.500140973Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:06.559828213Z [2024-03-28 00:00:06,559: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:06.580618395Z [2024-03-28 00:00:06,579: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[3e134951-4019-4b67-a052-f15bdc12a897] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3e134951-4019-4b67-a052-f15bdc12a897') 2024-03-28T00:00:06.580642913Z Traceback (most recent call last): 2024-03-28T00:00:06.580647264Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:06.580650666Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:06.580653839Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:06.580657281Z return self.run(*args, **kwargs) 2024-03-28T00:00:06.580661301Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:06.580665207Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:06.580668367Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:06.580672142Z raise AirflowException(msg) 2024-03-28T00:00:06.580676211Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3e134951-4019-4b67-a052-f15bdc12a897 2024-03-28T00:00:06.626687353Z [2024-03-28 00:00:06,626: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:00:06.631903484Z [2024-03-28 00:00:06,631: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:06.671299327Z [2024-03-28 00:00:06,670: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:00:06.673116664Z [2024-03-28 00:00:06,672: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:06.673172878Z [2024-03-28 00:00:06,673: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:06.673426736Z [2024-03-28 00:00:06,673: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:06.673599406Z [2024-03-28 00:00:06,673: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:00:06.675270407Z [2024-03-28 00:00:06,674: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:06.675587442Z [2024-03-28 00:00:06,675: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:06.807635338Z [2024-03-28 00:00:06,807: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:06.961144872Z [2024-03-28 00:00:06,960: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:00:06.974528605Z [2024-03-28 00:00:06,974: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.046688119Z [2024-03-28 00:00:07,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:00:07.050904325Z [2024-03-28 00:00:07,050: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.050925601Z [2024-03-28 00:00:07,050: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.051061872Z [2024-03-28 00:00:07,050: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.051160181Z [2024-03-28 00:00:07,051: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:00:07.051483161Z [2024-03-28 00:00:07,051: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:07.051891811Z [2024-03-28 00:00:07,051: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.082872886Z [2024-03-28 00:00:07,082: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:07.083734335Z [2024-03-28 00:00:07,083: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:07.088014923Z [2024-03-28 00:00:07,087: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:00:07.092566891Z [2024-03-28 00:00:07,092: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.225569255Z [2024-03-28 00:00:07,222: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:00:07.232219759Z [2024-03-28 00:00:07,225: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.232245727Z [2024-03-28 00:00:07,225: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.232252394Z [2024-03-28 00:00:07,225: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.232257960Z [2024-03-28 00:00:07,225: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:00:07.232263414Z [2024-03-28 00:00:07,226: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:07.232268881Z [2024-03-28 00:00:07,226: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.232274175Z [2024-03-28 00:00:07,231: ERROR/ForkPoolWorker-1] [eaf2fa77-ac2d-44f9-91c1-cf937644aeb0] Failed to execute task Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:07.232297724Z Traceback (most recent call last): 2024-03-28T00:00:07.232303007Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:07.232308209Z args.func(args) 2024-03-28T00:00:07.232312972Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:07.232317078Z return func(*args, **kwargs) 2024-03-28T00:00:07.232320402Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:07.232323717Z return f(*args, **kwargs) 2024-03-28T00:00:07.232326843Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:07.232330249Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:07.232333347Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:07.232336519Z raise AirflowException( 2024-03-28T00:00:07.232340272Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:07.242651437Z [2024-03-28 00:00:07,239: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:07.269963250Z [2024-03-28 00:00:07,267: INFO/ForkPoolWorker-6] Getting VIM list 2024-03-28T00:00:07.273494975Z [2024-03-28 00:00:07,272: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.281195196Z [2024-03-28 00:00:07,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.346961293Z [2024-03-28 00:00:07,346: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eaf2fa77-ac2d-44f9-91c1-cf937644aeb0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaf2fa77-ac2d-44f9-91c1-cf937644aeb0') 2024-03-28T00:00:07.346983147Z Traceback (most recent call last): 2024-03-28T00:00:07.346987705Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:07.346991174Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:07.346994379Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:07.346997603Z return self.run(*args, **kwargs) 2024-03-28T00:00:07.347001638Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:07.347005855Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:07.347009021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:07.347012825Z raise AirflowException(msg) 2024-03-28T00:00:07.347018089Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaf2fa77-ac2d-44f9-91c1-cf937644aeb0 2024-03-28T00:00:07.359299835Z [2024-03-28 00:00:07,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:07.361640918Z [2024-03-28 00:00:07,361: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.361680548Z [2024-03-28 00:00:07,361: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.361973257Z [2024-03-28 00:00:07,361: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.361994106Z [2024-03-28 00:00:07,361: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:07.362292779Z [2024-03-28 00:00:07,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:07.362447252Z [2024-03-28 00:00:07,362: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.364849754Z [2024-03-28 00:00:07,364: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-03-28T00:00:07.368066590Z [2024-03-28 00:00:07,367: INFO/ForkPoolWorker-6] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.368082080Z [2024-03-28 00:00:07,367: INFO/ForkPoolWorker-6] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.368481232Z [2024-03-28 00:00:07,368: INFO/ForkPoolWorker-6] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.368518084Z [2024-03-28 00:00:07,368: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-03-28T00:00:07.368936515Z [2024-03-28 00:00:07,368: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:07.369070304Z [2024-03-28 00:00:07,368: INFO/ForkPoolWorker-6] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.383165174Z [2024-03-28 00:00:07,382: WARNING/ForkPoolWorker-6] Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:07.384047319Z [2024-03-28 00:00:07,383: WARNING/ForkPoolWorker-15] Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:07.387492763Z [2024-03-28 00:00:07,386: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:07.388344753Z [2024-03-28 00:00:07,388: INFO/ForkPoolWorker-6] Getting VIM list 2024-03-28T00:00:07.389757743Z [2024-03-28 00:00:07,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:07.390585496Z [2024-03-28 00:00:07,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:07.402753352Z [2024-03-28 00:00:07,402: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.405539842Z [2024-03-28 00:00:07,405: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.446664236Z [2024-03-28 00:00:07,446: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:07.449222260Z [2024-03-28 00:00:07,448: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.451096149Z [2024-03-28 00:00:07,450: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.451487434Z [2024-03-28 00:00:07,451: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.451917796Z [2024-03-28 00:00:07,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:07.452319992Z [2024-03-28 00:00:07,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:07.452912849Z [2024-03-28 00:00:07,452: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.457793551Z [2024-03-28 00:00:07,457: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-03-28T00:00:07.460380218Z [2024-03-28 00:00:07,459: ERROR/ForkPoolWorker-15] [92d99da2-fdf6-4357-8d88-840184650145] Failed to execute task Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:07.460397160Z Traceback (most recent call last): 2024-03-28T00:00:07.460401855Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:07.460405895Z args.func(args) 2024-03-28T00:00:07.460409594Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:07.460413165Z return func(*args, **kwargs) 2024-03-28T00:00:07.460416308Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:07.460419429Z return f(*args, **kwargs) 2024-03-28T00:00:07.460422460Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:07.460425478Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:07.460428456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:07.460431598Z raise AirflowException( 2024-03-28T00:00:07.460435477Z airflow.exceptions.AirflowException: Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:07.461602659Z [2024-03-28 00:00:07,461: INFO/ForkPoolWorker-6] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.461894275Z [2024-03-28 00:00:07,461: INFO/ForkPoolWorker-6] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.462114536Z [2024-03-28 00:00:07,461: INFO/ForkPoolWorker-6] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.462271579Z [2024-03-28 00:00:07,462: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-03-28T00:00:07.462686233Z [2024-03-28 00:00:07,462: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:07.462792831Z [2024-03-28 00:00:07,462: INFO/ForkPoolWorker-6] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.468654040Z [2024-03-28 00:00:07,467: ERROR/ForkPoolWorker-6] [223ccc21-e147-4ff1-a4a0-d57eea095e62] Failed to execute task Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:07.468693533Z Traceback (most recent call last): 2024-03-28T00:00:07.468698093Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:07.468701956Z args.func(args) 2024-03-28T00:00:07.468705967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:07.468709692Z return func(*args, **kwargs) 2024-03-28T00:00:07.468712703Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:07.468715862Z return f(*args, **kwargs) 2024-03-28T00:00:07.468718923Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:07.468722041Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:07.468725017Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:07.468728479Z raise AirflowException( 2024-03-28T00:00:07.468732369Z airflow.exceptions.AirflowException: Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:07.538979764Z [2024-03-28 00:00:07,538: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[223ccc21-e147-4ff1-a4a0-d57eea095e62] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 223ccc21-e147-4ff1-a4a0-d57eea095e62') 2024-03-28T00:00:07.539003925Z Traceback (most recent call last): 2024-03-28T00:00:07.539008964Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:07.539012714Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:07.539015964Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:07.539019313Z return self.run(*args, **kwargs) 2024-03-28T00:00:07.539023264Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:07.539027219Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:07.539030509Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:07.539034219Z raise AirflowException(msg) 2024-03-28T00:00:07.539038155Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 223ccc21-e147-4ff1-a4a0-d57eea095e62 2024-03-28T00:00:07.563597341Z [2024-03-28 00:00:07,562: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92d99da2-fdf6-4357-8d88-840184650145] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 92d99da2-fdf6-4357-8d88-840184650145') 2024-03-28T00:00:07.563614275Z Traceback (most recent call last): 2024-03-28T00:00:07.563618424Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:07.563621703Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:07.563624881Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:07.563632870Z return self.run(*args, **kwargs) 2024-03-28T00:00:07.563636717Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:07.563653033Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:07.563656144Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:07.563659555Z raise AirflowException(msg) 2024-03-28T00:00:07.563663202Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 92d99da2-fdf6-4357-8d88-840184650145 2024-03-28T00:00:07.656877579Z [2024-03-28 00:00:07,656: INFO/ForkPoolWorker-9] Getting VIM list 2024-03-28T00:00:07.673668098Z [2024-03-28 00:00:07,673: INFO/ForkPoolWorker-9] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.707342165Z [2024-03-28 00:00:07,707: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:00:07.711011642Z [2024-03-28 00:00:07,710: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.726806898Z [2024-03-28 00:00:07,726: INFO/ForkPoolWorker-9] Connected to database osm version 1.2 2024-03-28T00:00:07.727970781Z [2024-03-28 00:00:07,727: INFO/ForkPoolWorker-9] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.727982339Z [2024-03-28 00:00:07,727: INFO/ForkPoolWorker-9] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.728180631Z [2024-03-28 00:00:07,728: INFO/ForkPoolWorker-9] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.728192811Z [2024-03-28 00:00:07,728: INFO/ForkPoolWorker-9] Getting VIM list OK 2024-03-28T00:00:07.728558770Z [2024-03-28 00:00:07,728: INFO/ForkPoolWorker-9] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:07.728650116Z [2024-03-28 00:00:07,728: INFO/ForkPoolWorker-9] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.777603380Z [2024-03-28 00:00:07,774: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:00:07.777627761Z [2024-03-28 00:00:07,776: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.777631180Z [2024-03-28 00:00:07,777: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.777634995Z [2024-03-28 00:00:07,777: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.777638844Z [2024-03-28 00:00:07,777: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:00:07.778030080Z [2024-03-28 00:00:07,777: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:07.778335498Z [2024-03-28 00:00:07,778: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.784908289Z [2024-03-28 00:00:07,784: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:07.786170146Z [2024-03-28 00:00:07,785: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:07.787501271Z [2024-03-28 00:00:07,786: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:00:07.789882110Z [2024-03-28 00:00:07,789: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:07.839622507Z [2024-03-28 00:00:07,838: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:00:07.841535358Z [2024-03-28 00:00:07,841: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:07.841658812Z [2024-03-28 00:00:07,841: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:07.841840235Z [2024-03-28 00:00:07,841: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:07.841927357Z [2024-03-28 00:00:07,841: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:00:07.842239250Z [2024-03-28 00:00:07,842: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:07.842411580Z [2024-03-28 00:00:07,842: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:07.847132536Z [2024-03-28 00:00:07,845: ERROR/ForkPoolWorker-2] [fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc] Failed to execute task Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:07.847152729Z Traceback (most recent call last): 2024-03-28T00:00:07.847158504Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:07.847163715Z args.func(args) 2024-03-28T00:00:07.847168601Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:07.847174143Z return func(*args, **kwargs) 2024-03-28T00:00:07.847178983Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:07.847183891Z return f(*args, **kwargs) 2024-03-28T00:00:07.847189560Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:07.847194306Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:07.847198715Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:07.847202917Z raise AirflowException( 2024-03-28T00:00:07.847208897Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:07.869641719Z [2024-03-28 00:00:07,868: INFO/ForkPoolWorker-9] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:07.888008698Z [2024-03-28 00:00:07,887: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc') 2024-03-28T00:00:07.888048564Z Traceback (most recent call last): 2024-03-28T00:00:07.888055512Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:07.888060700Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:07.888065217Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:07.888070808Z return self.run(*args, **kwargs) 2024-03-28T00:00:07.888075513Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:07.888080282Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:07.888085054Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:07.888090621Z raise AirflowException(msg) 2024-03-28T00:00:07.888096315Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fcb2e9b9-273e-4e69-a8d5-3971e6cacbbc 2024-03-28T00:00:08.538732430Z [2024-03-28 00:00:08,538: INFO/ForkPoolWorker-9] Task airflow.executors.celery_executor.execute_command[edca2ec9-7c90-4dd5-bedb-2dbf80a71848] succeeded in 6.348398326000051s: None 2024-03-28T00:00:09.116947565Z [2024-03-28 00:00:09,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ed6c197-f4a7-4f36-9582-52c325620260] received 2024-03-28T00:00:09.134842688Z [2024-03-28 00:00:09,134: INFO/ForkPoolWorker-15] [4ed6c197-f4a7-4f36-9582-52c325620260] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:09.275052448Z [2024-03-28 00:00:09,274: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[17a56b6c-cfc7-4e8b-bff7-e20d8a2bac4f] succeeded in 8.795469249999996s: None 2024-03-28T00:00:09.342064539Z [2024-03-28 00:00:09,341: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[14482dd3-7f5d-4eea-8640-14f563a99eb2] succeeded in 8.858908104999955s: None 2024-03-28T00:00:09.539800234Z [2024-03-28 00:00:09,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:11.410635801Z [2024-03-28 00:00:11,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:11.417288692Z [2024-03-28 00:00:11,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:11.466244320Z [2024-03-28 00:00:11,465: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:11.469374355Z [2024-03-28 00:00:11,469: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:11.469437409Z [2024-03-28 00:00:11,469: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:11.469611510Z [2024-03-28 00:00:11,469: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:11.469702898Z [2024-03-28 00:00:11,469: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:11.470119067Z [2024-03-28 00:00:11,469: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:11.470181451Z [2024-03-28 00:00:11,470: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:11.651632599Z [2024-03-28 00:00:11,651: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:12.394022041Z [2024-03-28 00:00:12,393: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ed6c197-f4a7-4f36-9582-52c325620260] succeeded in 3.2751685099999577s: None 2024-03-28T00:00:13.470269393Z [2024-03-28 00:00:13,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7c3f568-ada9-4c1e-964b-6399c546c2ca] received 2024-03-28T00:00:13.493324347Z [2024-03-28 00:00:13,492: INFO/ForkPoolWorker-15] [c7c3f568-ada9-4c1e-964b-6399c546c2ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:00:13.810179363Z [2024-03-28 00:00:13,806: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:14.955799427Z [2024-03-28 00:00:14,955: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:14.959448352Z [2024-03-28 00:00:14,958: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:14.982485669Z [2024-03-28 00:00:14,981: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:14.987694571Z [2024-03-28 00:00:14,987: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:14.987743326Z [2024-03-28 00:00:14,987: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:14.987950647Z [2024-03-28 00:00:14,987: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:14.988149271Z [2024-03-28 00:00:14,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:14.988984434Z [2024-03-28 00:00:14,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:14.989021246Z [2024-03-28 00:00:14,988: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:15.076669465Z [2024-03-28 00:00:15,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:15.667121313Z [2024-03-28 00:00:15,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7c3f568-ada9-4c1e-964b-6399c546c2ca] succeeded in 2.194751709000002s: None 2024-03-28T00:00:16.103583339Z [2024-03-28 00:00:16,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e13f5a6-0c9a-4aaa-9704-dcf39589341b] received 2024-03-28T00:00:16.109263754Z [2024-03-28 00:00:16,109: INFO/ForkPoolWorker-15] [9e13f5a6-0c9a-4aaa-9704-dcf39589341b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:16.292788644Z [2024-03-28 00:00:16,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fafa897b-5957-42a6-a8a5-924e82358a16] received 2024-03-28T00:00:16.298404886Z [2024-03-28 00:00:16,298: INFO/ForkPoolWorker-16] [fafa897b-5957-42a6-a8a5-924e82358a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:00:16.406272721Z [2024-03-28 00:00:16,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:16.613110391Z [2024-03-28 00:00:16,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:17.739659568Z [2024-03-28 00:00:17,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:17.743310356Z [2024-03-28 00:00:17,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:17.770971499Z [2024-03-28 00:00:17,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:17.772599802Z [2024-03-28 00:00:17,772: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:17.772722005Z [2024-03-28 00:00:17,772: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:17.772908862Z [2024-03-28 00:00:17,772: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:17.773017824Z [2024-03-28 00:00:17,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:17.773393025Z [2024-03-28 00:00:17,773: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:17.773604892Z [2024-03-28 00:00:17,773: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:17.778224771Z [2024-03-28 00:00:17,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4332b81e-8c90-4fd0-ac61-806d2b5a93dd] received 2024-03-28T00:00:17.789661722Z [2024-03-28 00:00:17,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[056d2dbf-6f49-4be7-b25e-f9dae2bb494d] received 2024-03-28T00:00:17.806715686Z [2024-03-28 00:00:17,806: INFO/ForkPoolWorker-2] [056d2dbf-6f49-4be7-b25e-f9dae2bb494d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:17.826014108Z [2024-03-28 00:00:17,825: INFO/ForkPoolWorker-1] [4332b81e-8c90-4fd0-ac61-806d2b5a93dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:00:17.882168465Z [2024-03-28 00:00:17,881: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:00:17.882928100Z [2024-03-28 00:00:17,882: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:00:17.885709751Z [2024-03-28 00:00:17,885: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:17.904304303Z [2024-03-28 00:00:17,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:00:17.905946889Z [2024-03-28 00:00:17,905: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:17.905964928Z [2024-03-28 00:00:17,905: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:17.906189111Z [2024-03-28 00:00:17,905: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:17.906272981Z [2024-03-28 00:00:17,906: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:00:17.906630595Z [2024-03-28 00:00:17,906: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:17.906680142Z [2024-03-28 00:00:17,906: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:17.916929331Z [2024-03-28 00:00:17,916: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:17.917974941Z [2024-03-28 00:00:17,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:17.918878057Z [2024-03-28 00:00:17,918: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:00:17.922048678Z [2024-03-28 00:00:17,921: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:17.959090165Z [2024-03-28 00:00:17,958: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:00:17.960361440Z [2024-03-28 00:00:17,960: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:17.960447224Z [2024-03-28 00:00:17,960: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:17.960674696Z [2024-03-28 00:00:17,960: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:17.960764017Z [2024-03-28 00:00:17,960: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:00:17.961114468Z [2024-03-28 00:00:17,960: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:17.961209465Z [2024-03-28 00:00:17,961: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:17.966629927Z [2024-03-28 00:00:17,966: ERROR/ForkPoolWorker-16] [fafa897b-5957-42a6-a8a5-924e82358a16] Failed to execute task Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:17.966648948Z Traceback (most recent call last): 2024-03-28T00:00:17.966653088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:17.966670012Z args.func(args) 2024-03-28T00:00:17.966674012Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:17.966677804Z return func(*args, **kwargs) 2024-03-28T00:00:17.966680973Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:17.966684020Z return f(*args, **kwargs) 2024-03-28T00:00:17.966687088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:17.966690245Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:17.966693304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:17.966696346Z raise AirflowException( 2024-03-28T00:00:17.966700158Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:18.058796250Z [2024-03-28 00:00:18,058: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fafa897b-5957-42a6-a8a5-924e82358a16] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fafa897b-5957-42a6-a8a5-924e82358a16') 2024-03-28T00:00:18.058817862Z Traceback (most recent call last): 2024-03-28T00:00:18.058822325Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:18.058826145Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:18.058829305Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:18.058832613Z return self.run(*args, **kwargs) 2024-03-28T00:00:18.058836607Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:18.058840631Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:18.058843771Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:18.058847266Z raise AirflowException(msg) 2024-03-28T00:00:18.058851026Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fafa897b-5957-42a6-a8a5-924e82358a16 2024-03-28T00:00:18.229276009Z [2024-03-28 00:00:18,221: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:18.317629840Z [2024-03-28 00:00:18,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe540ca9-15ed-4877-b2a6-14051265cd6e] received 2024-03-28T00:00:18.320860164Z [2024-03-28 00:00:18,315: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:18.326014397Z [2024-03-28 00:00:18,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da3584af-7dfd-40ac-9b33-bba69c15e544] received 2024-03-28T00:00:18.338256040Z [2024-03-28 00:00:18,338: INFO/ForkPoolWorker-16] [fe540ca9-15ed-4877-b2a6-14051265cd6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-27T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:00:18.445769018Z [2024-03-28 00:00:18,442: INFO/ForkPoolWorker-3] [da3584af-7dfd-40ac-9b33-bba69c15e544] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:00:18.790327795Z [2024-03-28 00:00:18,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e13f5a6-0c9a-4aaa-9704-dcf39589341b] succeeded in 2.685178318999988s: None 2024-03-28T00:00:19.036728047Z [2024-03-28 00:00:19,033: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:19.083568630Z [2024-03-28 00:00:19,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:19.514415256Z [2024-03-28 00:00:19,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edaf0586-db7e-42c0-a2b7-7428c377422b] received 2024-03-28T00:00:19.534254145Z [2024-03-28 00:00:19,534: INFO/ForkPoolWorker-15] [edaf0586-db7e-42c0-a2b7-7428c377422b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-27T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:00:19.742504466Z [2024-03-28 00:00:19,742: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:00:19.754548632Z [2024-03-28 00:00:19,754: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:19.813167699Z [2024-03-28 00:00:19,812: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:00:19.814855997Z [2024-03-28 00:00:19,814: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:19.815491849Z [2024-03-28 00:00:19,814: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:19.815704751Z [2024-03-28 00:00:19,815: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:19.815830935Z [2024-03-28 00:00:19,815: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:00:19.816185438Z [2024-03-28 00:00:19,816: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:19.816308197Z [2024-03-28 00:00:19,816: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:19.826967161Z [2024-03-28 00:00:19,826: WARNING/ForkPoolWorker-1] Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:19.828023425Z [2024-03-28 00:00:19,827: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:19.834285545Z [2024-03-28 00:00:19,834: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:00:19.841096265Z [2024-03-28 00:00:19,840: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:19.881088099Z [2024-03-28 00:00:19,880: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:00:19.886650197Z [2024-03-28 00:00:19,886: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:19.886783036Z [2024-03-28 00:00:19,886: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:19.887009837Z [2024-03-28 00:00:19,886: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:19.887127992Z [2024-03-28 00:00:19,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:00:19.887465633Z [2024-03-28 00:00:19,887: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:19.887589995Z [2024-03-28 00:00:19,887: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:19.891221882Z [2024-03-28 00:00:19,890: ERROR/ForkPoolWorker-1] [4332b81e-8c90-4fd0-ac61-806d2b5a93dd] Failed to execute task Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:19.891238441Z Traceback (most recent call last): 2024-03-28T00:00:19.891242927Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:19.891247595Z args.func(args) 2024-03-28T00:00:19.891251472Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:19.891255278Z return func(*args, **kwargs) 2024-03-28T00:00:19.891258444Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:19.891266630Z return f(*args, **kwargs) 2024-03-28T00:00:19.891270052Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:19.891273659Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:19.891276786Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:19.891280066Z raise AirflowException( 2024-03-28T00:00:19.891284073Z airflow.exceptions.AirflowException: Dag 'vim_status_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:19.966075148Z [2024-03-28 00:00:19,965: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4332b81e-8c90-4fd0-ac61-806d2b5a93dd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4332b81e-8c90-4fd0-ac61-806d2b5a93dd') 2024-03-28T00:00:19.966094259Z Traceback (most recent call last): 2024-03-28T00:00:19.966098093Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:19.966101288Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:19.966104300Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:19.966108316Z return self.run(*args, **kwargs) 2024-03-28T00:00:19.966112253Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:19.966115725Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:19.966118701Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:19.966122087Z raise AirflowException(msg) 2024-03-28T00:00:19.966125432Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4332b81e-8c90-4fd0-ac61-806d2b5a93dd 2024-03-28T00:00:20.064195426Z [2024-03-28 00:00:20,063: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:00:20.068350497Z [2024-03-28 00:00:20,067: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.103313232Z [2024-03-28 00:00:20,103: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:00:20.104511563Z [2024-03-28 00:00:20,104: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.104526692Z [2024-03-28 00:00:20,104: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.104705397Z [2024-03-28 00:00:20,104: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.104786396Z [2024-03-28 00:00:20,104: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:00:20.105126943Z [2024-03-28 00:00:20,104: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:20.105203608Z [2024-03-28 00:00:20,105: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.111383104Z [2024-03-28 00:00:20,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:20.117984155Z [2024-03-28 00:00:20,117: WARNING/ForkPoolWorker-2] Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:20.119270211Z [2024-03-28 00:00:20,118: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:20.121203036Z [2024-03-28 00:00:20,121: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:00:20.125954947Z [2024-03-28 00:00:20,125: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.174966978Z [2024-03-28 00:00:20,174: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:00:20.179604854Z [2024-03-28 00:00:20,179: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.179625422Z [2024-03-28 00:00:20,179: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.179830758Z [2024-03-28 00:00:20,179: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.180085089Z [2024-03-28 00:00:20,179: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:00:20.181623742Z [2024-03-28 00:00:20,181: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:20.185729754Z [2024-03-28 00:00:20,181: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.198248619Z [2024-03-28 00:00:20,188: ERROR/ForkPoolWorker-2] [056d2dbf-6f49-4be7-b25e-f9dae2bb494d] Failed to execute task Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:20.198297867Z Traceback (most recent call last): 2024-03-28T00:00:20.198303039Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:20.198306739Z args.func(args) 2024-03-28T00:00:20.198310443Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:20.198313905Z return func(*args, **kwargs) 2024-03-28T00:00:20.198316997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:20.198320058Z return f(*args, **kwargs) 2024-03-28T00:00:20.198323060Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:20.198326793Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:20.198330102Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:20.198333421Z raise AirflowException( 2024-03-28T00:00:20.198337000Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:20.245751425Z [2024-03-28 00:00:20,245: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[056d2dbf-6f49-4be7-b25e-f9dae2bb494d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 056d2dbf-6f49-4be7-b25e-f9dae2bb494d') 2024-03-28T00:00:20.245773106Z Traceback (most recent call last): 2024-03-28T00:00:20.245777312Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:20.245780571Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:20.245783825Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:20.245786867Z return self.run(*args, **kwargs) 2024-03-28T00:00:20.245790802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:20.245794261Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:20.245797446Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:20.245800943Z raise AirflowException(msg) 2024-03-28T00:00:20.245804293Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 056d2dbf-6f49-4be7-b25e-f9dae2bb494d 2024-03-28T00:00:20.517556508Z [2024-03-28 00:00:20,517: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:00:20.520786182Z [2024-03-28 00:00:20,520: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.538576403Z [2024-03-28 00:00:20,538: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:00:20.539716100Z [2024-03-28 00:00:20,539: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.539735408Z [2024-03-28 00:00:20,539: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.539865870Z [2024-03-28 00:00:20,539: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.539878037Z [2024-03-28 00:00:20,539: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:00:20.540094046Z [2024-03-28 00:00:20,539: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:20.540112289Z [2024-03-28 00:00:20,540: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.546866203Z [2024-03-28 00:00:20,546: WARNING/ForkPoolWorker-3] Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:20.547515257Z [2024-03-28 00:00:20,546: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:00:20.548712171Z [2024-03-28 00:00:20,548: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:00:20.551341508Z [2024-03-28 00:00:20,551: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.566972401Z [2024-03-28 00:00:20,566: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:00:20.568502727Z [2024-03-28 00:00:20,568: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.568519000Z [2024-03-28 00:00:20,568: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.568653848Z [2024-03-28 00:00:20,568: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.568699638Z [2024-03-28 00:00:20,568: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:00:20.568934948Z [2024-03-28 00:00:20,568: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:00:20.569409616Z [2024-03-28 00:00:20,569: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.573556926Z [2024-03-28 00:00:20,572: ERROR/ForkPoolWorker-3] [da3584af-7dfd-40ac-9b33-bba69c15e544] Failed to execute task Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:20.573574460Z Traceback (most recent call last): 2024-03-28T00:00:20.573579431Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:20.573583473Z args.func(args) 2024-03-28T00:00:20.573587167Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:20.573591907Z return func(*args, **kwargs) 2024-03-28T00:00:20.573595000Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:20.573598390Z return f(*args, **kwargs) 2024-03-28T00:00:20.573601726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:20.573604990Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:20.573608369Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:20.573623985Z raise AirflowException( 2024-03-28T00:00:20.573628560Z airflow.exceptions.AirflowException: Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:20.605635320Z [2024-03-28 00:00:20,605: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[da3584af-7dfd-40ac-9b33-bba69c15e544] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id da3584af-7dfd-40ac-9b33-bba69c15e544') 2024-03-28T00:00:20.605654082Z Traceback (most recent call last): 2024-03-28T00:00:20.605659812Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:20.605664753Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:20.605669383Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:20.605673733Z return self.run(*args, **kwargs) 2024-03-28T00:00:20.605698448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:20.605703907Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:20.605707468Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:20.605712516Z raise AirflowException(msg) 2024-03-28T00:00:20.605716462Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id da3584af-7dfd-40ac-9b33-bba69c15e544 2024-03-28T00:00:20.659123986Z [2024-03-28 00:00:20,658: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:00:20.662575557Z [2024-03-28 00:00:20,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.680163931Z [2024-03-28 00:00:20,679: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:00:20.681308324Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.681385686Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.681595055Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.681657761Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:00:20.681938957Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:20.682048625Z [2024-03-28 00:00:20,681: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.689753565Z [2024-03-28 00:00:20,689: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:20.690604677Z [2024-03-28 00:00:20,689: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:00:20.691531682Z [2024-03-28 00:00:20,691: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:00:20.694493649Z [2024-03-28 00:00:20,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:20.704192682Z [2024-03-28 00:00:20,704: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:00:20.705709145Z [2024-03-28 00:00:20,705: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:20.705775812Z [2024-03-28 00:00:20,705: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:20.705953009Z [2024-03-28 00:00:20,705: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:20.706016136Z [2024-03-28 00:00:20,705: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:00:20.706259749Z [2024-03-28 00:00:20,706: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:00:20.706337786Z [2024-03-28 00:00:20,706: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:20.710279156Z [2024-03-28 00:00:20,709: ERROR/ForkPoolWorker-16] [fe540ca9-15ed-4877-b2a6-14051265cd6e] Failed to execute task Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:20.710294801Z Traceback (most recent call last): 2024-03-28T00:00:20.710300068Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:20.710304878Z args.func(args) 2024-03-28T00:00:20.710309862Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:20.710314944Z return func(*args, **kwargs) 2024-03-28T00:00:20.710319135Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:20.710323850Z return f(*args, **kwargs) 2024-03-28T00:00:20.710327964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:20.710332018Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:20.710336045Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:20.710340089Z raise AirflowException( 2024-03-28T00:00:20.710344942Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:20.745121205Z [2024-03-28 00:00:20,744: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe540ca9-15ed-4877-b2a6-14051265cd6e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fe540ca9-15ed-4877-b2a6-14051265cd6e') 2024-03-28T00:00:20.745141455Z Traceback (most recent call last): 2024-03-28T00:00:20.745146645Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:20.745151037Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:20.745155198Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:20.745159431Z return self.run(*args, **kwargs) 2024-03-28T00:00:20.745179519Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:20.745184789Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:20.745188896Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:20.745193618Z raise AirflowException(msg) 2024-03-28T00:00:20.745198650Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fe540ca9-15ed-4877-b2a6-14051265cd6e 2024-03-28T00:00:21.344050938Z [2024-03-28 00:00:21,343: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:21.347437573Z [2024-03-28 00:00:21,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:21.367429564Z [2024-03-28 00:00:21,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:21.368909162Z [2024-03-28 00:00:21,368: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:21.368940449Z [2024-03-28 00:00:21,368: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:21.369074038Z [2024-03-28 00:00:21,368: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:21.369087192Z [2024-03-28 00:00:21,369: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:21.369407656Z [2024-03-28 00:00:21,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:21.369552926Z [2024-03-28 00:00:21,369: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:21.376957511Z [2024-03-28 00:00:21,376: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:21.377838868Z [2024-03-28 00:00:21,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:00:21.378709719Z [2024-03-28 00:00:21,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:00:21.381417518Z [2024-03-28 00:00:21,381: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:00:21.395951047Z [2024-03-28 00:00:21,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:00:21.397255480Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:00:21.397274144Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:00:21.397413485Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:00:21.397436540Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:00:21.397846003Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:00:21.397890505Z [2024-03-28 00:00:21,397: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:00:21.401579368Z [2024-03-28 00:00:21,400: ERROR/ForkPoolWorker-15] [edaf0586-db7e-42c0-a2b7-7428c377422b] Failed to execute task Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:00:21.401597221Z Traceback (most recent call last): 2024-03-28T00:00:21.401602419Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:00:21.401606640Z args.func(args) 2024-03-28T00:00:21.401610464Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:00:21.401613930Z return func(*args, **kwargs) 2024-03-28T00:00:21.401616939Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:00:21.401620036Z return f(*args, **kwargs) 2024-03-28T00:00:21.401622986Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:00:21.401626263Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:00:21.401629289Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:00:21.401632169Z raise AirflowException( 2024-03-28T00:00:21.401635647Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ee3403fc-9b1e-4bd6-ae3f-4a031eca0dd5' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:00:21.438972910Z [2024-03-28 00:00:21,438: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edaf0586-db7e-42c0-a2b7-7428c377422b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id edaf0586-db7e-42c0-a2b7-7428c377422b') 2024-03-28T00:00:21.438999182Z Traceback (most recent call last): 2024-03-28T00:00:21.439005389Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:00:21.439010124Z R = retval = fun(*args, **kwargs) 2024-03-28T00:00:21.439014257Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:00:21.439017730Z return self.run(*args, **kwargs) 2024-03-28T00:00:21.439021661Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:00:21.439025243Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:00:21.439028355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:00:21.439031935Z raise AirflowException(msg) 2024-03-28T00:00:21.439035978Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id edaf0586-db7e-42c0-a2b7-7428c377422b 2024-03-28T00:01:00.974941270Z [2024-03-28 00:01:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55d2106f-9ec2-4cec-bf77-e3b9e90682a7] received 2024-03-28T00:01:00.977105969Z [2024-03-28 00:01:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a5f5e2-a6d4-4b0b-9f89-75d021e7cf70] received 2024-03-28T00:01:00.986068310Z [2024-03-28 00:01:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfed519d-abf7-4311-86eb-ec776bf5f0d0] received 2024-03-28T00:01:00.989309785Z [2024-03-28 00:01:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a35416eb-61dd-4c49-94bf-78faa5e6cce5] received 2024-03-28T00:01:00.990175023Z [2024-03-28 00:01:00,989: INFO/ForkPoolWorker-16] [a0a5f5e2-a6d4-4b0b-9f89-75d021e7cf70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:01:00.995039098Z [2024-03-28 00:01:00,994: INFO/ForkPoolWorker-1] [dfed519d-abf7-4311-86eb-ec776bf5f0d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:01:00.997828403Z [2024-03-28 00:01:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbe90453-749a-4d75-b079-7f2f726b99a4] received 2024-03-28T00:01:00.998631939Z [2024-03-28 00:01:00,989: INFO/ForkPoolWorker-15] [55d2106f-9ec2-4cec-bf77-e3b9e90682a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:01:00.999612423Z [2024-03-28 00:01:00,999: INFO/ForkPoolWorker-2] [a35416eb-61dd-4c49-94bf-78faa5e6cce5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:01:01.021155374Z [2024-03-28 00:01:01,020: INFO/ForkPoolWorker-3] [dbe90453-749a-4d75-b079-7f2f726b99a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:01:01.481658174Z [2024-03-28 00:01:01,477: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:01.519966950Z [2024-03-28 00:01:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:01.527479964Z [2024-03-28 00:01:01,523: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:01:01.556818937Z [2024-03-28 00:01:01,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:01.865647915Z [2024-03-28 00:01:01,849: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:01.888318955Z [2024-03-28 00:01:01,887: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T00:01:01.892800938Z [2024-03-28 00:01:01,892: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:01.936464561Z [2024-03-28 00:01:01,936: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:01:01.938477656Z [2024-03-28 00:01:01,938: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:01:01.938784057Z [2024-03-28 00:01:01,938: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:01:01.938933175Z [2024-03-28 00:01:01,938: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T00:01:01.939265584Z [2024-03-28 00:01:01,939: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:01:02.099127430Z [2024-03-28 00:01:02,098: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:01:02.830383498Z [2024-03-28 00:01:02,829: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[dbe90453-749a-4d75-b079-7f2f726b99a4] succeeded in 1.8296951500001342s: None 2024-03-28T00:01:03.160682447Z [2024-03-28 00:01:03,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:01:03.164664193Z [2024-03-28 00:01:03,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.189165940Z [2024-03-28 00:01:03,188: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:01:03.191688144Z [2024-03-28 00:01:03,191: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.191728800Z [2024-03-28 00:01:03,191: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.191834812Z [2024-03-28 00:01:03,191: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.191875959Z [2024-03-28 00:01:03,191: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:01:03.192175204Z [2024-03-28 00:01:03,192: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:01:03.192185687Z [2024-03-28 00:01:03,192: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:03.285306304Z [2024-03-28 00:01:03,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:01:03.719562264Z [2024-03-28 00:01:03,719: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:01:03.723332000Z [2024-03-28 00:01:03,722: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.754374224Z [2024-03-28 00:01:03,754: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:01:03.755634390Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.755677470Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.755755486Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.755811184Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:01:03.756030307Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:01:03.756066407Z [2024-03-28 00:01:03,755: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:03.764629136Z [2024-03-28 00:01:03,764: WARNING/ForkPoolWorker-2] Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:03.765616478Z [2024-03-28 00:01:03,764: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:03.766716403Z [2024-03-28 00:01:03,766: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:01:03.769771197Z [2024-03-28 00:01:03,769: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.782800585Z [2024-03-28 00:01:03,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:01:03.785331118Z [2024-03-28 00:01:03,785: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:01:03.787069324Z [2024-03-28 00:01:03,786: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.787371802Z [2024-03-28 00:01:03,787: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.787417749Z [2024-03-28 00:01:03,787: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.787650888Z [2024-03-28 00:01:03,787: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.787749501Z [2024-03-28 00:01:03,787: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:01:03.788437729Z [2024-03-28 00:01:03,788: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:01:03.788711209Z [2024-03-28 00:01:03,788: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:03.792281495Z [2024-03-28 00:01:03,791: ERROR/ForkPoolWorker-2] [a35416eb-61dd-4c49-94bf-78faa5e6cce5] Failed to execute task Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:01:03.792299938Z Traceback (most recent call last): 2024-03-28T00:01:03.792304043Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:01:03.792307933Z args.func(args) 2024-03-28T00:01:03.792311779Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:01:03.792315627Z return func(*args, **kwargs) 2024-03-28T00:01:03.792319430Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:01:03.792322617Z return f(*args, **kwargs) 2024-03-28T00:01:03.792326144Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:01:03.792344230Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:01:03.792347704Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:01:03.792350934Z raise AirflowException( 2024-03-28T00:01:03.792356639Z airflow.exceptions.AirflowException: Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:01:03.824051153Z [2024-03-28 00:01:03,823: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:01:03.826577973Z [2024-03-28 00:01:03,826: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.826791671Z [2024-03-28 00:01:03,826: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.827014926Z [2024-03-28 00:01:03,826: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.827170905Z [2024-03-28 00:01:03,827: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:01:03.827527528Z [2024-03-28 00:01:03,827: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:01:03.827699059Z [2024-03-28 00:01:03,827: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:03.836261772Z [2024-03-28 00:01:03,836: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:03.838924983Z [2024-03-28 00:01:03,838: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a35416eb-61dd-4c49-94bf-78faa5e6cce5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a35416eb-61dd-4c49-94bf-78faa5e6cce5') 2024-03-28T00:01:03.838943422Z Traceback (most recent call last): 2024-03-28T00:01:03.838947578Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:01:03.838950703Z R = retval = fun(*args, **kwargs) 2024-03-28T00:01:03.838953769Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:01:03.838957702Z return self.run(*args, **kwargs) 2024-03-28T00:01:03.838961704Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:01:03.838965304Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:01:03.838968373Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:01:03.838973433Z raise AirflowException(msg) 2024-03-28T00:01:03.838977474Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a35416eb-61dd-4c49-94bf-78faa5e6cce5 2024-03-28T00:01:03.842318770Z [2024-03-28 00:01:03,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:03.854692311Z [2024-03-28 00:01:03,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:01:03.857871084Z [2024-03-28 00:01:03,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.869259977Z [2024-03-28 00:01:03,868: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:01:03.871483111Z [2024-03-28 00:01:03,871: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.871716257Z [2024-03-28 00:01:03,871: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.871918019Z [2024-03-28 00:01:03,871: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.872061764Z [2024-03-28 00:01:03,871: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:01:03.872467729Z [2024-03-28 00:01:03,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:01:03.872613830Z [2024-03-28 00:01:03,872: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:03.876439700Z [2024-03-28 00:01:03,875: ERROR/ForkPoolWorker-15] [55d2106f-9ec2-4cec-bf77-e3b9e90682a7] Failed to execute task Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:01:03.876452014Z Traceback (most recent call last): 2024-03-28T00:01:03.876456039Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:01:03.876459716Z args.func(args) 2024-03-28T00:01:03.876463798Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:01:03.876467687Z return func(*args, **kwargs) 2024-03-28T00:01:03.876470773Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:01:03.876474016Z return f(*args, **kwargs) 2024-03-28T00:01:03.876477087Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:01:03.876480207Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:01:03.876483246Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:01:03.876486305Z raise AirflowException( 2024-03-28T00:01:03.876490633Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:01:03.900117357Z [2024-03-28 00:01:03,899: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:01:03.903502532Z [2024-03-28 00:01:03,903: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:03.920222132Z [2024-03-28 00:01:03,919: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55d2106f-9ec2-4cec-bf77-e3b9e90682a7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 55d2106f-9ec2-4cec-bf77-e3b9e90682a7') 2024-03-28T00:01:03.920235562Z Traceback (most recent call last): 2024-03-28T00:01:03.920239536Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:01:03.920242997Z R = retval = fun(*args, **kwargs) 2024-03-28T00:01:03.920259052Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:01:03.920262110Z return self.run(*args, **kwargs) 2024-03-28T00:01:03.920265918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:01:03.920269422Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:01:03.920272530Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:01:03.920276265Z raise AirflowException(msg) 2024-03-28T00:01:03.920280003Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 55d2106f-9ec2-4cec-bf77-e3b9e90682a7 2024-03-28T00:01:03.921698819Z [2024-03-28 00:01:03,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:01:03.923714153Z [2024-03-28 00:01:03,923: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:03.923733588Z [2024-03-28 00:01:03,923: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:03.923856631Z [2024-03-28 00:01:03,923: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:03.923903238Z [2024-03-28 00:01:03,923: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:01:03.924548160Z [2024-03-28 00:01:03,924: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:01:03.924762409Z [2024-03-28 00:01:03,924: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:04.025252820Z [2024-03-28 00:01:04,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:01:05.124771305Z [2024-03-28 00:01:05,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dfed519d-abf7-4311-86eb-ec776bf5f0d0] succeeded in 4.136741129000029s: None 2024-03-28T00:01:06.121252061Z [2024-03-28 00:01:06,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0a5f5e2-a6d4-4b0b-9f89-75d021e7cf70] succeeded in 5.142289783000024s: None 2024-03-28T00:01:15.104183307Z [2024-03-28 00:01:15,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dd7a3b3-a538-41d1-890a-79361b1b0570] received 2024-03-28T00:01:15.112839159Z [2024-03-28 00:01:15,112: INFO/ForkPoolWorker-15] [8dd7a3b3-a538-41d1-890a-79361b1b0570] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:01:15.126245686Z [2024-03-28 00:01:15,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ebb4e02-4d07-40e1-9855-4b8421031ffc] received 2024-03-28T00:01:15.143301169Z [2024-03-28 00:01:15,142: INFO/ForkPoolWorker-16] [7ebb4e02-4d07-40e1-9855-4b8421031ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:01:15.450709946Z [2024-03-28 00:01:15,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:15.481086799Z [2024-03-28 00:01:15,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:16.593883363Z [2024-03-28 00:01:16,593: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:01:16.597180998Z [2024-03-28 00:01:16,596: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:16.599324557Z [2024-03-28 00:01:16,599: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:01:16.602576517Z [2024-03-28 00:01:16,602: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:16.621121645Z [2024-03-28 00:01:16,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:01:16.624066307Z [2024-03-28 00:01:16,623: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:16.624183762Z [2024-03-28 00:01:16,624: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:16.624917892Z [2024-03-28 00:01:16,624: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:16.625057662Z [2024-03-28 00:01:16,624: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:01:16.625960191Z [2024-03-28 00:01:16,625: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:01:16.626041614Z [2024-03-28 00:01:16,625: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:16.626313858Z [2024-03-28 00:01:16,626: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:01:16.627639591Z [2024-03-28 00:01:16,627: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:16.627814533Z [2024-03-28 00:01:16,627: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:16.628018181Z [2024-03-28 00:01:16,627: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:16.628146462Z [2024-03-28 00:01:16,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:01:16.628427948Z [2024-03-28 00:01:16,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:01:16.628558873Z [2024-03-28 00:01:16,628: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:16.633378278Z [2024-03-28 00:01:16,633: WARNING/ForkPoolWorker-16] Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:16.634434543Z [2024-03-28 00:01:16,634: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:16.634508676Z [2024-03-28 00:01:16,633: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:01:16.635399809Z [2024-03-28 00:01:16,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:01:16.635661632Z [2024-03-28 00:01:16,635: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:01:16.636140854Z [2024-03-28 00:01:16,635: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:01:16.638781120Z [2024-03-28 00:01:16,638: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:16.639812897Z [2024-03-28 00:01:16,639: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:01:16.652818787Z [2024-03-28 00:01:16,652: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:01:16.654441723Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:16.654505525Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:16.654608607Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:16.654701328Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:01:16.654914282Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:01:16.654979915Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:16.654984659Z [2024-03-28 00:01:16,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:01:16.656653155Z [2024-03-28 00:01:16,656: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:01:16.656746141Z [2024-03-28 00:01:16,656: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:01:16.656870077Z [2024-03-28 00:01:16,656: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:01:16.656910014Z [2024-03-28 00:01:16,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:01:16.657241347Z [2024-03-28 00:01:16,657: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:01:16.657398211Z [2024-03-28 00:01:16,657: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:01:16.658630981Z [2024-03-28 00:01:16,657: ERROR/ForkPoolWorker-15] [8dd7a3b3-a538-41d1-890a-79361b1b0570] Failed to execute task Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:01:16.658645485Z Traceback (most recent call last): 2024-03-28T00:01:16.658651228Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:01:16.658679547Z args.func(args) 2024-03-28T00:01:16.658684817Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:01:16.658690340Z return func(*args, **kwargs) 2024-03-28T00:01:16.658694913Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:01:16.658699506Z return f(*args, **kwargs) 2024-03-28T00:01:16.658708175Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:01:16.658712866Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:01:16.658728436Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:01:16.658732612Z raise AirflowException( 2024-03-28T00:01:16.658737511Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:01:16.663355681Z [2024-03-28 00:01:16,662: ERROR/ForkPoolWorker-16] [7ebb4e02-4d07-40e1-9855-4b8421031ffc] Failed to execute task Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:01:16.663372390Z Traceback (most recent call last): 2024-03-28T00:01:16.663376505Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:01:16.663388472Z args.func(args) 2024-03-28T00:01:16.663392170Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:01:16.663395943Z return func(*args, **kwargs) 2024-03-28T00:01:16.663399033Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:01:16.663402038Z return f(*args, **kwargs) 2024-03-28T00:01:16.663405044Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:01:16.663408126Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:01:16.663411217Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:01:16.663414192Z raise AirflowException( 2024-03-28T00:01:16.663420579Z airflow.exceptions.AirflowException: Dag 'vim_status_28ce5a1c-c069-48dc-b943-696c30dae783' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:01:16.695852103Z [2024-03-28 00:01:16,694: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8dd7a3b3-a538-41d1-890a-79361b1b0570] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8dd7a3b3-a538-41d1-890a-79361b1b0570') 2024-03-28T00:01:16.695879148Z Traceback (most recent call last): 2024-03-28T00:01:16.695883265Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:01:16.695886440Z R = retval = fun(*args, **kwargs) 2024-03-28T00:01:16.695889689Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:01:16.695892754Z return self.run(*args, **kwargs) 2024-03-28T00:01:16.695896434Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:01:16.695899923Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:01:16.695903029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:01:16.695917919Z raise AirflowException(msg) 2024-03-28T00:01:16.695921709Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8dd7a3b3-a538-41d1-890a-79361b1b0570 2024-03-28T00:01:16.698503828Z [2024-03-28 00:01:16,696: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ebb4e02-4d07-40e1-9855-4b8421031ffc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7ebb4e02-4d07-40e1-9855-4b8421031ffc') 2024-03-28T00:01:16.698564822Z Traceback (most recent call last): 2024-03-28T00:01:16.698572328Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:01:16.698575777Z R = retval = fun(*args, **kwargs) 2024-03-28T00:01:16.698579171Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:01:16.698582340Z return self.run(*args, **kwargs) 2024-03-28T00:01:16.698585847Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:01:16.698589915Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:01:16.698593254Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:01:16.698597110Z raise AirflowException(msg) 2024-03-28T00:01:16.698600858Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7ebb4e02-4d07-40e1-9855-4b8421031ffc 2024-03-28T00:02:00.319740485Z [2024-03-28 00:02:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ddf23e3-5b62-4559-b5f7-6d2f83196028] received 2024-03-28T00:02:00.323375606Z [2024-03-28 00:02:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55416b55-188a-499c-a446-34007a718277] received 2024-03-28T00:02:00.330661116Z [2024-03-28 00:02:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e66d497-910f-4615-9c83-0e445a3bc832] received 2024-03-28T00:02:00.331545892Z [2024-03-28 00:02:00,331: INFO/ForkPoolWorker-16] [55416b55-188a-499c-a446-34007a718277] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:02:00.333951925Z [2024-03-28 00:02:00,333: INFO/ForkPoolWorker-15] [4ddf23e3-5b62-4559-b5f7-6d2f83196028] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:02:00.342211018Z [2024-03-28 00:02:00,341: INFO/ForkPoolWorker-1] [5e66d497-910f-4615-9c83-0e445a3bc832] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:02:00.350127916Z [2024-03-28 00:02:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c42205c3-7555-4df2-beb8-9466de852623] received 2024-03-28T00:02:00.365382180Z [2024-03-28 00:02:00,365: INFO/ForkPoolWorker-2] [c42205c3-7555-4df2-beb8-9466de852623] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:02:00.740777654Z [2024-03-28 00:02:00,737: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:02:00.744279942Z [2024-03-28 00:02:00,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:02:00.758521384Z [2024-03-28 00:02:00,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:02:00.797852728Z [2024-03-28 00:02:00,794: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:02:00.909870034Z [2024-03-28 00:02:00,909: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:02:00.914090789Z [2024-03-28 00:02:00,913: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:02:00.939269265Z [2024-03-28 00:02:00,939: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:02:00.940906720Z [2024-03-28 00:02:00,940: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:02:00.941147710Z [2024-03-28 00:02:00,940: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:02:00.941335751Z [2024-03-28 00:02:00,941: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:02:00.941794732Z [2024-03-28 00:02:00,941: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:02:01.066601080Z [2024-03-28 00:02:01,066: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:02:01.070066817Z [2024-03-28 00:02:01,069: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:02:01.778426850Z [2024-03-28 00:02:01,777: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e66d497-910f-4615-9c83-0e445a3bc832] succeeded in 1.4458164830000442s: None 2024-03-28T00:02:01.910239969Z [2024-03-28 00:02:01,909: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c42205c3-7555-4df2-beb8-9466de852623] succeeded in 1.5586098420001235s: None 2024-03-28T00:02:02.132900657Z [2024-03-28 00:02:02,132: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:02:02.136625980Z [2024-03-28 00:02:02,136: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:02:02.165105992Z [2024-03-28 00:02:02,164: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:02:02.166802662Z [2024-03-28 00:02:02,166: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:02:02.166817852Z [2024-03-28 00:02:02,166: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:02:02.167100930Z [2024-03-28 00:02:02,166: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:02:02.167255327Z [2024-03-28 00:02:02,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:02:02.167748523Z [2024-03-28 00:02:02,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:02:02.167873243Z [2024-03-28 00:02:02,167: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:02:02.240413220Z [2024-03-28 00:02:02,239: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:02:02.244666248Z [2024-03-28 00:02:02,244: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:02:02.262256587Z [2024-03-28 00:02:02,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:02:02.263425290Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:02:02.263441925Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:02:02.263535353Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:02:02.263549406Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:02:02.263840260Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:02:02.263852467Z [2024-03-28 00:02:02,263: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:02:02.265993456Z [2024-03-28 00:02:02,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:02:02.348421397Z [2024-03-28 00:02:02,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:02:03.872983181Z [2024-03-28 00:02:03,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ddf23e3-5b62-4559-b5f7-6d2f83196028] succeeded in 3.54851516299982s: None 2024-03-28T00:02:04.944810258Z [2024-03-28 00:02:04,944: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55416b55-188a-499c-a446-34007a718277] succeeded in 4.62026392100006s: None 2024-03-28T00:03:00.751795124Z [2024-03-28 00:03:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89d041a5-0f0a-4023-8daa-78b50955f7f1] received 2024-03-28T00:03:00.766045377Z [2024-03-28 00:03:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b60a67-2d4f-4467-89b7-3cac97b998aa] received 2024-03-28T00:03:00.766605751Z [2024-03-28 00:03:00,766: INFO/ForkPoolWorker-15] [89d041a5-0f0a-4023-8daa-78b50955f7f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:03:00.781700643Z [2024-03-28 00:03:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae556ea5-edef-4f49-9d16-72f8a026cab9] received 2024-03-28T00:03:00.789268804Z [2024-03-28 00:03:00,788: INFO/ForkPoolWorker-16] [e2b60a67-2d4f-4467-89b7-3cac97b998aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:03:00.855842110Z [2024-03-28 00:03:00,854: INFO/ForkPoolWorker-1] [ae556ea5-edef-4f49-9d16-72f8a026cab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:03:01.318996694Z [2024-03-28 00:03:01,314: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:03:01.375234904Z [2024-03-28 00:03:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:03:01.442331876Z [2024-03-28 00:03:01,432: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:03:01.579406605Z [2024-03-28 00:03:01,578: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T00:03:01.585163736Z [2024-03-28 00:03:01,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:03:01.645787364Z [2024-03-28 00:03:01,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:03:01.653749074Z [2024-03-28 00:03:01,649: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:03:01.653780385Z [2024-03-28 00:03:01,649: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:03:01.653784942Z [2024-03-28 00:03:01,650: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T00:03:01.653798950Z [2024-03-28 00:03:01,650: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:03:01.757161150Z [2024-03-28 00:03:01,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:03:02.771984959Z [2024-03-28 00:03:02,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89d041a5-0f0a-4023-8daa-78b50955f7f1] succeeded in 2.01600984699985s: None 2024-03-28T00:03:03.102701227Z [2024-03-28 00:03:03,102: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:03:03.106294231Z [2024-03-28 00:03:03,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:03:03.134323035Z [2024-03-28 00:03:03,134: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:03:03.136024550Z [2024-03-28 00:03:03,135: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:03:03.136251011Z [2024-03-28 00:03:03,135: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:03:03.136498569Z [2024-03-28 00:03:03,136: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:03:03.136734424Z [2024-03-28 00:03:03,136: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:03:03.137296266Z [2024-03-28 00:03:03,137: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:03:03.137527026Z [2024-03-28 00:03:03,137: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:03:03.242240544Z [2024-03-28 00:03:03,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:03:03.384106151Z [2024-03-28 00:03:03,383: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:03:03.387729660Z [2024-03-28 00:03:03,387: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:03:03.420896579Z [2024-03-28 00:03:03,420: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:03:03.423012432Z [2024-03-28 00:03:03,422: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:03:03.423058547Z [2024-03-28 00:03:03,422: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:03:03.423209711Z [2024-03-28 00:03:03,422: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:03:03.423281074Z [2024-03-28 00:03:03,423: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:03:03.423669842Z [2024-03-28 00:03:03,423: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:03:03.423679350Z [2024-03-28 00:03:03,423: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:03:03.536113027Z [2024-03-28 00:03:03,534: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:03:07.397370108Z [2024-03-28 00:03:07,396: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae556ea5-edef-4f49-9d16-72f8a026cab9] succeeded in 6.6093594480000775s: None 2024-03-28T00:03:08.060263005Z [2024-03-28 00:03:08,059: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2b60a67-2d4f-4467-89b7-3cac97b998aa] succeeded in 7.280042973000036s: None 2024-03-28T00:04:00.994764670Z [2024-03-28 00:04:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45323da6-5f4f-46a0-ae80-fb92529397e5] received 2024-03-28T00:04:01.006341395Z [2024-03-28 00:04:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de43f123-353c-4296-b531-e0e198381658] received 2024-03-28T00:04:01.010196547Z [2024-03-28 00:04:01,009: INFO/ForkPoolWorker-15] [45323da6-5f4f-46a0-ae80-fb92529397e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:04:01.010872285Z [2024-03-28 00:04:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3beb54c-e4f9-4f75-85fa-143ad1ffd826] received 2024-03-28T00:04:01.019543068Z [2024-03-28 00:04:01,019: INFO/ForkPoolWorker-16] [de43f123-353c-4296-b531-e0e198381658] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:04:01.027079899Z [2024-03-28 00:04:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4309fb32-f34f-46b7-8390-b98b7b5e7400] received 2024-03-28T00:04:01.038107516Z [2024-03-28 00:04:01,037: INFO/ForkPoolWorker-1] [c3beb54c-e4f9-4f75-85fa-143ad1ffd826] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:04:01.047535646Z [2024-03-28 00:04:01,047: INFO/ForkPoolWorker-2] [4309fb32-f34f-46b7-8390-b98b7b5e7400] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:04:01.405390495Z [2024-03-28 00:04:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:04:01.570962547Z [2024-03-28 00:04:01,560: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:04:01.658464223Z [2024-03-28 00:04:01,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:04:01.659920544Z [2024-03-28 00:04:01,649: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:04:02.197460675Z [2024-03-28 00:04:02,196: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:04:02.206241517Z [2024-03-28 00:04:02,205: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:04:02.259581002Z [2024-03-28 00:04:02,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:04:02.289316138Z [2024-03-28 00:04:02,289: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:04:02.291474261Z [2024-03-28 00:04:02,291: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:04:02.291851281Z [2024-03-28 00:04:02,291: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:04:02.292063479Z [2024-03-28 00:04:02,291: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:04:02.292426660Z [2024-03-28 00:04:02,292: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:04:02.445694254Z [2024-03-28 00:04:02,445: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:04:03.210022978Z [2024-03-28 00:04:03,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45323da6-5f4f-46a0-ae80-fb92529397e5] succeeded in 2.213205112999958s: None 2024-03-28T00:04:03.330016443Z [2024-03-28 00:04:03,329: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:04:03.333880731Z [2024-03-28 00:04:03,333: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:04:03.369408238Z [2024-03-28 00:04:03,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:04:03.369427886Z [2024-03-28 00:04:03,364: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:04:03.369432015Z [2024-03-28 00:04:03,365: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:04:03.369437224Z [2024-03-28 00:04:03,365: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:04:03.369442203Z [2024-03-28 00:04:03,365: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:04:03.369445648Z [2024-03-28 00:04:03,365: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:04:03.369449034Z [2024-03-28 00:04:03,365: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:04:03.506989186Z [2024-03-28 00:04:03,506: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de43f123-353c-4296-b531-e0e198381658] succeeded in 2.498201076999976s: None 2024-03-28T00:04:03.522708543Z [2024-03-28 00:04:03,522: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:04:03.796551856Z [2024-03-28 00:04:03,796: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:04:03.805930894Z [2024-03-28 00:04:03,804: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:04:03.828972119Z [2024-03-28 00:04:03,828: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:04:03.830848921Z [2024-03-28 00:04:03,830: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:04:03.831118255Z [2024-03-28 00:04:03,830: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:04:03.831364835Z [2024-03-28 00:04:03,831: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:04:03.831488971Z [2024-03-28 00:04:03,831: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:04:03.831814309Z [2024-03-28 00:04:03,831: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:04:03.832212036Z [2024-03-28 00:04:03,832: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:04:03.943748437Z [2024-03-28 00:04:03,943: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:04:05.734108061Z [2024-03-28 00:04:05,733: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3beb54c-e4f9-4f75-85fa-143ad1ffd826] succeeded in 4.716788539999925s: None 2024-03-28T00:04:05.869561967Z [2024-03-28 00:04:05,869: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4309fb32-f34f-46b7-8390-b98b7b5e7400] succeeded in 4.830600162999872s: None 2024-03-28T00:05:00.910844735Z [2024-03-28 00:05:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e05681c3-a59f-4e0a-8b7c-f781b0e5ab64] received 2024-03-28T00:05:00.917410999Z [2024-03-28 00:05:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64622a7d-c8d0-4813-914a-a317933de706] received 2024-03-28T00:05:00.926306064Z [2024-03-28 00:05:00,925: INFO/ForkPoolWorker-15] [e05681c3-a59f-4e0a-8b7c-f781b0e5ab64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:05:00.940189462Z [2024-03-28 00:05:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc66b384-4ba5-4bfb-9a29-b9c413cea457] received 2024-03-28T00:05:00.941754979Z [2024-03-28 00:05:00,941: INFO/ForkPoolWorker-16] [64622a7d-c8d0-4813-914a-a317933de706] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:05:00.948214212Z [2024-03-28 00:05:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a00e190-f211-4066-8d2d-c2ec2fb480f9] received 2024-03-28T00:05:00.971315568Z [2024-03-28 00:05:00,970: INFO/ForkPoolWorker-1] [dc66b384-4ba5-4bfb-9a29-b9c413cea457] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:05:00.979838830Z [2024-03-28 00:05:00,979: INFO/ForkPoolWorker-2] [0a00e190-f211-4066-8d2d-c2ec2fb480f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:05:01.622679544Z [2024-03-28 00:05:01,616: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:05:01.738999487Z [2024-03-28 00:05:01,729: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:05:01.844780011Z [2024-03-28 00:05:01,841: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:05:01.999130630Z [2024-03-28 00:05:01,994: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:05:02.100281703Z [2024-03-28 00:05:02,099: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:05:02.110401274Z [2024-03-28 00:05:02,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:02.156527507Z [2024-03-28 00:05:02,156: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:05:02.157787746Z [2024-03-28 00:05:02,157: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:05:02.157982635Z [2024-03-28 00:05:02,157: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:05:02.158049121Z [2024-03-28 00:05:02,157: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:05:02.158297211Z [2024-03-28 00:05:02,158: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:05:02.322823809Z [2024-03-28 00:05:02,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:03.838556946Z [2024-03-28 00:05:03,835: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64622a7d-c8d0-4813-914a-a317933de706] succeeded in 2.915187131000039s: None 2024-03-28T00:05:04.373165114Z [2024-03-28 00:05:04,372: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:05:04.391712169Z [2024-03-28 00:05:04,390: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:04.462171936Z [2024-03-28 00:05:04,461: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:05:04.468981662Z [2024-03-28 00:05:04,468: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:04.469014121Z [2024-03-28 00:05:04,468: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:04.469158489Z [2024-03-28 00:05:04,468: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:04.469190348Z [2024-03-28 00:05:04,469: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:05:04.469441903Z [2024-03-28 00:05:04,469: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:05:04.469473237Z [2024-03-28 00:05:04,469: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:04.614865587Z [2024-03-28 00:05:04,612: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:05:04.620723814Z [2024-03-28 00:05:04,620: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:04.665447421Z [2024-03-28 00:05:04,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:04.702746469Z [2024-03-28 00:05:04,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:05:04.708627083Z [2024-03-28 00:05:04,703: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:04.708671567Z [2024-03-28 00:05:04,704: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:04.708677254Z [2024-03-28 00:05:04,704: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:04.708682140Z [2024-03-28 00:05:04,705: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:05:04.708701869Z [2024-03-28 00:05:04,705: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:05:04.708705444Z [2024-03-28 00:05:04,705: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:04.852083943Z [2024-03-28 00:05:04,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:05.159306574Z [2024-03-28 00:05:05,158: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:05:05.163994893Z [2024-03-28 00:05:05,163: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:05.201014272Z [2024-03-28 00:05:05,200: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:05:05.205423307Z [2024-03-28 00:05:05,205: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:05.206660131Z [2024-03-28 00:05:05,206: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:05.206977135Z [2024-03-28 00:05:05,206: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:05.207167087Z [2024-03-28 00:05:05,207: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:05:05.207565450Z [2024-03-28 00:05:05,207: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:05:05.207823284Z [2024-03-28 00:05:05,207: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:05.349017208Z [2024-03-28 00:05:05,348: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:05.557228903Z [2024-03-28 00:05:05,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e05681c3-a59f-4e0a-8b7c-f781b0e5ab64] succeeded in 4.644556826000098s: None 2024-03-28T00:05:05.864355851Z [2024-03-28 00:05:05,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ac2c95-907c-4214-987d-744925648338] received 2024-03-28T00:05:05.875956031Z [2024-03-28 00:05:05,875: INFO/ForkPoolWorker-15] [25ac2c95-907c-4214-987d-744925648338] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:05:06.259385240Z [2024-03-28 00:05:06,256: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:05:06.621890236Z [2024-03-28 00:05:06,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc66b384-4ba5-4bfb-9a29-b9c413cea457] succeeded in 5.6785552740000185s: None 2024-03-28T00:05:07.442856820Z [2024-03-28 00:05:07,442: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a00e190-f211-4066-8d2d-c2ec2fb480f9] succeeded in 6.490206080999997s: None 2024-03-28T00:05:07.566812727Z [2024-03-28 00:05:07,566: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:05:07.570397794Z [2024-03-28 00:05:07,569: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:07.591857857Z [2024-03-28 00:05:07,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:05:07.593362179Z [2024-03-28 00:05:07,593: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:07.593558736Z [2024-03-28 00:05:07,593: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:07.593857386Z [2024-03-28 00:05:07,593: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:07.593968423Z [2024-03-28 00:05:07,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:05:07.594340210Z [2024-03-28 00:05:07,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:05:07.594459404Z [2024-03-28 00:05:07,594: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:07.687622461Z [2024-03-28 00:05:07,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:08.421610041Z [2024-03-28 00:05:08,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25ac2c95-907c-4214-987d-744925648338] succeeded in 2.5493890370000827s: None 2024-03-28T00:05:09.055256170Z [2024-03-28 00:05:09,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[706065eb-ae61-41a8-a270-c5c63e890fb7] received 2024-03-28T00:05:09.121456160Z [2024-03-28 00:05:09,121: INFO/ForkPoolWorker-15] [706065eb-ae61-41a8-a270-c5c63e890fb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:05:09.640555088Z [2024-03-28 00:05:09,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:05:11.710838944Z [2024-03-28 00:05:11,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:05:11.718369931Z [2024-03-28 00:05:11,717: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:11.767748708Z [2024-03-28 00:05:11,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:05:11.769954610Z [2024-03-28 00:05:11,769: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:11.770172883Z [2024-03-28 00:05:11,769: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:11.770421156Z [2024-03-28 00:05:11,770: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:11.770503363Z [2024-03-28 00:05:11,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:05:11.770844079Z [2024-03-28 00:05:11,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:05:11.770869920Z [2024-03-28 00:05:11,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:11.916461512Z [2024-03-28 00:05:11,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:12.550188787Z [2024-03-28 00:05:12,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[706065eb-ae61-41a8-a270-c5c63e890fb7] succeeded in 3.467174851999971s: None 2024-03-28T00:05:13.133095965Z [2024-03-28 00:05:13,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c34bc01f-35fa-4c41-94d5-a9b9052b74be] received 2024-03-28T00:05:13.141409314Z [2024-03-28 00:05:13,141: INFO/ForkPoolWorker-15] [c34bc01f-35fa-4c41-94d5-a9b9052b74be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:05:13.454102642Z [2024-03-28 00:05:13,450: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:05:14.622746866Z [2024-03-28 00:05:14,622: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:05:14.626211711Z [2024-03-28 00:05:14,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:05:14.651805912Z [2024-03-28 00:05:14,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:05:14.653383024Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:05:14.653406813Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:05:14.653613603Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:05:14.653630815Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:05:14.653880162Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:05:14.653895439Z [2024-03-28 00:05:14,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:05:14.775479301Z [2024-03-28 00:05:14,775: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:05:15.399913201Z [2024-03-28 00:05:15,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c34bc01f-35fa-4c41-94d5-a9b9052b74be] succeeded in 2.2639174370001456s: None 2024-03-28T00:06:00.623750070Z [2024-03-28 00:06:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f454175-c5cf-4d6a-8976-de3fb058ca91] received 2024-03-28T00:06:00.627466208Z [2024-03-28 00:06:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5407c67-3f52-4063-b4d9-246c77c3e3ed] received 2024-03-28T00:06:00.633195012Z [2024-03-28 00:06:00,632: INFO/ForkPoolWorker-15] [6f454175-c5cf-4d6a-8976-de3fb058ca91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:06:00.640528457Z [2024-03-28 00:06:00,640: INFO/ForkPoolWorker-16] [f5407c67-3f52-4063-b4d9-246c77c3e3ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:06:00.641173910Z [2024-03-28 00:06:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9407b86-d8e7-4c1e-b221-548b8a05a9b5] received 2024-03-28T00:06:00.648736323Z [2024-03-28 00:06:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a97f8ad3-f6af-4083-be93-5314eb87544f] received 2024-03-28T00:06:00.658398262Z [2024-03-28 00:06:00,657: INFO/ForkPoolWorker-1] [f9407b86-d8e7-4c1e-b221-548b8a05a9b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:06:00.667614101Z [2024-03-28 00:06:00,667: INFO/ForkPoolWorker-2] [a97f8ad3-f6af-4083-be93-5314eb87544f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:06:01.049963173Z [2024-03-28 00:06:01,045: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:06:01.088766385Z [2024-03-28 00:06:01,084: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:06:01.457624909Z [2024-03-28 00:06:01,457: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:06:01.462886760Z [2024-03-28 00:06:01,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:06:01.492302579Z [2024-03-28 00:06:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:06:01.507082563Z [2024-03-28 00:06:01,506: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:06:01.509157517Z [2024-03-28 00:06:01,508: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:06:01.510424935Z [2024-03-28 00:06:01,509: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:06:01.510656590Z [2024-03-28 00:06:01,510: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:06:01.511495637Z [2024-03-28 00:06:01,510: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:06:01.696494409Z [2024-03-28 00:06:01,685: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:06:01.790423661Z [2024-03-28 00:06:01,790: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:06:01.919608813Z [2024-03-28 00:06:01,919: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:06:02.898586044Z [2024-03-28 00:06:02,898: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9407b86-d8e7-4c1e-b221-548b8a05a9b5] succeeded in 2.252932274999921s: None 2024-03-28T00:06:02.918513106Z [2024-03-28 00:06:02,918: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5407c67-3f52-4063-b4d9-246c77c3e3ed] succeeded in 2.2890141050002057s: None 2024-03-28T00:06:03.345340870Z [2024-03-28 00:06:03,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:06:03.353720193Z [2024-03-28 00:06:03,348: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:06:03.395814904Z [2024-03-28 00:06:03,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:06:03.397215680Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:06:03.397266574Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:06:03.397369647Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:06:03.397513609Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:06:03.397851929Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:06:03.397895021Z [2024-03-28 00:06:03,397: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:06:03.533879328Z [2024-03-28 00:06:03,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:06:04.034660535Z [2024-03-28 00:06:04,034: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:06:04.038700295Z [2024-03-28 00:06:04,038: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:06:04.068874415Z [2024-03-28 00:06:04,068: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:06:04.071617383Z [2024-03-28 00:06:04,071: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:06:04.071926263Z [2024-03-28 00:06:04,071: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:06:04.072151966Z [2024-03-28 00:06:04,071: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:06:04.072266052Z [2024-03-28 00:06:04,072: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:06:04.072578193Z [2024-03-28 00:06:04,072: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:06:04.072730102Z [2024-03-28 00:06:04,072: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:06:04.173230407Z [2024-03-28 00:06:04,172: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:06:05.864119729Z [2024-03-28 00:06:05,863: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a97f8ad3-f6af-4083-be93-5314eb87544f] succeeded in 5.212918544000104s: None 2024-03-28T00:06:05.939615372Z [2024-03-28 00:06:05,938: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f454175-c5cf-4d6a-8976-de3fb058ca91] succeeded in 5.313031271999989s: None 2024-03-28T00:07:00.532317156Z [2024-03-28 00:07:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66158412-6902-49ce-9257-ae0d7c2b0335] received 2024-03-28T00:07:00.536154909Z [2024-03-28 00:07:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e826441-39a2-46de-8e3f-107214f72d5f] received 2024-03-28T00:07:00.543180122Z [2024-03-28 00:07:00,542: INFO/ForkPoolWorker-15] [66158412-6902-49ce-9257-ae0d7c2b0335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:07:00.546624005Z [2024-03-28 00:07:00,546: INFO/ForkPoolWorker-16] [3e826441-39a2-46de-8e3f-107214f72d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:07:00.556640283Z [2024-03-28 00:07:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0e798fa-cff6-455a-b9fd-454b79d0dd2c] received 2024-03-28T00:07:00.573625275Z [2024-03-28 00:07:00,573: INFO/ForkPoolWorker-1] [a0e798fa-cff6-455a-b9fd-454b79d0dd2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:07:00.854168142Z [2024-03-28 00:07:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:07:00.894272219Z [2024-03-28 00:07:00,890: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:07:00.945959681Z [2024-03-28 00:07:00,942: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:07:01.081290105Z [2024-03-28 00:07:01,080: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:07:01.085862926Z [2024-03-28 00:07:01,085: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:07:01.119997856Z [2024-03-28 00:07:01,119: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:07:01.121816741Z [2024-03-28 00:07:01,121: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:07:01.122175555Z [2024-03-28 00:07:01,121: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:07:01.122430809Z [2024-03-28 00:07:01,122: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:07:01.122915571Z [2024-03-28 00:07:01,122: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:07:01.215469303Z [2024-03-28 00:07:01,215: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:07:01.930748761Z [2024-03-28 00:07:01,930: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a0e798fa-cff6-455a-b9fd-454b79d0dd2c] succeeded in 1.3703089820000969s: None 2024-03-28T00:07:02.154378866Z [2024-03-28 00:07:02,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:07:02.158405571Z [2024-03-28 00:07:02,157: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:07:02.175263299Z [2024-03-28 00:07:02,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:07:02.176614909Z [2024-03-28 00:07:02,176: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:07:02.176634532Z [2024-03-28 00:07:02,176: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:07:02.176870541Z [2024-03-28 00:07:02,176: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:07:02.176879295Z [2024-03-28 00:07:02,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:07:02.177244919Z [2024-03-28 00:07:02,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:07:02.177338965Z [2024-03-28 00:07:02,177: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:07:02.266404179Z [2024-03-28 00:07:02,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:07:02.328794666Z [2024-03-28 00:07:02,328: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:07:02.333141265Z [2024-03-28 00:07:02,332: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:07:02.355483840Z [2024-03-28 00:07:02,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:07:02.357754988Z [2024-03-28 00:07:02,357: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:07:02.358002382Z [2024-03-28 00:07:02,357: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:07:02.358311171Z [2024-03-28 00:07:02,357: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:07:02.358512894Z [2024-03-28 00:07:02,358: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:07:02.359013884Z [2024-03-28 00:07:02,358: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:07:02.359172279Z [2024-03-28 00:07:02,358: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:07:02.461663823Z [2024-03-28 00:07:02,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:07:03.830379683Z [2024-03-28 00:07:03,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66158412-6902-49ce-9257-ae0d7c2b0335] succeeded in 3.292706229000032s: None 2024-03-28T00:07:04.653919473Z [2024-03-28 00:07:04,653: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e826441-39a2-46de-8e3f-107214f72d5f] succeeded in 4.1158929069999886s: None 2024-03-28T00:08:00.251172023Z [2024-03-28 00:08:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c781ac35-4b57-4350-8851-6fa82d9a273a] received 2024-03-28T00:08:00.259513577Z [2024-03-28 00:08:00,259: INFO/ForkPoolWorker-15] [c781ac35-4b57-4350-8851-6fa82d9a273a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:08:00.264759546Z [2024-03-28 00:08:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e663370-125b-4186-b981-5746493b1eb6] received 2024-03-28T00:08:00.272589642Z [2024-03-28 00:08:00,272: INFO/ForkPoolWorker-16] [2e663370-125b-4186-b981-5746493b1eb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:08:00.277744133Z [2024-03-28 00:08:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7c7ab49-bf29-46ed-a17f-682b98e44d6f] received 2024-03-28T00:08:00.284093432Z [2024-03-28 00:08:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e7de417-fdbd-4755-bbe7-a5dedb4a6957] received 2024-03-28T00:08:00.285248343Z [2024-03-28 00:08:00,285: INFO/ForkPoolWorker-1] [a7c7ab49-bf29-46ed-a17f-682b98e44d6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:08:00.305266668Z [2024-03-28 00:08:00,304: INFO/ForkPoolWorker-2] [1e7de417-fdbd-4755-bbe7-a5dedb4a6957] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:08:00.602139971Z [2024-03-28 00:08:00,598: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:08:00.615288322Z [2024-03-28 00:08:00,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:08:00.640583844Z [2024-03-28 00:08:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:08:00.737204563Z [2024-03-28 00:08:00,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:08:00.858863841Z [2024-03-28 00:08:00,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:08:00.920460145Z [2024-03-28 00:08:00,920: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:08:00.924737325Z [2024-03-28 00:08:00,924: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:08:00.962972409Z [2024-03-28 00:08:00,962: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:08:00.966784852Z [2024-03-28 00:08:00,966: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:08:00.967125908Z [2024-03-28 00:08:00,966: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:08:00.967396276Z [2024-03-28 00:08:00,967: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:08:00.968160240Z [2024-03-28 00:08:00,967: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:08:01.104438016Z [2024-03-28 00:08:01,104: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:08:01.694268235Z [2024-03-28 00:08:01,693: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c781ac35-4b57-4350-8851-6fa82d9a273a] succeeded in 1.44057722499997s: None 2024-03-28T00:08:01.955263415Z [2024-03-28 00:08:01,954: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e7de417-fdbd-4755-bbe7-a5dedb4a6957] succeeded in 1.6670981449999545s: None 2024-03-28T00:08:02.371337475Z [2024-03-28 00:08:02,370: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:08:02.375631137Z [2024-03-28 00:08:02,375: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:08:02.402647221Z [2024-03-28 00:08:02,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:08:02.409488930Z [2024-03-28 00:08:02,409: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:08:02.409691257Z [2024-03-28 00:08:02,409: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:08:02.410010962Z [2024-03-28 00:08:02,409: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:08:02.410175352Z [2024-03-28 00:08:02,409: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:08:02.410606379Z [2024-03-28 00:08:02,410: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:08:02.410878994Z [2024-03-28 00:08:02,410: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:08:02.535637634Z [2024-03-28 00:08:02,535: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:08:02.556226413Z [2024-03-28 00:08:02,555: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:08:02.563562151Z [2024-03-28 00:08:02,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:08:02.599935152Z [2024-03-28 00:08:02,599: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:08:02.604063816Z [2024-03-28 00:08:02,603: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:08:02.604347472Z [2024-03-28 00:08:02,603: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:08:02.604734302Z [2024-03-28 00:08:02,604: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:08:02.605354740Z [2024-03-28 00:08:02,604: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:08:02.605950328Z [2024-03-28 00:08:02,605: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:08:02.606172826Z [2024-03-28 00:08:02,605: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:08:02.699999743Z [2024-03-28 00:08:02,699: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:08:04.415052952Z [2024-03-28 00:08:04,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7c7ab49-bf29-46ed-a17f-682b98e44d6f] succeeded in 4.135245295000004s: None 2024-03-28T00:08:04.828998037Z [2024-03-28 00:08:04,828: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e663370-125b-4186-b981-5746493b1eb6] succeeded in 4.561997539000004s: None 2024-03-28T00:09:00.169884931Z [2024-03-28 00:09:00,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9aec815-d9f5-4a69-bfa2-2815c1a6aa04] received 2024-03-28T00:09:00.177540710Z [2024-03-28 00:09:00,177: INFO/ForkPoolWorker-15] [e9aec815-d9f5-4a69-bfa2-2815c1a6aa04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:09:00.183609680Z [2024-03-28 00:09:00,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fabb37c-908e-47b5-a21d-bb4f77c41fc6] received 2024-03-28T00:09:00.185429555Z [2024-03-28 00:09:00,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14a6bed0-ee51-44e7-bb2a-0e9b79f3ab8b] received 2024-03-28T00:09:00.198885918Z [2024-03-28 00:09:00,198: INFO/ForkPoolWorker-1] [14a6bed0-ee51-44e7-bb2a-0e9b79f3ab8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:09:00.199104378Z [2024-03-28 00:09:00,198: INFO/ForkPoolWorker-16] [4fabb37c-908e-47b5-a21d-bb4f77c41fc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:09:00.491771281Z [2024-03-28 00:09:00,488: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:09:00.494770337Z [2024-03-28 00:09:00,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:09:00.521388440Z [2024-03-28 00:09:00,518: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:09:00.650770367Z [2024-03-28 00:09:00,650: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:09:00.654896015Z [2024-03-28 00:09:00,654: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:09:00.686517991Z [2024-03-28 00:09:00,686: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:09:00.687861129Z [2024-03-28 00:09:00,687: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:09:00.687971636Z [2024-03-28 00:09:00,687: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:09:00.688020278Z [2024-03-28 00:09:00,687: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:09:00.688272531Z [2024-03-28 00:09:00,688: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:09:00.790837387Z [2024-03-28 00:09:00,790: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:09:01.498338036Z [2024-03-28 00:09:01,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[14a6bed0-ee51-44e7-bb2a-0e9b79f3ab8b] succeeded in 1.3113046450000638s: None 2024-03-28T00:09:01.816331395Z [2024-03-28 00:09:01,815: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:09:01.821275874Z [2024-03-28 00:09:01,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:09:01.852135556Z [2024-03-28 00:09:01,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:09:01.854840784Z [2024-03-28 00:09:01,854: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:09:01.855128022Z [2024-03-28 00:09:01,854: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:09:01.855386495Z [2024-03-28 00:09:01,855: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:09:01.855538410Z [2024-03-28 00:09:01,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:09:01.855978487Z [2024-03-28 00:09:01,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:09:01.856106694Z [2024-03-28 00:09:01,855: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:09:01.956016477Z [2024-03-28 00:09:01,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:09:01.973966408Z [2024-03-28 00:09:01,973: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:09:01.978068091Z [2024-03-28 00:09:01,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:09:02.010835556Z [2024-03-28 00:09:02,010: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:09:02.012994315Z [2024-03-28 00:09:02,012: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:09:02.013202796Z [2024-03-28 00:09:02,012: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:09:02.013576940Z [2024-03-28 00:09:02,013: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:09:02.013781878Z [2024-03-28 00:09:02,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:09:02.014292716Z [2024-03-28 00:09:02,014: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:09:02.014438118Z [2024-03-28 00:09:02,014: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:09:02.108558429Z [2024-03-28 00:09:02,108: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:09:03.817574516Z [2024-03-28 00:09:03,816: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fabb37c-908e-47b5-a21d-bb4f77c41fc6] succeeded in 3.6320188439999583s: None 2024-03-28T00:09:04.280095649Z [2024-03-28 00:09:04,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9aec815-d9f5-4a69-bfa2-2815c1a6aa04] succeeded in 4.108348318000026s: None 2024-03-28T00:10:00.824007088Z [2024-03-28 00:10:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa339fd4-01af-4a63-af28-e973f9a0f1e4] received 2024-03-28T00:10:00.827536792Z [2024-03-28 00:10:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef886463-e6e8-4db1-9b0f-eb03b6a596e8] received 2024-03-28T00:10:00.829806843Z [2024-03-28 00:10:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dfe4729-7bf0-4be0-b1c5-b4cae5244093] received 2024-03-28T00:10:00.842000020Z [2024-03-28 00:10:00,841: INFO/ForkPoolWorker-1] [9dfe4729-7bf0-4be0-b1c5-b4cae5244093] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:10:00.843219860Z [2024-03-28 00:10:00,841: INFO/ForkPoolWorker-16] [ef886463-e6e8-4db1-9b0f-eb03b6a596e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:10:00.850094282Z [2024-03-28 00:10:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[befeefa4-1d12-4469-bbb7-4f6d055b3986] received 2024-03-28T00:10:00.860099457Z [2024-03-28 00:10:00,859: INFO/ForkPoolWorker-15] [fa339fd4-01af-4a63-af28-e973f9a0f1e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:10:00.863913702Z [2024-03-28 00:10:00,863: INFO/ForkPoolWorker-2] [befeefa4-1d12-4469-bbb7-4f6d055b3986] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:10:00.865309050Z [2024-03-28 00:10:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd8a7122-32ab-404c-95f9-728e8511b934] received 2024-03-28T00:10:00.899838981Z [2024-03-28 00:10:00,899: INFO/ForkPoolWorker-3] [fd8a7122-32ab-404c-95f9-728e8511b934] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:10:01.556376292Z [2024-03-28 00:10:01,549: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:10:01.592268180Z [2024-03-28 00:10:01,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:10:01.724692081Z [2024-03-28 00:10:01,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:10:02.103399661Z [2024-03-28 00:10:02,081: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:10:02.254488080Z [2024-03-28 00:10:02,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:10:02.541115817Z [2024-03-28 00:10:02,540: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:02.547172140Z [2024-03-28 00:10:02,546: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:10:02.566139973Z [2024-03-28 00:10:02,564: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:02.764228418Z [2024-03-28 00:10:02,763: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:10:02.767137066Z [2024-03-28 00:10:02,766: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:10:02.769451883Z [2024-03-28 00:10:02,767: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:10:02.769665600Z [2024-03-28 00:10:02,769: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:10:02.770341165Z [2024-03-28 00:10:02,769: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:10:03.158643448Z [2024-03-28 00:10:03,158: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:03.693738754Z [2024-03-28 00:10:03,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef886463-e6e8-4db1-9b0f-eb03b6a596e8] succeeded in 2.8642364330000873s: None 2024-03-28T00:10:04.898738266Z [2024-03-28 00:10:04,898: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9dfe4729-7bf0-4be0-b1c5-b4cae5244093] succeeded in 4.0674216580000575s: None 2024-03-28T00:10:05.697322715Z [2024-03-28 00:10:05,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:10:05.701969956Z [2024-03-28 00:10:05,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:05.739854584Z [2024-03-28 00:10:05,739: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:10:05.741580114Z [2024-03-28 00:10:05,741: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:05.741857502Z [2024-03-28 00:10:05,741: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:05.742206976Z [2024-03-28 00:10:05,742: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:05.742635857Z [2024-03-28 00:10:05,742: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:10:05.742875709Z [2024-03-28 00:10:05,742: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:10:05.743011278Z [2024-03-28 00:10:05,742: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:05.911555802Z [2024-03-28 00:10:05,911: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:06.041307789Z [2024-03-28 00:10:06,040: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:10:06.045409611Z [2024-03-28 00:10:06,044: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:06.122235276Z [2024-03-28 00:10:06,121: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:10:06.126742443Z [2024-03-28 00:10:06,126: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:06.167733822Z [2024-03-28 00:10:06,167: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:10:06.185819913Z [2024-03-28 00:10:06,185: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:06.185862388Z [2024-03-28 00:10:06,185: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:06.185932004Z [2024-03-28 00:10:06,185: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:06.185950327Z [2024-03-28 00:10:06,185: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:10:06.186472684Z [2024-03-28 00:10:06,186: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:10:06.186477867Z [2024-03-28 00:10:06,186: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:06.198861291Z [2024-03-28 00:10:06,198: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:10:06.202832955Z [2024-03-28 00:10:06,202: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:06.203150697Z [2024-03-28 00:10:06,202: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:06.203731171Z [2024-03-28 00:10:06,203: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:06.204010852Z [2024-03-28 00:10:06,203: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:10:06.204835215Z [2024-03-28 00:10:06,204: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:10:06.205056698Z [2024-03-28 00:10:06,204: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:06.379070573Z [2024-03-28 00:10:06,377: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:06.439344641Z [2024-03-28 00:10:06,439: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:07.242734141Z [2024-03-28 00:10:07,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fcd876d-57d9-4a88-9718-d57b694a8ea4] received 2024-03-28T00:10:07.254662775Z [2024-03-28 00:10:07,250: INFO/ForkPoolWorker-16] [9fcd876d-57d9-4a88-9718-d57b694a8ea4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:10:07.375933504Z [2024-03-28 00:10:07,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa339fd4-01af-4a63-af28-e973f9a0f1e4] succeeded in 6.54743627300013s: None 2024-03-28T00:10:07.722350789Z [2024-03-28 00:10:07,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:10:09.037986266Z [2024-03-28 00:10:09,037: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fd8a7122-32ab-404c-95f9-728e8511b934] succeeded in 8.163440718999937s: None 2024-03-28T00:10:09.745297027Z [2024-03-28 00:10:09,744: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[befeefa4-1d12-4469-bbb7-4f6d055b3986] succeeded in 8.887486784999965s: None 2024-03-28T00:10:10.230140798Z [2024-03-28 00:10:10,229: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:10:10.238082470Z [2024-03-28 00:10:10,236: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:10.287703847Z [2024-03-28 00:10:10,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:10:10.296334737Z [2024-03-28 00:10:10,296: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:10.297199113Z [2024-03-28 00:10:10,296: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:10.297893692Z [2024-03-28 00:10:10,297: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:10.297951993Z [2024-03-28 00:10:10,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:10:10.300905807Z [2024-03-28 00:10:10,299: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:10:10.301665015Z [2024-03-28 00:10:10,300: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:10.448400386Z [2024-03-28 00:10:10,448: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:11.357865892Z [2024-03-28 00:10:11,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fcd876d-57d9-4a88-9718-d57b694a8ea4] succeeded in 4.117588699999942s: None 2024-03-28T00:10:11.702580531Z [2024-03-28 00:10:11,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1c555e7-2667-42ee-b21b-ea5c1afed4e5] received 2024-03-28T00:10:11.718103847Z [2024-03-28 00:10:11,717: INFO/ForkPoolWorker-15] [c1c555e7-2667-42ee-b21b-ea5c1afed4e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:10:12.068093308Z [2024-03-28 00:10:12,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:10:13.959617247Z [2024-03-28 00:10:13,959: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:10:13.963974765Z [2024-03-28 00:10:13,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:13.987505555Z [2024-03-28 00:10:13,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:10:13.989023629Z [2024-03-28 00:10:13,988: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:13.989286584Z [2024-03-28 00:10:13,989: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:13.989615234Z [2024-03-28 00:10:13,989: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:13.989871897Z [2024-03-28 00:10:13,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:10:13.990269480Z [2024-03-28 00:10:13,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:10:13.990466543Z [2024-03-28 00:10:13,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:14.094721880Z [2024-03-28 00:10:14,094: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:14.815638122Z [2024-03-28 00:10:14,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1c555e7-2667-42ee-b21b-ea5c1afed4e5] succeeded in 3.1088140249999014s: None 2024-03-28T00:10:15.579873351Z [2024-03-28 00:10:15,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b5c33f6-59a4-405b-84d9-85878309b5b0] received 2024-03-28T00:10:15.595118956Z [2024-03-28 00:10:15,594: INFO/ForkPoolWorker-15] [2b5c33f6-59a4-405b-84d9-85878309b5b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:10:15.992693235Z [2024-03-28 00:10:15,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:10:17.111635944Z [2024-03-28 00:10:17,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:10:17.115145738Z [2024-03-28 00:10:17,114: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:10:17.220535114Z [2024-03-28 00:10:17,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:10:17.227435897Z [2024-03-28 00:10:17,227: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:10:17.227611783Z [2024-03-28 00:10:17,227: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:10:17.227814524Z [2024-03-28 00:10:17,227: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:10:17.227963316Z [2024-03-28 00:10:17,227: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:10:17.228292984Z [2024-03-28 00:10:17,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:10:17.228480071Z [2024-03-28 00:10:17,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:10:17.306643438Z [2024-03-28 00:10:17,306: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:10:17.923905613Z [2024-03-28 00:10:17,923: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b5c33f6-59a4-405b-84d9-85878309b5b0] succeeded in 2.336368506999861s: None 2024-03-28T00:11:00.621831080Z [2024-03-28 00:11:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32cc8a4f-1409-4ffb-8522-58b8efbc6f10] received 2024-03-28T00:11:00.630176459Z [2024-03-28 00:11:00,629: INFO/ForkPoolWorker-15] [32cc8a4f-1409-4ffb-8522-58b8efbc6f10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:11:00.636081882Z [2024-03-28 00:11:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6610c942-7d87-407e-a9d8-1a343ed1dc88] received 2024-03-28T00:11:00.639743345Z [2024-03-28 00:11:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5729c14-069c-4eb8-a3e9-adb122932a78] received 2024-03-28T00:11:00.655542455Z [2024-03-28 00:11:00,655: INFO/ForkPoolWorker-1] [a5729c14-069c-4eb8-a3e9-adb122932a78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:11:00.656743584Z [2024-03-28 00:11:00,656: INFO/ForkPoolWorker-16] [6610c942-7d87-407e-a9d8-1a343ed1dc88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:11:00.970121798Z [2024-03-28 00:11:00,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:11:00.996825888Z [2024-03-28 00:11:00,991: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:11:01.092521280Z [2024-03-28 00:11:01,089: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:11:01.240674080Z [2024-03-28 00:11:01,240: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:11:01.248179260Z [2024-03-28 00:11:01,247: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:11:01.275662199Z [2024-03-28 00:11:01,275: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:11:01.276714741Z [2024-03-28 00:11:01,276: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:11:01.276822800Z [2024-03-28 00:11:01,276: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:11:01.276891390Z [2024-03-28 00:11:01,276: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:11:01.277214864Z [2024-03-28 00:11:01,277: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:11:01.386813112Z [2024-03-28 00:11:01,386: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:11:02.230497158Z [2024-03-28 00:11:02,229: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5729c14-069c-4eb8-a3e9-adb122932a78] succeeded in 1.5882739379999293s: None 2024-03-28T00:11:02.456116611Z [2024-03-28 00:11:02,455: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:11:02.460017004Z [2024-03-28 00:11:02,459: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:11:02.480731788Z [2024-03-28 00:11:02,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:11:02.482161470Z [2024-03-28 00:11:02,481: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:11:02.482176251Z [2024-03-28 00:11:02,482: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:11:02.482294889Z [2024-03-28 00:11:02,482: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:11:02.482391823Z [2024-03-28 00:11:02,482: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:11:02.482670966Z [2024-03-28 00:11:02,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:11:02.482727128Z [2024-03-28 00:11:02,482: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:11:02.548352252Z [2024-03-28 00:11:02,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:11:02.552122337Z [2024-03-28 00:11:02,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:11:02.573006004Z [2024-03-28 00:11:02,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:11:02.573035870Z [2024-03-28 00:11:02,572: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:11:02.573921261Z [2024-03-28 00:11:02,573: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:11:02.573962181Z [2024-03-28 00:11:02,573: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:11:02.574210152Z [2024-03-28 00:11:02,573: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:11:02.574542912Z [2024-03-28 00:11:02,574: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:11:02.575396361Z [2024-03-28 00:11:02,575: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:11:02.575442782Z [2024-03-28 00:11:02,575: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:11:02.694825406Z [2024-03-28 00:11:02,694: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:11:04.442981248Z [2024-03-28 00:11:04,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32cc8a4f-1409-4ffb-8522-58b8efbc6f10] succeeded in 3.8192138169999907s: None 2024-03-28T00:11:05.083974880Z [2024-03-28 00:11:05,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6610c942-7d87-407e-a9d8-1a343ed1dc88] succeeded in 4.446244901s: None 2024-03-28T00:12:00.487327697Z [2024-03-28 00:12:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e534c23-4eb8-4329-94e6-2bd83f419d3f] received 2024-03-28T00:12:00.490743491Z [2024-03-28 00:12:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19d171d0-c76a-45ed-9955-0b3dce3b1745] received 2024-03-28T00:12:00.495626350Z [2024-03-28 00:12:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71aede9d-3dc6-4a7c-bf4b-8328a0a260cf] received 2024-03-28T00:12:00.498376329Z [2024-03-28 00:12:00,498: INFO/ForkPoolWorker-15] [0e534c23-4eb8-4329-94e6-2bd83f419d3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:12:00.500524307Z [2024-03-28 00:12:00,500: INFO/ForkPoolWorker-16] [19d171d0-c76a-45ed-9955-0b3dce3b1745] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:12:00.505351726Z [2024-03-28 00:12:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d0e8de-4fb1-4ac7-bd6a-2d2d8e03df64] received 2024-03-28T00:12:00.508495177Z [2024-03-28 00:12:00,508: INFO/ForkPoolWorker-1] [71aede9d-3dc6-4a7c-bf4b-8328a0a260cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:12:00.522290380Z [2024-03-28 00:12:00,521: INFO/ForkPoolWorker-2] [82d0e8de-4fb1-4ac7-bd6a-2d2d8e03df64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:12:00.862696421Z [2024-03-28 00:12:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:12:00.868224033Z [2024-03-28 00:12:00,864: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:12:01.004440498Z [2024-03-28 00:12:00,986: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:12:01.006627735Z [2024-03-28 00:12:01,000: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:12:01.199303306Z [2024-03-28 00:12:01,198: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:12:01.203699543Z [2024-03-28 00:12:01,203: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:01.234466581Z [2024-03-28 00:12:01,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:01.244493032Z [2024-03-28 00:12:01,244: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:12:01.246821110Z [2024-03-28 00:12:01,246: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:12:01.247075812Z [2024-03-28 00:12:01,246: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:12:01.247334025Z [2024-03-28 00:12:01,247: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:12:01.247621236Z [2024-03-28 00:12:01,247: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:12:01.357557988Z [2024-03-28 00:12:01,357: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:01.978045219Z [2024-03-28 00:12:01,977: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e534c23-4eb8-4329-94e6-2bd83f419d3f] succeeded in 1.4880040529999405s: None 2024-03-28T00:12:02.099998997Z [2024-03-28 00:12:02,099: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82d0e8de-4fb1-4ac7-bd6a-2d2d8e03df64] succeeded in 1.592326759999878s: None 2024-03-28T00:12:02.446405114Z [2024-03-28 00:12:02,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:12:02.450406701Z [2024-03-28 00:12:02,449: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:02.478214301Z [2024-03-28 00:12:02,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:12:02.479773038Z [2024-03-28 00:12:02,479: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:02.479948652Z [2024-03-28 00:12:02,479: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:02.480142294Z [2024-03-28 00:12:02,479: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:12:02.480317697Z [2024-03-28 00:12:02,480: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:12:02.480676045Z [2024-03-28 00:12:02,480: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:12:02.480773704Z [2024-03-28 00:12:02,480: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:02.587827956Z [2024-03-28 00:12:02,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:02.609042656Z [2024-03-28 00:12:02,608: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:12:02.612643570Z [2024-03-28 00:12:02,612: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:02.648197693Z [2024-03-28 00:12:02,647: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:12:02.650574231Z [2024-03-28 00:12:02,650: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:02.650656935Z [2024-03-28 00:12:02,650: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:02.650934171Z [2024-03-28 00:12:02,650: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:12:02.651019253Z [2024-03-28 00:12:02,650: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:12:02.651417194Z [2024-03-28 00:12:02,651: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:12:02.651489504Z [2024-03-28 00:12:02,651: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:02.785071566Z [2024-03-28 00:12:02,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:04.199637373Z [2024-03-28 00:12:04,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19d171d0-c76a-45ed-9955-0b3dce3b1745] succeeded in 3.705058644000019s: None 2024-03-28T00:12:05.120156384Z [2024-03-28 00:12:05,119: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71aede9d-3dc6-4a7c-bf4b-8328a0a260cf] succeeded in 4.621334137000076s: None 2024-03-28T00:12:51.156334318Z [2024-03-28 00:12:51,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7980cb4d-4ddd-48a3-bd78-b3bb84b62423] received 2024-03-28T00:12:51.164982027Z [2024-03-28 00:12:51,164: INFO/ForkPoolWorker-15] [7980cb4d-4ddd-48a3-bd78-b3bb84b62423] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:12:51.451729572Z [2024-03-28 00:12:51,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:12:52.722904165Z [2024-03-28 00:12:52,722: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:12:52.726859341Z [2024-03-28 00:12:52,726: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:52.748015662Z [2024-03-28 00:12:52,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:12:52.749426120Z [2024-03-28 00:12:52,749: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:52.749633835Z [2024-03-28 00:12:52,749: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:52.749644793Z [2024-03-28 00:12:52,749: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:12:52.749840883Z [2024-03-28 00:12:52,749: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:12:52.749956975Z [2024-03-28 00:12:52,749: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:12:52.750340602Z [2024-03-28 00:12:52,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:12:52.750468955Z [2024-03-28 00:12:52,750: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:52.757877453Z [2024-03-28 00:12:52,757: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:12:52.851639299Z [2024-03-28 00:12:52,851: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:53.536671793Z [2024-03-28 00:12:53,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[979fc434-4185-4fe4-a758-02bf26ec4787] received 2024-03-28T00:12:53.546853922Z [2024-03-28 00:12:53,546: INFO/ForkPoolWorker-16] [979fc434-4185-4fe4-a758-02bf26ec4787] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'split_metrics', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:12:53.611839052Z [2024-03-28 00:12:53,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7980cb4d-4ddd-48a3-bd78-b3bb84b62423] succeeded in 2.452122708999923s: None 2024-03-28T00:12:53.839581564Z [2024-03-28 00:12:53,835: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:12:55.182284941Z [2024-03-28 00:12:55,181: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:12:55.186001749Z [2024-03-28 00:12:55,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:55.228971905Z [2024-03-28 00:12:55,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:12:55.230563411Z [2024-03-28 00:12:55,230: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:55.230710195Z [2024-03-28 00:12:55,230: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:55.230857813Z [2024-03-28 00:12:55,230: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:12:55.231096195Z [2024-03-28 00:12:55,230: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:12:55.231220661Z [2024-03-28 00:12:55,231: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:12:55.231582384Z [2024-03-28 00:12:55,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:12:55.231728456Z [2024-03-28 00:12:55,231: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:55.239417611Z [2024-03-28 00:12:55,239: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:12:55.337569863Z [2024-03-28 00:12:55,337: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:56.118339858Z [2024-03-28 00:12:56,117: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[979fc434-4185-4fe4-a758-02bf26ec4787] succeeded in 2.578701583999873s: None 2024-03-28T00:12:56.270368161Z [2024-03-28 00:12:56,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fd20817-4cf2-4e6f-b388-fa796570be19] received 2024-03-28T00:12:56.305609236Z [2024-03-28 00:12:56,304: INFO/ForkPoolWorker-15] [1fd20817-4cf2-4e6f-b388-fa796570be19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'collect_metrics', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:12:56.679259329Z [2024-03-28 00:12:56,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:12:57.624360175Z [2024-03-28 00:12:57,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9681a7fc-da1a-40ba-b071-88d7a0b2d7d0] received 2024-03-28T00:12:57.630201568Z [2024-03-28 00:12:57,629: INFO/ForkPoolWorker-16] [9681a7fc-da1a-40ba-b071-88d7a0b2d7d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:12:57.998537303Z [2024-03-28 00:12:57,995: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:12:58.086461551Z [2024-03-28 00:12:58,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:12:58.089904082Z [2024-03-28 00:12:58,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:58.125772580Z [2024-03-28 00:12:58,125: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:12:58.127391690Z [2024-03-28 00:12:58,127: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:58.127408570Z [2024-03-28 00:12:58,127: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:58.127778135Z [2024-03-28 00:12:58,127: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:12:58.127938236Z [2024-03-28 00:12:58,127: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:12:58.128001797Z [2024-03-28 00:12:58,127: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:12:58.128297099Z [2024-03-28 00:12:58,128: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:12:58.128302790Z [2024-03-28 00:12:58,128: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:58.134134677Z [2024-03-28 00:12:58,133: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:12:58.230917230Z [2024-03-28 00:12:58,230: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:12:58.824737421Z [2024-03-28 00:12:58,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fd20817-4cf2-4e6f-b388-fa796570be19] succeeded in 2.5526507650001804s: None 2024-03-28T00:12:59.090509793Z [2024-03-28 00:12:59,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2332e559-e511-412f-9057-e72422419d90] received 2024-03-28T00:12:59.101435702Z [2024-03-28 00:12:59,101: INFO/ForkPoolWorker-15] [2332e559-e511-412f-9057-e72422419d90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'send_prometheus', 'scheduled__2024-03-28T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:12:59.113577716Z [2024-03-28 00:12:59,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a756572-d450-4f54-9281-533b62b9fa53] received 2024-03-28T00:12:59.122842876Z [2024-03-28 00:12:59,122: INFO/ForkPoolWorker-1] [7a756572-d450-4f54-9281-533b62b9fa53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:12:59.458078018Z [2024-03-28 00:12:59,453: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:12:59.479640492Z [2024-03-28 00:12:59,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:12:59.494783282Z [2024-03-28 00:12:59,494: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:12:59.498190553Z [2024-03-28 00:12:59,497: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:12:59.513101399Z [2024-03-28 00:12:59,512: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:12:59.514759429Z [2024-03-28 00:12:59,514: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:12:59.514775877Z [2024-03-28 00:12:59,514: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:12:59.514864225Z [2024-03-28 00:12:59,514: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:12:59.514998115Z [2024-03-28 00:12:59,514: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:12:59.515008844Z [2024-03-28 00:12:59,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:12:59.515218657Z [2024-03-28 00:12:59,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:12:59.515229863Z [2024-03-28 00:12:59,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:12:59.519435058Z [2024-03-28 00:12:59,519: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:12:59.588214255Z [2024-03-28 00:12:59,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:00.357387028Z [2024-03-28 00:13:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[189ac76f-6493-45d0-9a9f-8ed7d1e4bed3] received 2024-03-28T00:13:00.362918998Z [2024-03-28 00:13:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faaf0416-d92f-49f1-8cd7-56783d4bb4f3] received 2024-03-28T00:13:00.372105566Z [2024-03-28 00:13:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0e7cb89-bba6-4bbd-a0e8-bd6a1c360c56] received 2024-03-28T00:13:00.373655899Z [2024-03-28 00:13:00,373: INFO/ForkPoolWorker-2] [189ac76f-6493-45d0-9a9f-8ed7d1e4bed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:13:00.375989674Z [2024-03-28 00:13:00,375: INFO/ForkPoolWorker-3] [faaf0416-d92f-49f1-8cd7-56783d4bb4f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:13:00.376526015Z [2024-03-28 00:13:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f5a4989-9e6f-4550-9916-7ca1b0be7e8c] received 2024-03-28T00:13:00.396651284Z [2024-03-28 00:13:00,396: INFO/ForkPoolWorker-5] [3f5a4989-9e6f-4550-9916-7ca1b0be7e8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:13:00.406157655Z [2024-03-28 00:13:00,405: INFO/ForkPoolWorker-4] [a0e7cb89-bba6-4bbd-a0e8-bd6a1c360c56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:13:00.809800433Z [2024-03-28 00:13:00,805: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:13:00.853641337Z [2024-03-28 00:13:00,841: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:13:00.938549402Z [2024-03-28 00:13:00,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:13:00.951333091Z [2024-03-28 00:13:00,947: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:13:01.023363060Z [2024-03-28 00:13:01,022: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:13:01.028714696Z [2024-03-28 00:13:01,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:01.056676882Z [2024-03-28 00:13:01,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:13:01.059925103Z [2024-03-28 00:13:01,059: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:13:01.061943057Z [2024-03-28 00:13:01,061: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:01.062123317Z [2024-03-28 00:13:01,062: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:01.062259303Z [2024-03-28 00:13:01,062: INFO/ForkPoolWorker-1] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:01.062490214Z [2024-03-28 00:13:01,062: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:01.062624611Z [2024-03-28 00:13:01,062: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:13:01.062976147Z [2024-03-28 00:13:01,062: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:13:01.063104097Z [2024-03-28 00:13:01,063: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:01.067922142Z [2024-03-28 00:13:01,067: INFO/ForkPoolWorker-1] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:01.076759016Z [2024-03-28 00:13:01,076: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:01.088977173Z [2024-03-28 00:13:01,088: INFO/ForkPoolWorker-5] Getting SDNC list 2024-03-28T00:13:01.093807348Z [2024-03-28 00:13:01,093: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:01.143754631Z [2024-03-28 00:13:01,143: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T00:13:01.145134260Z [2024-03-28 00:13:01,144: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:13:01.146039882Z [2024-03-28 00:13:01,145: INFO/ForkPoolWorker-5] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:13:01.146271110Z [2024-03-28 00:13:01,145: INFO/ForkPoolWorker-5] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:13:01.146462687Z [2024-03-28 00:13:01,146: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-03-28T00:13:01.146666009Z [2024-03-28 00:13:01,146: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:13:01.147278361Z [2024-03-28 00:13:01,147: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:01.147353049Z [2024-03-28 00:13:01,147: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:01.147433995Z [2024-03-28 00:13:01,147: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:01.147676109Z [2024-03-28 00:13:01,147: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:01.147740019Z [2024-03-28 00:13:01,147: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:13:01.148321526Z [2024-03-28 00:13:01,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:13:01.148403749Z [2024-03-28 00:13:01,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:01.152632205Z [2024-03-28 00:13:01,152: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:01.154860856Z [2024-03-28 00:13:01,154: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:01.357422470Z [2024-03-28 00:13:01,357: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:01.424518099Z [2024-03-28 00:13:01,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9681a7fc-da1a-40ba-b071-88d7a0b2d7d0] succeeded in 3.798536436999939s: None 2024-03-28T00:13:01.431401820Z [2024-03-28 00:13:01,431: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:02.358281881Z [2024-03-28 00:13:02,357: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[3f5a4989-9e6f-4550-9916-7ca1b0be7e8c] succeeded in 1.9781506660001469s: None 2024-03-28T00:13:02.368099854Z [2024-03-28 00:13:02,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2332e559-e511-412f-9057-e72422419d90] succeeded in 3.2754570209999656s: None 2024-03-28T00:13:02.631429209Z [2024-03-28 00:13:02,630: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:13:02.635139855Z [2024-03-28 00:13:02,634: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:02.660113954Z [2024-03-28 00:13:02,659: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:13:02.662081258Z [2024-03-28 00:13:02,661: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:02.663186350Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:02.663203279Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:02.663213348Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:02.663217649Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:13:02.663220920Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:13:02.663224344Z [2024-03-28 00:13:02,662: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:02.667663899Z [2024-03-28 00:13:02,667: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:02.763205109Z [2024-03-28 00:13:02,762: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:02.811130475Z [2024-03-28 00:13:02,810: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T00:13:02.815653054Z [2024-03-28 00:13:02,815: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:02.857172496Z [2024-03-28 00:13:02,856: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T00:13:02.858714978Z [2024-03-28 00:13:02,858: INFO/ForkPoolWorker-4] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:02.858740499Z [2024-03-28 00:13:02,858: INFO/ForkPoolWorker-4] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:02.858755912Z [2024-03-28 00:13:02,858: INFO/ForkPoolWorker-4] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:02.858877204Z [2024-03-28 00:13:02,858: INFO/ForkPoolWorker-4] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:02.858911974Z [2024-03-28 00:13:02,858: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T00:13:02.859251053Z [2024-03-28 00:13:02,859: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:13:02.859265741Z [2024-03-28 00:13:02,859: INFO/ForkPoolWorker-4] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:02.867514677Z [2024-03-28 00:13:02,867: INFO/ForkPoolWorker-4] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:02.894812496Z [2024-03-28 00:13:02,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a756572-d450-4f54-9281-533b62b9fa53] succeeded in 3.778668902000163s: None 2024-03-28T00:13:02.963657431Z [2024-03-28 00:13:02,963: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:03.058356858Z [2024-03-28 00:13:03,057: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:13:03.062090349Z [2024-03-28 00:13:03,061: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:03.088556533Z [2024-03-28 00:13:03,088: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:13:03.090018011Z [2024-03-28 00:13:03,089: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:03.090150688Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:03.090257761Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:03.090460419Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:03.090603043Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:13:03.090913653Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:13:03.091113406Z [2024-03-28 00:13:03,090: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:03.095931240Z [2024-03-28 00:13:03,095: INFO/ForkPoolWorker-3] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:03.171942860Z [2024-03-28 00:13:03,171: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:03.473409770Z [2024-03-28 00:13:03,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f89b5ee5-55ac-49b9-b0f6-f35c0b22d5d0] received 2024-03-28T00:13:03.523865055Z [2024-03-28 00:13:03,522: INFO/ForkPoolWorker-15] [f89b5ee5-55ac-49b9-b0f6-f35c0b22d5d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:13:03.812839227Z [2024-03-28 00:13:03,809: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:13:04.905126451Z [2024-03-28 00:13:04,904: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:13:04.908661456Z [2024-03-28 00:13:04,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:13:04.927930098Z [2024-03-28 00:13:04,927: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:13:04.929141542Z [2024-03-28 00:13:04,928: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:13:04.929155183Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:13:04.929186089Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:13:04.929319234Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:13:04.929348284Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:13:04.929843022Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:13:04.929884293Z [2024-03-28 00:13:04,929: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:13:04.935267377Z [2024-03-28 00:13:04,934: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:13:05.032688342Z [2024-03-28 00:13:05,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:13:05.407651371Z [2024-03-28 00:13:05,407: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a0e7cb89-bba6-4bbd-a0e8-bd6a1c360c56] succeeded in 5.031407816999945s: None 2024-03-28T00:13:05.407993589Z [2024-03-28 00:13:05,407: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[faaf0416-d92f-49f1-8cd7-56783d4bb4f3] succeeded in 5.042383071000131s: None 2024-03-28T00:13:05.659559382Z [2024-03-28 00:13:05,659: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[189ac76f-6493-45d0-9a9f-8ed7d1e4bed3] succeeded in 5.2997163739999s: None 2024-03-28T00:13:07.854365373Z [2024-03-28 00:13:07,853: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f89b5ee5-55ac-49b9-b0f6-f35c0b22d5d0] succeeded in 4.343284566999955s: None 2024-03-28T00:14:01.170868144Z [2024-03-28 00:14:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bd77d09-07c7-4705-a3d8-3cb4f22bf7f9] received 2024-03-28T00:14:01.173985664Z [2024-03-28 00:14:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eadd23f-b61e-4f61-b716-5757e9da43d2] received 2024-03-28T00:14:01.178811733Z [2024-03-28 00:14:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ada75a9-aa06-4840-81ad-08852965a35b] received 2024-03-28T00:14:01.191016457Z [2024-03-28 00:14:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10521968-a185-4b84-8761-76ffd36e2a81] received 2024-03-28T00:14:01.195601813Z [2024-03-28 00:14:01,195: INFO/ForkPoolWorker-1] [4ada75a9-aa06-4840-81ad-08852965a35b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:14:01.206708950Z [2024-03-28 00:14:01,206: INFO/ForkPoolWorker-16] [4eadd23f-b61e-4f61-b716-5757e9da43d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:14:01.209247723Z [2024-03-28 00:14:01,208: INFO/ForkPoolWorker-2] [10521968-a185-4b84-8761-76ffd36e2a81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:14:01.225160251Z [2024-03-28 00:14:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b998a9c-7985-49bd-a60f-39b06359e165] received 2024-03-28T00:14:01.228684687Z [2024-03-28 00:14:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b649683-3f2d-43ab-bd5b-05d9ff51e72d] received 2024-03-28T00:14:01.246450333Z [2024-03-28 00:14:01,239: INFO/ForkPoolWorker-15] [2bd77d09-07c7-4705-a3d8-3cb4f22bf7f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:14:01.260478376Z [2024-03-28 00:14:01,260: INFO/ForkPoolWorker-4] [6b649683-3f2d-43ab-bd5b-05d9ff51e72d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:14:01.262452374Z [2024-03-28 00:14:01,262: INFO/ForkPoolWorker-3] [2b998a9c-7985-49bd-a60f-39b06359e165] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:14:01.987758456Z [2024-03-28 00:14:01,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:14:02.007552284Z [2024-03-28 00:14:02,004: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:14:02.251411126Z [2024-03-28 00:14:02,247: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:14:02.427715534Z [2024-03-28 00:14:02,415: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:14:02.517054001Z [2024-03-28 00:14:02,513: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:14:02.550192088Z [2024-03-28 00:14:02,528: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:14:02.663374108Z [2024-03-28 00:14:02,662: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T00:14:02.692632352Z [2024-03-28 00:14:02,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:14:02.778395426Z [2024-03-28 00:14:02,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:14:02.782738494Z [2024-03-28 00:14:02,782: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:14:02.782998583Z [2024-03-28 00:14:02,782: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:14:02.783114058Z [2024-03-28 00:14:02,782: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T00:14:02.783489056Z [2024-03-28 00:14:02,783: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:14:03.054816226Z [2024-03-28 00:14:03,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:03.819891509Z [2024-03-28 00:14:03,819: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:04.085262563Z [2024-03-28 00:14:04,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bd77d09-07c7-4705-a3d8-3cb4f22bf7f9] succeeded in 2.905961318999971s: None 2024-03-28T00:14:04.310985081Z [2024-03-28 00:14:04,310: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:14:04.314715954Z [2024-03-28 00:14:04,314: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:14:04.347241910Z [2024-03-28 00:14:04,347: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:14:04.348801171Z [2024-03-28 00:14:04,348: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:14:04.348994293Z [2024-03-28 00:14:04,348: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:14:04.349137583Z [2024-03-28 00:14:04,348: INFO/ForkPoolWorker-3] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:14:04.349344574Z [2024-03-28 00:14:04,349: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:14:04.349420268Z [2024-03-28 00:14:04,349: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:14:04.350032579Z [2024-03-28 00:14:04,349: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:14:04.350379282Z [2024-03-28 00:14:04,350: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:14:04.355899502Z [2024-03-28 00:14:04,355: INFO/ForkPoolWorker-3] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:14:04.448069889Z [2024-03-28 00:14:04,447: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T00:14:04.452873280Z [2024-03-28 00:14:04,452: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:14:04.503650582Z [2024-03-28 00:14:04,503: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T00:14:04.520054637Z [2024-03-28 00:14:04,519: INFO/ForkPoolWorker-4] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:14:04.520813871Z [2024-03-28 00:14:04,520: INFO/ForkPoolWorker-4] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:14:04.521334193Z [2024-03-28 00:14:04,521: INFO/ForkPoolWorker-4] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:14:04.521914765Z [2024-03-28 00:14:04,521: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:04.521933620Z [2024-03-28 00:14:04,521: INFO/ForkPoolWorker-4] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:14:04.522173231Z [2024-03-28 00:14:04,522: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T00:14:04.522558118Z [2024-03-28 00:14:04,522: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:14:04.524737546Z [2024-03-28 00:14:04,524: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:14:04.545623176Z [2024-03-28 00:14:04,543: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:14:04.653072578Z [2024-03-28 00:14:04,652: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:04.852412187Z [2024-03-28 00:14:04,842: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:14:04.856274251Z [2024-03-28 00:14:04,855: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:14:04.893523209Z [2024-03-28 00:14:04,893: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4eadd23f-b61e-4f61-b716-5757e9da43d2] succeeded in 3.7097066470000755s: None 2024-03-28T00:14:04.901063652Z [2024-03-28 00:14:04,900: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:14:04.902482650Z [2024-03-28 00:14:04,902: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:14:04.903526262Z [2024-03-28 00:14:04,902: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:14:04.903712500Z [2024-03-28 00:14:04,903: INFO/ForkPoolWorker-2] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:14:04.903912301Z [2024-03-28 00:14:04,903: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:14:04.904040335Z [2024-03-28 00:14:04,903: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:14:04.904339428Z [2024-03-28 00:14:04,904: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:14:04.904461774Z [2024-03-28 00:14:04,904: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:14:04.912063489Z [2024-03-28 00:14:04,909: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:14:05.079008630Z [2024-03-28 00:14:05,078: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:05.172133356Z [2024-03-28 00:14:05,171: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:14:05.175777135Z [2024-03-28 00:14:05,175: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:14:05.207441690Z [2024-03-28 00:14:05,207: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:14:05.209172973Z [2024-03-28 00:14:05,208: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:14:05.209367088Z [2024-03-28 00:14:05,209: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:14:05.209657400Z [2024-03-28 00:14:05,209: INFO/ForkPoolWorker-1] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:14:05.209948311Z [2024-03-28 00:14:05,209: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:14:05.210261035Z [2024-03-28 00:14:05,209: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:14:05.211856457Z [2024-03-28 00:14:05,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:14:05.212104319Z [2024-03-28 00:14:05,211: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:14:05.219420541Z [2024-03-28 00:14:05,219: INFO/ForkPoolWorker-1] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:14:05.320722223Z [2024-03-28 00:14:05,320: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:14:06.399809815Z [2024-03-28 00:14:06,399: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2b998a9c-7985-49bd-a60f-39b06359e165] succeeded in 5.169142171999965s: None 2024-03-28T00:14:06.932646074Z [2024-03-28 00:14:06,932: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[6b649683-3f2d-43ab-bd5b-05d9ff51e72d] succeeded in 5.7023309409999s: None 2024-03-28T00:14:08.113286379Z [2024-03-28 00:14:08,112: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ada75a9-aa06-4840-81ad-08852965a35b] succeeded in 6.931679374999931s: None 2024-03-28T00:14:08.220540113Z [2024-03-28 00:14:08,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10521968-a185-4b84-8761-76ffd36e2a81] succeeded in 7.0280943810000736s: None 2024-03-28T00:15:01.014274798Z [2024-03-28 00:15:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e644756f-c936-492b-9977-153915be4d26] received 2024-03-28T00:15:01.019965375Z [2024-03-28 00:15:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efdd1c49-cf80-49fa-a228-5a4cf9c4a4da] received 2024-03-28T00:15:01.023097690Z [2024-03-28 00:15:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31f43c3c-b907-4a07-90dc-699cbf31715f] received 2024-03-28T00:15:01.034069146Z [2024-03-28 00:15:01,033: INFO/ForkPoolWorker-1] [31f43c3c-b907-4a07-90dc-699cbf31715f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:15:01.039300289Z [2024-03-28 00:15:01,038: INFO/ForkPoolWorker-16] [efdd1c49-cf80-49fa-a228-5a4cf9c4a4da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:01.041369995Z [2024-03-28 00:15:01,041: INFO/ForkPoolWorker-15] [e644756f-c936-492b-9977-153915be4d26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:01.055217081Z [2024-03-28 00:15:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5d53564-b7f3-44a5-95a1-1d1a240a1b26] received 2024-03-28T00:15:01.062557321Z [2024-03-28 00:15:01,062: INFO/ForkPoolWorker-2] [b5d53564-b7f3-44a5-95a1-1d1a240a1b26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:15:01.067111649Z [2024-03-28 00:15:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a5e8884-0daa-4809-ab93-62960043c83d] received 2024-03-28T00:15:01.076670215Z [2024-03-28 00:15:01,076: INFO/ForkPoolWorker-3] [6a5e8884-0daa-4809-ab93-62960043c83d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:15:01.088406018Z [2024-03-28 00:15:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e440fe2-0b42-4da2-b379-4d6c3e230201] received 2024-03-28T00:15:01.095988097Z [2024-03-28 00:15:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af275768-5969-4c2e-92f4-48d76fd93004] received 2024-03-28T00:15:01.114283333Z [2024-03-28 00:15:01,113: INFO/ForkPoolWorker-4] [2e440fe2-0b42-4da2-b379-4d6c3e230201] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:15:01.119588323Z [2024-03-28 00:15:01,119: INFO/ForkPoolWorker-5] [af275768-5969-4c2e-92f4-48d76fd93004] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:15:01.495296031Z [2024-03-28 00:15:01,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:01.602089158Z [2024-03-28 00:15:01,598: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:15:01.751418835Z [2024-03-28 00:15:01,747: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:15:01.763318430Z [2024-03-28 00:15:01,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:01.897643160Z [2024-03-28 00:15:01,892: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:15:02.575018115Z [2024-03-28 00:15:02,570: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:15:02.582027765Z [2024-03-28 00:15:02,577: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:15:02.861642903Z [2024-03-28 00:15:02,861: INFO/ForkPoolWorker-4] Getting SDNC list 2024-03-28T00:15:02.867431610Z [2024-03-28 00:15:02,866: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:02.916630299Z [2024-03-28 00:15:02,916: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T00:15:02.918262439Z [2024-03-28 00:15:02,917: INFO/ForkPoolWorker-4] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:15:02.918471147Z [2024-03-28 00:15:02,918: INFO/ForkPoolWorker-4] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:15:02.918966038Z [2024-03-28 00:15:02,918: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-03-28T00:15:02.919671992Z [2024-03-28 00:15:02,919: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:15:03.089761762Z [2024-03-28 00:15:03,089: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:04.543709699Z [2024-03-28 00:15:04,543: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[2e440fe2-0b42-4da2-b379-4d6c3e230201] succeeded in 3.4464961080002467s: None 2024-03-28T00:15:05.181956525Z [2024-03-28 00:15:05,181: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:15:05.186019193Z [2024-03-28 00:15:05,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:05.229642859Z [2024-03-28 00:15:05,229: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:15:05.237353404Z [2024-03-28 00:15:05,236: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:05.251112878Z [2024-03-28 00:15:05,250: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:15:05.253343188Z [2024-03-28 00:15:05,253: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:05.253368411Z [2024-03-28 00:15:05,253: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:05.253512987Z [2024-03-28 00:15:05,253: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:05.253791657Z [2024-03-28 00:15:05,253: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:05.253829935Z [2024-03-28 00:15:05,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:15:05.254259934Z [2024-03-28 00:15:05,254: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:05.254368781Z [2024-03-28 00:15:05,254: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:05.262672890Z [2024-03-28 00:15:05,262: INFO/ForkPoolWorker-5] Getting VIM list 2024-03-28T00:15:05.265141694Z [2024-03-28 00:15:05,264: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:05.270822828Z [2024-03-28 00:15:05,270: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:05.303845043Z [2024-03-28 00:15:05,303: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:15:05.317538606Z [2024-03-28 00:15:05,317: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:05.332228004Z [2024-03-28 00:15:05,331: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:15:05.340389234Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:05.340420862Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:05.340452904Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:05.340664420Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:05.340735319Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:15:05.341071487Z [2024-03-28 00:15:05,340: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:15:05.341088086Z [2024-03-28 00:15:05,341: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:05.352764945Z [2024-03-28 00:15:05,352: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-03-28T00:15:05.366014247Z [2024-03-28 00:15:05,365: INFO/ForkPoolWorker-3] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:05.368264788Z [2024-03-28 00:15:05,366: INFO/ForkPoolWorker-5] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:05.376696390Z [2024-03-28 00:15:05,376: INFO/ForkPoolWorker-5] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:05.376883782Z [2024-03-28 00:15:05,376: INFO/ForkPoolWorker-5] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:05.377390454Z [2024-03-28 00:15:05,376: INFO/ForkPoolWorker-5] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:05.378152926Z [2024-03-28 00:15:05,377: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-03-28T00:15:05.378846498Z [2024-03-28 00:15:05,378: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:15:05.379104860Z [2024-03-28 00:15:05,378: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:05.403642331Z [2024-03-28 00:15:05,403: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:05.469425945Z [2024-03-28 00:15:05,467: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:15:05.490432295Z [2024-03-28 00:15:05,478: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:05.490494886Z [2024-03-28 00:15:05,486: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:05.490516955Z [2024-03-28 00:15:05,486: INFO/ForkPoolWorker-1] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:05.490525671Z [2024-03-28 00:15:05,486: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:05.490530603Z [2024-03-28 00:15:05,486: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:15:05.490535012Z [2024-03-28 00:15:05,487: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:15:05.490555276Z [2024-03-28 00:15:05,487: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:05.512123804Z [2024-03-28 00:15:05,511: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:05.558700595Z [2024-03-28 00:15:05,558: INFO/ForkPoolWorker-1] Creating DAG vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:05.618928911Z [2024-03-28 00:15:05,618: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:05.860619270Z [2024-03-28 00:15:05,860: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:05.861066718Z [2024-03-28 00:15:05,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:06.319320711Z [2024-03-28 00:15:06,318: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:15:06.358765545Z [2024-03-28 00:15:06,358: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:06.560492161Z [2024-03-28 00:15:06,560: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:15:06.587020731Z [2024-03-28 00:15:06,586: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:06.587061849Z [2024-03-28 00:15:06,586: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:06.587194624Z [2024-03-28 00:15:06,587: INFO/ForkPoolWorker-2] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:06.587479191Z [2024-03-28 00:15:06,587: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:06.587593655Z [2024-03-28 00:15:06,587: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:15:06.588034727Z [2024-03-28 00:15:06,587: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:15:06.588220630Z [2024-03-28 00:15:06,587: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:06.630920881Z [2024-03-28 00:15:06,630: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:06.847884754Z [2024-03-28 00:15:06,847: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:07.211341382Z [2024-03-28 00:15:07,209: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:15:07.228782172Z [2024-03-28 00:15:07,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:07.315893706Z [2024-03-28 00:15:07,315: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:15:07.317227240Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:07.317302914Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:07.317368268Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:07.317637088Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:07.317644953Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:15:07.317982742Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:07.318138464Z [2024-03-28 00:15:07,317: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:07.324416824Z [2024-03-28 00:15:07,324: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:07.433229947Z [2024-03-28 00:15:07,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:07.454944943Z [2024-03-28 00:15:07,454: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efdd1c49-cf80-49fa-a228-5a4cf9c4a4da] succeeded in 6.4265267769999355s: None 2024-03-28T00:15:08.137332943Z [2024-03-28 00:15:08,136: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e644756f-c936-492b-9977-153915be4d26] succeeded in 7.119839601999956s: None 2024-03-28T00:15:08.173552445Z [2024-03-28 00:15:08,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c67cafde-c75f-4d09-8102-dc56f84df9f9] received 2024-03-28T00:15:08.178683345Z [2024-03-28 00:15:08,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c197cbd-c798-4806-9a49-b46a8ef4c120] received 2024-03-28T00:15:08.193583023Z [2024-03-28 00:15:08,184: INFO/ForkPoolWorker-16] [7c197cbd-c798-4806-9a49-b46a8ef4c120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'split_metrics', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:08.193609407Z [2024-03-28 00:15:08,185: INFO/ForkPoolWorker-15] [c67cafde-c75f-4d09-8102-dc56f84df9f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:08.773360551Z [2024-03-28 00:15:08,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:08.795136305Z [2024-03-28 00:15:08,794: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[af275768-5969-4c2e-92f4-48d76fd93004] succeeded in 7.692699109999921s: None 2024-03-28T00:15:08.819856222Z [2024-03-28 00:15:08,819: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31f43c3c-b907-4a07-90dc-699cbf31715f] succeeded in 7.794632617000161s: None 2024-03-28T00:15:08.878760167Z [2024-03-28 00:15:08,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:08.947028319Z [2024-03-28 00:15:08,946: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6a5e8884-0daa-4809-ab93-62960043c83d] succeeded in 7.878098955000041s: None 2024-03-28T00:15:09.603253630Z [2024-03-28 00:15:09,602: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b5d53564-b7f3-44a5-95a1-1d1a240a1b26] succeeded in 8.546137233000081s: None 2024-03-28T00:15:10.229781315Z [2024-03-28 00:15:10,229: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:15:10.234252598Z [2024-03-28 00:15:10,233: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:10.271673052Z [2024-03-28 00:15:10,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:15:10.273324824Z [2024-03-28 00:15:10,273: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:10.273513438Z [2024-03-28 00:15:10,273: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:10.273686738Z [2024-03-28 00:15:10,273: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:10.273933962Z [2024-03-28 00:15:10,273: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:10.274067829Z [2024-03-28 00:15:10,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:15:10.274418968Z [2024-03-28 00:15:10,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:10.274578456Z [2024-03-28 00:15:10,274: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:10.281874877Z [2024-03-28 00:15:10,281: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:10.351925995Z [2024-03-28 00:15:10,351: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:15:10.355475394Z [2024-03-28 00:15:10,355: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:10.378118196Z [2024-03-28 00:15:10,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:15:10.386602705Z [2024-03-28 00:15:10,386: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:10.386708649Z [2024-03-28 00:15:10,386: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:10.386834895Z [2024-03-28 00:15:10,386: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:10.387008227Z [2024-03-28 00:15:10,386: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:10.387090317Z [2024-03-28 00:15:10,387: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:15:10.387453831Z [2024-03-28 00:15:10,387: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:10.387569063Z [2024-03-28 00:15:10,387: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:10.396082661Z [2024-03-28 00:15:10,395: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:10.414787374Z [2024-03-28 00:15:10,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:10.473067990Z [2024-03-28 00:15:10,472: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:11.079878401Z [2024-03-28 00:15:11,079: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c197cbd-c798-4806-9a49-b46a8ef4c120] succeeded in 2.903653521000251s: None 2024-03-28T00:15:11.144580645Z [2024-03-28 00:15:11,141: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c67cafde-c75f-4d09-8102-dc56f84df9f9] succeeded in 2.9712555860000975s: None 2024-03-28T00:15:11.341369208Z [2024-03-28 00:15:11,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff5f0e80-4755-4603-bf44-8e8a7df8d943] received 2024-03-28T00:15:11.346810371Z [2024-03-28 00:15:11,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a04fe6d-4089-478b-8d4c-2892d6ddc3bb] received 2024-03-28T00:15:11.351052143Z [2024-03-28 00:15:11,350: INFO/ForkPoolWorker-15] [ff5f0e80-4755-4603-bf44-8e8a7df8d943] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'collect_metrics', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:15:11.356916637Z [2024-03-28 00:15:11,356: INFO/ForkPoolWorker-16] [0a04fe6d-4089-478b-8d4c-2892d6ddc3bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:15:11.740237596Z [2024-03-28 00:15:11,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:11.759267247Z [2024-03-28 00:15:11,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:13.018504202Z [2024-03-28 00:15:13,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:15:13.022191903Z [2024-03-28 00:15:13,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:13.034068331Z [2024-03-28 00:15:13,033: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:15:13.041327613Z [2024-03-28 00:15:13,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:13.043112602Z [2024-03-28 00:15:13,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:15:13.044789558Z [2024-03-28 00:15:13,044: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:13.044969765Z [2024-03-28 00:15:13,044: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:13.045115620Z [2024-03-28 00:15:13,044: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:13.045348008Z [2024-03-28 00:15:13,045: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:13.045546513Z [2024-03-28 00:15:13,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:15:13.046042323Z [2024-03-28 00:15:13,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:13.046238738Z [2024-03-28 00:15:13,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:13.052702037Z [2024-03-28 00:15:13,052: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:13.081271566Z [2024-03-28 00:15:13,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:15:13.084185657Z [2024-03-28 00:15:13,083: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:13.084442714Z [2024-03-28 00:15:13,084: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:13.085369670Z [2024-03-28 00:15:13,084: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:13.085899833Z [2024-03-28 00:15:13,085: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:13.086131360Z [2024-03-28 00:15:13,085: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:15:13.086829913Z [2024-03-28 00:15:13,086: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:13.086994300Z [2024-03-28 00:15:13,086: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:13.097098955Z [2024-03-28 00:15:13,096: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:13.152427757Z [2024-03-28 00:15:13,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:13.209277827Z [2024-03-28 00:15:13,208: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:13.805398791Z [2024-03-28 00:15:13,804: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff5f0e80-4755-4603-bf44-8e8a7df8d943] succeeded in 2.460562129000209s: None 2024-03-28T00:15:13.827961855Z [2024-03-28 00:15:13,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a04fe6d-4089-478b-8d4c-2892d6ddc3bb] succeeded in 2.479221339000105s: None 2024-03-28T00:15:14.610391509Z [2024-03-28 00:15:14,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[468e31a3-7804-4182-8c4e-e22b17e786d6] received 2024-03-28T00:15:14.615143154Z [2024-03-28 00:15:14,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d77d591-4f21-49c3-a78e-73da802ee5f0] received 2024-03-28T00:15:14.623263677Z [2024-03-28 00:15:14,622: INFO/ForkPoolWorker-16] [0d77d591-4f21-49c3-a78e-73da802ee5f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'send_prometheus', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:14.624080149Z [2024-03-28 00:15:14,623: INFO/ForkPoolWorker-15] [468e31a3-7804-4182-8c4e-e22b17e786d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:15:14.896586187Z [2024-03-28 00:15:14,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:14.898059998Z [2024-03-28 00:15:14,894: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:15:16.185414635Z [2024-03-28 00:15:16,184: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:15:16.189247270Z [2024-03-28 00:15:16,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:16.194991523Z [2024-03-28 00:15:16,194: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:15:16.198433489Z [2024-03-28 00:15:16,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:15:16.210098276Z [2024-03-28 00:15:16,209: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:15:16.212168339Z [2024-03-28 00:15:16,211: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:16.212573821Z [2024-03-28 00:15:16,212: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:16.212837788Z [2024-03-28 00:15:16,212: INFO/ForkPoolWorker-15] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:16.213340055Z [2024-03-28 00:15:16,212: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:16.213831836Z [2024-03-28 00:15:16,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:15:16.214220493Z [2024-03-28 00:15:16,214: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:16.214484795Z [2024-03-28 00:15:16,214: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:16.217072509Z [2024-03-28 00:15:16,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:15:16.218390657Z [2024-03-28 00:15:16,218: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:15:16.218431183Z [2024-03-28 00:15:16,218: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:15:16.218529547Z [2024-03-28 00:15:16,218: INFO/ForkPoolWorker-16] Read VIM 03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 (basic_08_vim_test) 2024-03-28T00:15:16.218708995Z [2024-03-28 00:15:16,218: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-03-28T00:15:16.218743506Z [2024-03-28 00:15:16,218: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:15:16.219299686Z [2024-03-28 00:15:16,219: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:15:16.219347548Z [2024-03-28 00:15:16,219: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:15:16.224512155Z [2024-03-28 00:15:16,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:16.225170850Z [2024-03-28 00:15:16,224: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7 2024-03-28T00:15:16.339334084Z [2024-03-28 00:15:16,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:16.359823773Z [2024-03-28 00:15:16,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:15:17.071397771Z [2024-03-28 00:15:17,071: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d77d591-4f21-49c3-a78e-73da802ee5f0] succeeded in 2.454756128999634s: None 2024-03-28T00:15:17.086323914Z [2024-03-28 00:15:17,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[468e31a3-7804-4182-8c4e-e22b17e786d6] succeeded in 2.472478040999704s: None 2024-03-28T00:16:00.301423716Z [2024-03-28 00:16:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[912da5dc-a9c8-4a76-bba4-52422d17bed6] received 2024-03-28T00:16:00.305465317Z [2024-03-28 00:16:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbdbcc67-81cd-43a5-92ee-0b28ccea79f3] received 2024-03-28T00:16:00.312633827Z [2024-03-28 00:16:00,312: INFO/ForkPoolWorker-15] [912da5dc-a9c8-4a76-bba4-52422d17bed6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:16:00.313543014Z [2024-03-28 00:16:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb3c2a38-ef62-427f-95ad-5ccdc6cb4684] received 2024-03-28T00:16:00.317932736Z [2024-03-28 00:16:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[851e2ab1-6ece-49ef-b92a-81a0ba9434f3] received 2024-03-28T00:16:00.321790755Z [2024-03-28 00:16:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6bb5231-5bfa-4f73-9499-b5397bfbd1cb] received 2024-03-28T00:16:00.324363501Z [2024-03-28 00:16:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93de5793-25f0-43a7-aafb-e57322337dc4] received 2024-03-28T00:16:00.332541534Z [2024-03-28 00:16:00,332: INFO/ForkPoolWorker-4] [93de5793-25f0-43a7-aafb-e57322337dc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:16:00.336179637Z [2024-03-28 00:16:00,335: INFO/ForkPoolWorker-3] [c6bb5231-5bfa-4f73-9499-b5397bfbd1cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:16:00.338333822Z [2024-03-28 00:16:00,338: INFO/ForkPoolWorker-1] [fb3c2a38-ef62-427f-95ad-5ccdc6cb4684] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:16:00.339109702Z [2024-03-28 00:16:00,338: INFO/ForkPoolWorker-2] [851e2ab1-6ece-49ef-b92a-81a0ba9434f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:16:00.346173417Z [2024-03-28 00:16:00,345: INFO/ForkPoolWorker-16] [fbdbcc67-81cd-43a5-92ee-0b28ccea79f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:16:00.838288626Z [2024-03-28 00:16:00,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:16:00.897507725Z [2024-03-28 00:16:00,894: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:00.975132056Z [2024-03-28 00:16:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:01.092725344Z [2024-03-28 00:16:01,088: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:01.122616777Z [2024-03-28 00:16:01,118: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:01.411201879Z [2024-03-28 00:16:01,397: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:16:01.489119026Z [2024-03-28 00:16:01,488: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:16:01.838275618Z [2024-03-28 00:16:01,837: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T00:16:01.846567621Z [2024-03-28 00:16:01,846: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:01.869998686Z [2024-03-28 00:16:01,869: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:16:01.872107361Z [2024-03-28 00:16:01,871: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:16:01.872139620Z [2024-03-28 00:16:01,872: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:16:01.872239289Z [2024-03-28 00:16:01,872: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T00:16:01.872877926Z [2024-03-28 00:16:01,872: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:16:02.037406239Z [2024-03-28 00:16:02,037: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:16:02.642709239Z [2024-03-28 00:16:02,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[912da5dc-a9c8-4a76-bba4-52422d17bed6] succeeded in 2.338578872999733s: None 2024-03-28T00:16:02.988953863Z [2024-03-28 00:16:02,988: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c6bb5231-5bfa-4f73-9499-b5397bfbd1cb] succeeded in 2.6654786589997457s: None 2024-03-28T00:16:03.296837533Z [2024-03-28 00:16:03,296: INFO/ForkPoolWorker-4] Getting VIM list 2024-03-28T00:16:03.307064949Z [2024-03-28 00:16:03,306: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:03.370856357Z [2024-03-28 00:16:03,370: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T00:16:03.375371400Z [2024-03-28 00:16:03,374: INFO/ForkPoolWorker-4] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:03.375424066Z [2024-03-28 00:16:03,375: INFO/ForkPoolWorker-4] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:03.375728874Z [2024-03-28 00:16:03,375: INFO/ForkPoolWorker-4] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:03.375829232Z [2024-03-28 00:16:03,375: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-03-28T00:16:03.376250490Z [2024-03-28 00:16:03,376: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:16:03.376352986Z [2024-03-28 00:16:03,376: INFO/ForkPoolWorker-4] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:03.458767585Z [2024-03-28 00:16:03,457: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:16:03.465575099Z [2024-03-28 00:16:03,462: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:03.507847882Z [2024-03-28 00:16:03,503: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:16:03.507874102Z [2024-03-28 00:16:03,505: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:03.507894254Z [2024-03-28 00:16:03,506: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:03.507901259Z [2024-03-28 00:16:03,506: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:03.507907086Z [2024-03-28 00:16:03,506: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:16:03.507911967Z [2024-03-28 00:16:03,506: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:16:03.507917769Z [2024-03-28 00:16:03,506: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:03.521675885Z [2024-03-28 00:16:03,518: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:16:03.630409211Z [2024-03-28 00:16:03,627: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:16:03.816453554Z [2024-03-28 00:16:03,811: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:16:03.823702048Z [2024-03-28 00:16:03,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:03.880819271Z [2024-03-28 00:16:03,880: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:16:03.883758452Z [2024-03-28 00:16:03,883: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:03.883997597Z [2024-03-28 00:16:03,883: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:03.884513923Z [2024-03-28 00:16:03,884: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:03.885857358Z [2024-03-28 00:16:03,885: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:16:03.886107204Z [2024-03-28 00:16:03,885: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:16:03.886204024Z [2024-03-28 00:16:03,886: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:03.902557552Z [2024-03-28 00:16:03,902: WARNING/ForkPoolWorker-16] Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:03.905618285Z [2024-03-28 00:16:03,902: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:03.912875724Z [2024-03-28 00:16:03,912: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:16:03.919387264Z [2024-03-28 00:16:03,918: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:03.963620350Z [2024-03-28 00:16:03,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:16:03.971862957Z [2024-03-28 00:16:03,971: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:03.971950315Z [2024-03-28 00:16:03,971: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:03.972011134Z [2024-03-28 00:16:03,971: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:03.972021732Z [2024-03-28 00:16:03,971: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:16:03.972236422Z [2024-03-28 00:16:03,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:16:03.972262020Z [2024-03-28 00:16:03,972: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:03.978379278Z [2024-03-28 00:16:03,977: ERROR/ForkPoolWorker-16] [fbdbcc67-81cd-43a5-92ee-0b28ccea79f3] Failed to execute task Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:16:03.978401959Z Traceback (most recent call last): 2024-03-28T00:16:03.978406697Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:16:03.978411495Z args.func(args) 2024-03-28T00:16:03.978415489Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:16:03.978419442Z return func(*args, **kwargs) 2024-03-28T00:16:03.978422783Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:16:03.978426008Z return f(*args, **kwargs) 2024-03-28T00:16:03.978429271Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:16:03.978447441Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:16:03.978451264Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:16:03.978455047Z raise AirflowException( 2024-03-28T00:16:03.978459347Z airflow.exceptions.AirflowException: Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:16:04.028058308Z [2024-03-28 00:16:04,027: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:16:04.035607936Z [2024-03-28 00:16:04,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:04.072488235Z [2024-03-28 00:16:04,071: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fbdbcc67-81cd-43a5-92ee-0b28ccea79f3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fbdbcc67-81cd-43a5-92ee-0b28ccea79f3') 2024-03-28T00:16:04.072511385Z Traceback (most recent call last): 2024-03-28T00:16:04.072515712Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:16:04.072518885Z R = retval = fun(*args, **kwargs) 2024-03-28T00:16:04.072522015Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:16:04.072553567Z return self.run(*args, **kwargs) 2024-03-28T00:16:04.072558205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:16:04.072562247Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:16:04.072565659Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:16:04.072569597Z raise AirflowException(msg) 2024-03-28T00:16:04.072573728Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fbdbcc67-81cd-43a5-92ee-0b28ccea79f3 2024-03-28T00:16:04.102208504Z [2024-03-28 00:16:04,101: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:16:04.106147203Z [2024-03-28 00:16:04,105: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:04.106172299Z [2024-03-28 00:16:04,106: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:04.106225123Z [2024-03-28 00:16:04,106: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:04.106281398Z [2024-03-28 00:16:04,106: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:16:04.106632741Z [2024-03-28 00:16:04,106: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:16:04.107353221Z [2024-03-28 00:16:04,106: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:04.130012589Z [2024-03-28 00:16:04,129: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:04.131071964Z [2024-03-28 00:16:04,130: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:04.132131772Z [2024-03-28 00:16:04,131: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:16:04.134995733Z [2024-03-28 00:16:04,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:04.176817801Z [2024-03-28 00:16:04,176: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:16:04.178427803Z [2024-03-28 00:16:04,178: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:04.179009219Z [2024-03-28 00:16:04,178: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:04.179161904Z [2024-03-28 00:16:04,178: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:04.179410966Z [2024-03-28 00:16:04,179: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:16:04.179914601Z [2024-03-28 00:16:04,179: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:16:04.179993899Z [2024-03-28 00:16:04,179: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:04.184192974Z [2024-03-28 00:16:04,183: ERROR/ForkPoolWorker-1] [fb3c2a38-ef62-427f-95ad-5ccdc6cb4684] Failed to execute task Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:16:04.184236879Z Traceback (most recent call last): 2024-03-28T00:16:04.184242986Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:16:04.184248727Z args.func(args) 2024-03-28T00:16:04.184254124Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:16:04.184259542Z return func(*args, **kwargs) 2024-03-28T00:16:04.184264453Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:16:04.184269411Z return f(*args, **kwargs) 2024-03-28T00:16:04.184274171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:16:04.184278973Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:16:04.184283018Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:16:04.184286225Z raise AirflowException( 2024-03-28T00:16:04.184290611Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:16:04.240624223Z [2024-03-28 00:16:04,239: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb3c2a38-ef62-427f-95ad-5ccdc6cb4684] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb3c2a38-ef62-427f-95ad-5ccdc6cb4684') 2024-03-28T00:16:04.240647668Z Traceback (most recent call last): 2024-03-28T00:16:04.240653994Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:16:04.240658811Z R = retval = fun(*args, **kwargs) 2024-03-28T00:16:04.240663932Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:16:04.240669179Z return self.run(*args, **kwargs) 2024-03-28T00:16:04.240674591Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:16:04.240679812Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:16:04.240702388Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:16:04.240708731Z raise AirflowException(msg) 2024-03-28T00:16:04.240714513Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb3c2a38-ef62-427f-95ad-5ccdc6cb4684 2024-03-28T00:16:05.330359192Z [2024-03-28 00:16:05,329: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[93de5793-25f0-43a7-aafb-e57322337dc4] succeeded in 5.0044400900001165s: None 2024-03-28T00:16:05.873762059Z [2024-03-28 00:16:05,872: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[851e2ab1-6ece-49ef-b92a-81a0ba9434f3] succeeded in 5.550532341999769s: None 2024-03-28T00:16:14.425534947Z [2024-03-28 00:16:14,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[749fb533-c1b7-4098-ae0d-5472e19f4ef6] received 2024-03-28T00:16:14.427389814Z [2024-03-28 00:16:14,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[527554b1-8d39-45c9-afd5-0689c86b217b] received 2024-03-28T00:16:14.436842735Z [2024-03-28 00:16:14,436: INFO/ForkPoolWorker-15] [749fb533-c1b7-4098-ae0d-5472e19f4ef6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:16:14.437387794Z [2024-03-28 00:16:14,437: INFO/ForkPoolWorker-16] [527554b1-8d39-45c9-afd5-0689c86b217b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:16:14.702053028Z [2024-03-28 00:16:14,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:14.719822531Z [2024-03-28 00:16:14,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:15.868191661Z [2024-03-28 00:16:15,867: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:16:15.871311066Z [2024-03-28 00:16:15,870: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:15.895718376Z [2024-03-28 00:16:15,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:16:15.897123020Z [2024-03-28 00:16:15,896: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:15.897178742Z [2024-03-28 00:16:15,897: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:15.897459009Z [2024-03-28 00:16:15,897: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:15.897715446Z [2024-03-28 00:16:15,897: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:16:15.898129260Z [2024-03-28 00:16:15,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:16:15.898170006Z [2024-03-28 00:16:15,898: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:15.904853041Z [2024-03-28 00:16:15,904: WARNING/ForkPoolWorker-16] Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:15.905843236Z [2024-03-28 00:16:15,904: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:16:15.906801552Z [2024-03-28 00:16:15,906: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:16:15.907948900Z [2024-03-28 00:16:15,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:16:15.909543095Z [2024-03-28 00:16:15,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:15.911839658Z [2024-03-28 00:16:15,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:15.925814886Z [2024-03-28 00:16:15,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:16:15.927532960Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:15.927583572Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:15.927692534Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:15.927729914Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:16:15.927993194Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:16:15.928036734Z [2024-03-28 00:16:15,927: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:15.931728226Z [2024-03-28 00:16:15,931: ERROR/ForkPoolWorker-16] [527554b1-8d39-45c9-afd5-0689c86b217b] Failed to execute task Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:16:15.931743338Z Traceback (most recent call last): 2024-03-28T00:16:15.931747493Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:16:15.931751786Z args.func(args) 2024-03-28T00:16:15.931755694Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:16:15.931759374Z return func(*args, **kwargs) 2024-03-28T00:16:15.931762538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:16:15.931765772Z return f(*args, **kwargs) 2024-03-28T00:16:15.931768869Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:16:15.931772111Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:16:15.931775217Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:16:15.931778689Z raise AirflowException( 2024-03-28T00:16:15.931782410Z airflow.exceptions.AirflowException: Dag 'vim_status_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:16:15.938871585Z [2024-03-28 00:16:15,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:16:15.938878662Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:15.938882383Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:15.938886195Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:15.938890085Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:16:15.938893131Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:16:15.938896203Z [2024-03-28 00:16:15,938: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:15.947214180Z [2024-03-28 00:16:15,945: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:15.947263294Z [2024-03-28 00:16:15,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:16:15.948492894Z [2024-03-28 00:16:15,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:16:15.951625730Z [2024-03-28 00:16:15,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:16:15.963685048Z [2024-03-28 00:16:15,963: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[527554b1-8d39-45c9-afd5-0689c86b217b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 527554b1-8d39-45c9-afd5-0689c86b217b') 2024-03-28T00:16:15.963699879Z Traceback (most recent call last): 2024-03-28T00:16:15.963703732Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:16:15.963706760Z R = retval = fun(*args, **kwargs) 2024-03-28T00:16:15.963709793Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:16:15.963712814Z return self.run(*args, **kwargs) 2024-03-28T00:16:15.963716302Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:16:15.963755228Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:16:15.963758689Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:16:15.963762420Z raise AirflowException(msg) 2024-03-28T00:16:15.963766154Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 527554b1-8d39-45c9-afd5-0689c86b217b 2024-03-28T00:16:15.970339723Z [2024-03-28 00:16:15,970: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:16:15.971817032Z [2024-03-28 00:16:15,971: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:16:15.971833250Z [2024-03-28 00:16:15,971: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:16:15.971941319Z [2024-03-28 00:16:15,971: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:16:15.971975593Z [2024-03-28 00:16:15,971: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:16:15.972191980Z [2024-03-28 00:16:15,972: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:16:15.972203130Z [2024-03-28 00:16:15,972: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:16:15.976551642Z [2024-03-28 00:16:15,975: ERROR/ForkPoolWorker-15] [749fb533-c1b7-4098-ae0d-5472e19f4ef6] Failed to execute task Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T00:16:15.976568364Z Traceback (most recent call last): 2024-03-28T00:16:15.976588577Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T00:16:15.976612138Z args.func(args) 2024-03-28T00:16:15.976617931Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T00:16:15.976623054Z return func(*args, **kwargs) 2024-03-28T00:16:15.976626516Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T00:16:15.976629472Z return f(*args, **kwargs) 2024-03-28T00:16:15.976632525Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T00:16:15.976635529Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T00:16:15.976638566Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T00:16:15.976641608Z raise AirflowException( 2024-03-28T00:16:15.976645241Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_03b3e83c-ddaa-4e59-a83a-c1ded4549bb7' could not be found; either it does not exist or it failed to parse. 2024-03-28T00:16:16.012131261Z [2024-03-28 00:16:16,011: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[749fb533-c1b7-4098-ae0d-5472e19f4ef6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 749fb533-c1b7-4098-ae0d-5472e19f4ef6') 2024-03-28T00:16:16.012151895Z Traceback (most recent call last): 2024-03-28T00:16:16.012155925Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T00:16:16.012159100Z R = retval = fun(*args, **kwargs) 2024-03-28T00:16:16.012162190Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T00:16:16.012165481Z return self.run(*args, **kwargs) 2024-03-28T00:16:16.012169070Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T00:16:16.012173086Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T00:16:16.012176120Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T00:16:16.012179584Z raise AirflowException(msg) 2024-03-28T00:16:16.012183502Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 749fb533-c1b7-4098-ae0d-5472e19f4ef6 2024-03-28T00:17:01.203393326Z [2024-03-28 00:17:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c601e306-c82d-4a08-bf3c-4d0ced0028c2] received 2024-03-28T00:17:01.206829608Z [2024-03-28 00:17:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f14872b9-52ca-47fb-a5aa-b2dd887e637f] received 2024-03-28T00:17:01.213582899Z [2024-03-28 00:17:01,213: INFO/ForkPoolWorker-15] [c601e306-c82d-4a08-bf3c-4d0ced0028c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:17:01.219070984Z [2024-03-28 00:17:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a82ed28-3487-4170-aecd-76ab8c0346f9] received 2024-03-28T00:17:01.221710732Z [2024-03-28 00:17:01,221: INFO/ForkPoolWorker-16] [f14872b9-52ca-47fb-a5aa-b2dd887e637f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:17:01.233723433Z [2024-03-28 00:17:01,233: INFO/ForkPoolWorker-1] [7a82ed28-3487-4170-aecd-76ab8c0346f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:17:01.527531781Z [2024-03-28 00:17:01,524: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:17:01.569269634Z [2024-03-28 00:17:01,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:17:01.574814445Z [2024-03-28 00:17:01,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:17:01.745230400Z [2024-03-28 00:17:01,744: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:17:01.750478240Z [2024-03-28 00:17:01,749: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:17:01.785344556Z [2024-03-28 00:17:01,784: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:17:01.790472978Z [2024-03-28 00:17:01,790: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:17:01.790748067Z [2024-03-28 00:17:01,790: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:17:01.790917277Z [2024-03-28 00:17:01,790: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:17:01.791297442Z [2024-03-28 00:17:01,791: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:17:01.903796414Z [2024-03-28 00:17:01,903: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:17:02.510694924Z [2024-03-28 00:17:02,510: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a82ed28-3487-4170-aecd-76ab8c0346f9] succeeded in 1.289209135999954s: None 2024-03-28T00:17:02.754116140Z [2024-03-28 00:17:02,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:17:02.757461301Z [2024-03-28 00:17:02,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:17:02.778753818Z [2024-03-28 00:17:02,778: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:17:02.780084684Z [2024-03-28 00:17:02,779: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:17:02.780096799Z [2024-03-28 00:17:02,779: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:17:02.780239190Z [2024-03-28 00:17:02,780: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:17:02.780248323Z [2024-03-28 00:17:02,780: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:17:02.780510985Z [2024-03-28 00:17:02,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:17:02.780538044Z [2024-03-28 00:17:02,780: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:17:02.891253099Z [2024-03-28 00:17:02,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:17:02.992300332Z [2024-03-28 00:17:02,991: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:17:02.995872991Z [2024-03-28 00:17:02,995: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:17:03.029681003Z [2024-03-28 00:17:03,029: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:17:03.031181951Z [2024-03-28 00:17:03,030: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:17:03.031203651Z [2024-03-28 00:17:03,031: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:17:03.031399829Z [2024-03-28 00:17:03,031: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:17:03.031562844Z [2024-03-28 00:17:03,031: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:17:03.032061003Z [2024-03-28 00:17:03,031: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:17:03.032191614Z [2024-03-28 00:17:03,031: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:17:03.180705012Z [2024-03-28 00:17:03,180: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:17:04.504503458Z [2024-03-28 00:17:04,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c601e306-c82d-4a08-bf3c-4d0ced0028c2] succeeded in 3.297610600000098s: None 2024-03-28T00:17:05.204651302Z [2024-03-28 00:17:05,204: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f14872b9-52ca-47fb-a5aa-b2dd887e637f] succeeded in 3.995622386999912s: None 2024-03-28T00:18:00.326245836Z [2024-03-28 00:18:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cfd6b88-5167-44b6-8039-e0111bb8fca0] received 2024-03-28T00:18:00.328198579Z [2024-03-28 00:18:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29909c2a-ae0e-4cfc-b9f7-9eb7fefc45e2] received 2024-03-28T00:18:00.341078772Z [2024-03-28 00:18:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bd3a0de-fe35-49b5-90b6-de5e819b7080] received 2024-03-28T00:18:00.341385996Z [2024-03-28 00:18:00,340: INFO/ForkPoolWorker-16] [29909c2a-ae0e-4cfc-b9f7-9eb7fefc45e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:18:00.341923808Z [2024-03-28 00:18:00,341: INFO/ForkPoolWorker-15] [1cfd6b88-5167-44b6-8039-e0111bb8fca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:18:00.343470448Z [2024-03-28 00:18:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc087d4e-3ce0-4e15-90a7-fcd7711f2dba] received 2024-03-28T00:18:00.354089118Z [2024-03-28 00:18:00,353: INFO/ForkPoolWorker-1] [5bd3a0de-fe35-49b5-90b6-de5e819b7080] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:18:00.357059009Z [2024-03-28 00:18:00,356: INFO/ForkPoolWorker-2] [dc087d4e-3ce0-4e15-90a7-fcd7711f2dba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:18:00.667447765Z [2024-03-28 00:18:00,663: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:18:00.697688850Z [2024-03-28 00:18:00,693: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:18:00.770254077Z [2024-03-28 00:18:00,766: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:18:00.784629885Z [2024-03-28 00:18:00,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:18:00.880255833Z [2024-03-28 00:18:00,879: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:18:00.884476669Z [2024-03-28 00:18:00,883: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:18:00.916263029Z [2024-03-28 00:18:00,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:18:00.917741141Z [2024-03-28 00:18:00,917: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:18:00.917805294Z [2024-03-28 00:18:00,917: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:18:00.917853168Z [2024-03-28 00:18:00,917: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:18:00.918047014Z [2024-03-28 00:18:00,917: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:18:00.984562197Z [2024-03-28 00:18:00,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:18:01.019032541Z [2024-03-28 00:18:01,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:18:01.654795963Z [2024-03-28 00:18:01,654: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5bd3a0de-fe35-49b5-90b6-de5e819b7080] succeeded in 1.3095699390000846s: None 2024-03-28T00:18:01.837976729Z [2024-03-28 00:18:01,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29909c2a-ae0e-4cfc-b9f7-9eb7fefc45e2] succeeded in 1.5070769109997855s: None 2024-03-28T00:18:02.307370567Z [2024-03-28 00:18:02,306: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:18:02.311256528Z [2024-03-28 00:18:02,310: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:18:02.339452212Z [2024-03-28 00:18:02,339: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:18:02.340967817Z [2024-03-28 00:18:02,340: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:18:02.340997564Z [2024-03-28 00:18:02,340: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:18:02.341105845Z [2024-03-28 00:18:02,340: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:18:02.341230789Z [2024-03-28 00:18:02,341: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:18:02.341597357Z [2024-03-28 00:18:02,341: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:18:02.341645115Z [2024-03-28 00:18:02,341: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:18:02.436879949Z [2024-03-28 00:18:02,436: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:18:02.438406533Z [2024-03-28 00:18:02,438: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:18:02.441282288Z [2024-03-28 00:18:02,440: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:18:02.474935175Z [2024-03-28 00:18:02,474: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:18:02.477597194Z [2024-03-28 00:18:02,477: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:18:02.478062566Z [2024-03-28 00:18:02,477: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:18:02.478399897Z [2024-03-28 00:18:02,478: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:18:02.478604768Z [2024-03-28 00:18:02,478: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:18:02.479483612Z [2024-03-28 00:18:02,479: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:18:02.479676953Z [2024-03-28 00:18:02,479: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:18:02.617343607Z [2024-03-28 00:18:02,617: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:18:04.414865125Z [2024-03-28 00:18:04,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dc087d4e-3ce0-4e15-90a7-fcd7711f2dba] succeeded in 4.069435013000202s: None 2024-03-28T00:18:04.682641018Z [2024-03-28 00:18:04,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cfd6b88-5167-44b6-8039-e0111bb8fca0] succeeded in 4.3532419940002s: None 2024-03-28T00:19:00.631720116Z [2024-03-28 00:19:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69cd5e52-fb60-47f0-ab64-1b3923367525] received 2024-03-28T00:19:00.634795338Z [2024-03-28 00:19:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[258cc297-48e3-4001-bb50-d643ebfe41e7] received 2024-03-28T00:19:00.638818205Z [2024-03-28 00:19:00,638: INFO/ForkPoolWorker-15] [69cd5e52-fb60-47f0-ab64-1b3923367525] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:19:00.644501818Z [2024-03-28 00:19:00,644: INFO/ForkPoolWorker-16] [258cc297-48e3-4001-bb50-d643ebfe41e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:19:00.650315686Z [2024-03-28 00:19:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ee11ef1-902e-4a38-8169-896c2b7b3d59] received 2024-03-28T00:19:00.659062269Z [2024-03-28 00:19:00,658: INFO/ForkPoolWorker-1] [6ee11ef1-902e-4a38-8169-896c2b7b3d59] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:19:00.979675397Z [2024-03-28 00:19:00,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:19:00.986049015Z [2024-03-28 00:19:00,980: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:19:00.987215113Z [2024-03-28 00:19:00,983: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:19:01.149210960Z [2024-03-28 00:19:01,148: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:19:01.153608486Z [2024-03-28 00:19:01,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:19:01.179832614Z [2024-03-28 00:19:01,179: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:19:01.181313761Z [2024-03-28 00:19:01,181: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:19:01.181561322Z [2024-03-28 00:19:01,181: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:19:01.181755108Z [2024-03-28 00:19:01,181: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:19:01.182029753Z [2024-03-28 00:19:01,181: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:19:01.307993402Z [2024-03-28 00:19:01,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:19:01.993071478Z [2024-03-28 00:19:01,992: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ee11ef1-902e-4a38-8169-896c2b7b3d59] succeeded in 1.3408273899999585s: None 2024-03-28T00:19:02.268986918Z [2024-03-28 00:19:02,268: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:19:02.273219042Z [2024-03-28 00:19:02,272: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:19:02.293986871Z [2024-03-28 00:19:02,293: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:19:02.295657811Z [2024-03-28 00:19:02,295: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:19:02.295776532Z [2024-03-28 00:19:02,295: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:19:02.296014544Z [2024-03-28 00:19:02,295: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:19:02.296129641Z [2024-03-28 00:19:02,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:19:02.296435170Z [2024-03-28 00:19:02,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:19:02.296617812Z [2024-03-28 00:19:02,296: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:19:02.390471605Z [2024-03-28 00:19:02,390: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:19:02.532716934Z [2024-03-28 00:19:02,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:19:02.537113184Z [2024-03-28 00:19:02,536: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:19:02.575880208Z [2024-03-28 00:19:02,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:19:02.578180154Z [2024-03-28 00:19:02,577: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:19:02.578491629Z [2024-03-28 00:19:02,578: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:19:02.580652816Z [2024-03-28 00:19:02,580: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:19:02.580863115Z [2024-03-28 00:19:02,580: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:19:02.581270384Z [2024-03-28 00:19:02,581: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:19:02.581550729Z [2024-03-28 00:19:02,581: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:19:02.716333370Z [2024-03-28 00:19:02,715: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:19:04.258595107Z [2024-03-28 00:19:04,258: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[258cc297-48e3-4001-bb50-d643ebfe41e7] succeeded in 3.619798660000015s: None 2024-03-28T00:19:04.441367722Z [2024-03-28 00:19:04,440: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69cd5e52-fb60-47f0-ab64-1b3923367525] succeeded in 3.8074110359998485s: None 2024-03-28T00:20:01.210841935Z [2024-03-28 00:20:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6661c271-1ac3-4f9e-8d0a-8974a0b63b1c] received 2024-03-28T00:20:01.214520570Z [2024-03-28 00:20:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0641187-b865-4422-858a-6c3c2b6ecb04] received 2024-03-28T00:20:01.222604326Z [2024-03-28 00:20:01,221: INFO/ForkPoolWorker-16] [e0641187-b865-4422-858a-6c3c2b6ecb04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:20:01.222636436Z [2024-03-28 00:20:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f28f107-78b3-4c95-8d97-8045eebc9b06] received 2024-03-28T00:20:01.222752348Z [2024-03-28 00:20:01,221: INFO/ForkPoolWorker-15] [6661c271-1ac3-4f9e-8d0a-8974a0b63b1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:20:01.225198752Z [2024-03-28 00:20:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[047ae2ac-e13b-415e-a672-5180ff0a777d] received 2024-03-28T00:20:01.239209532Z [2024-03-28 00:20:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f29d650a-f539-46f2-a025-4018ff8fd7b4] received 2024-03-28T00:20:01.261419051Z [2024-03-28 00:20:01,260: INFO/ForkPoolWorker-2] [047ae2ac-e13b-415e-a672-5180ff0a777d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:20:01.266719955Z [2024-03-28 00:20:01,266: INFO/ForkPoolWorker-1] [1f28f107-78b3-4c95-8d97-8045eebc9b06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:20:01.267962187Z [2024-03-28 00:20:01,267: INFO/ForkPoolWorker-3] [f29d650a-f539-46f2-a025-4018ff8fd7b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:20:01.657521075Z [2024-03-28 00:20:01,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:20:01.723919852Z [2024-03-28 00:20:01,719: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:20:01.761923161Z [2024-03-28 00:20:01,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:20:01.879006580Z [2024-03-28 00:20:01,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:20:02.000792667Z [2024-03-28 00:20:01,986: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:20:02.131683041Z [2024-03-28 00:20:02,131: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:02.481683031Z [2024-03-28 00:20:02,481: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T00:20:02.490944777Z [2024-03-28 00:20:02,490: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:02.525797973Z [2024-03-28 00:20:02,525: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:20:02.527546304Z [2024-03-28 00:20:02,527: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:20:02.527864835Z [2024-03-28 00:20:02,527: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:20:02.528082149Z [2024-03-28 00:20:02,527: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T00:20:02.528616859Z [2024-03-28 00:20:02,528: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:20:02.732753803Z [2024-03-28 00:20:02,732: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:02.997051341Z [2024-03-28 00:20:02,996: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[047ae2ac-e13b-415e-a672-5180ff0a777d] succeeded in 1.7685583670004235s: None 2024-03-28T00:20:03.681650351Z [2024-03-28 00:20:03,680: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f29d650a-f539-46f2-a025-4018ff8fd7b4] succeeded in 2.4356036630001654s: None 2024-03-28T00:20:03.832924458Z [2024-03-28 00:20:03,832: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:20:03.838491674Z [2024-03-28 00:20:03,837: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:03.865600986Z [2024-03-28 00:20:03,865: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:20:03.867655481Z [2024-03-28 00:20:03,867: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:03.867668770Z [2024-03-28 00:20:03,867: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:03.867979675Z [2024-03-28 00:20:03,867: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:03.868129721Z [2024-03-28 00:20:03,867: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:20:03.868630315Z [2024-03-28 00:20:03,868: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:20:03.868767753Z [2024-03-28 00:20:03,868: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:03.948274357Z [2024-03-28 00:20:03,945: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:20:03.955549191Z [2024-03-28 00:20:03,954: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:03.974841433Z [2024-03-28 00:20:03,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:03.980966770Z [2024-03-28 00:20:03,980: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:20:03.982778876Z [2024-03-28 00:20:03,982: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:03.982826139Z [2024-03-28 00:20:03,982: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:03.983057400Z [2024-03-28 00:20:03,982: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:03.983131453Z [2024-03-28 00:20:03,983: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:20:03.983481083Z [2024-03-28 00:20:03,983: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:20:03.983603487Z [2024-03-28 00:20:03,983: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:04.021604581Z [2024-03-28 00:20:04,021: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:20:04.025793453Z [2024-03-28 00:20:04,025: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:04.050929399Z [2024-03-28 00:20:04,050: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:20:04.052820462Z [2024-03-28 00:20:04,052: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:04.052911586Z [2024-03-28 00:20:04,052: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:04.053084167Z [2024-03-28 00:20:04,052: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:04.053161019Z [2024-03-28 00:20:04,053: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:20:04.053591373Z [2024-03-28 00:20:04,053: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:20:04.053712533Z [2024-03-28 00:20:04,053: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:04.109724312Z [2024-03-28 00:20:04,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:04.144504560Z [2024-03-28 00:20:04,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:05.046074665Z [2024-03-28 00:20:05,045: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f28f107-78b3-4c95-8d97-8045eebc9b06] succeeded in 3.819754055999965s: None 2024-03-28T00:20:05.905224989Z [2024-03-28 00:20:05,904: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0641187-b865-4422-858a-6c3c2b6ecb04] succeeded in 4.688966913000058s: None 2024-03-28T00:20:05.977748009Z [2024-03-28 00:20:05,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbda302-93d6-48d3-9c8e-6428bdf16542] received 2024-03-28T00:20:05.988056918Z [2024-03-28 00:20:05,987: INFO/ForkPoolWorker-16] [2bbda302-93d6-48d3-9c8e-6428bdf16542] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:20:06.310062652Z [2024-03-28 00:20:06,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:20:06.708679151Z [2024-03-28 00:20:06,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6661c271-1ac3-4f9e-8d0a-8974a0b63b1c] succeeded in 5.495583430999886s: None 2024-03-28T00:20:07.558901352Z [2024-03-28 00:20:07,558: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:20:07.562913647Z [2024-03-28 00:20:07,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:07.582481985Z [2024-03-28 00:20:07,582: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:20:07.584505260Z [2024-03-28 00:20:07,584: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:07.584764580Z [2024-03-28 00:20:07,584: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:07.585216799Z [2024-03-28 00:20:07,584: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:07.585440168Z [2024-03-28 00:20:07,585: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:20:07.586044017Z [2024-03-28 00:20:07,585: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:20:07.586296324Z [2024-03-28 00:20:07,586: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:07.696324494Z [2024-03-28 00:20:07,695: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:08.400727779Z [2024-03-28 00:20:08,400: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bbda302-93d6-48d3-9c8e-6428bdf16542] succeeded in 2.4168870209996385s: None 2024-03-28T00:20:08.710678073Z [2024-03-28 00:20:08,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99dbecd-8dbe-455a-acac-82b9e164444d] received 2024-03-28T00:20:08.721925974Z [2024-03-28 00:20:08,721: INFO/ForkPoolWorker-15] [c99dbecd-8dbe-455a-acac-82b9e164444d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:20:09.052903813Z [2024-03-28 00:20:09,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:20:10.424369136Z [2024-03-28 00:20:10,423: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:20:10.431063865Z [2024-03-28 00:20:10,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:10.479572896Z [2024-03-28 00:20:10,479: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:20:10.482294983Z [2024-03-28 00:20:10,482: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:10.482486776Z [2024-03-28 00:20:10,482: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:10.482751116Z [2024-03-28 00:20:10,482: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:10.482898023Z [2024-03-28 00:20:10,482: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:20:10.483226350Z [2024-03-28 00:20:10,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:20:10.484048513Z [2024-03-28 00:20:10,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:10.580566972Z [2024-03-28 00:20:10,580: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:11.160059196Z [2024-03-28 00:20:11,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67fd502c-450c-4dd6-850a-f73748b92b2d] received 2024-03-28T00:20:11.176284906Z [2024-03-28 00:20:11,175: INFO/ForkPoolWorker-16] [67fd502c-450c-4dd6-850a-f73748b92b2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:20:11.239326692Z [2024-03-28 00:20:11,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c99dbecd-8dbe-455a-acac-82b9e164444d] succeeded in 2.5255739429999267s: None 2024-03-28T00:20:11.599821528Z [2024-03-28 00:20:11,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:20:12.751652030Z [2024-03-28 00:20:12,751: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:20:12.755347196Z [2024-03-28 00:20:12,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:20:12.777590010Z [2024-03-28 00:20:12,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:20:12.778916792Z [2024-03-28 00:20:12,778: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:20:12.778935743Z [2024-03-28 00:20:12,778: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:20:12.779005433Z [2024-03-28 00:20:12,778: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:20:12.779029193Z [2024-03-28 00:20:12,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:20:12.779263770Z [2024-03-28 00:20:12,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:20:12.779316895Z [2024-03-28 00:20:12,779: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:20:12.856052588Z [2024-03-28 00:20:12,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:20:13.391536946Z [2024-03-28 00:20:13,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67fd502c-450c-4dd6-850a-f73748b92b2d] succeeded in 2.229770835999716s: None 2024-03-28T00:21:00.386724908Z [2024-03-28 00:21:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e686471a-aabd-4050-b0b9-9b6c0b411de7] received 2024-03-28T00:21:00.395061744Z [2024-03-28 00:21:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2a569ec-9d97-4e54-b965-9d19ab9d5797] received 2024-03-28T00:21:00.397921651Z [2024-03-28 00:21:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00f9c47-eff3-4405-849b-b68b56c81454] received 2024-03-28T00:21:00.403473233Z [2024-03-28 00:21:00,403: INFO/ForkPoolWorker-15] [e686471a-aabd-4050-b0b9-9b6c0b411de7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:21:00.406670498Z [2024-03-28 00:21:00,406: INFO/ForkPoolWorker-1] [b00f9c47-eff3-4405-849b-b68b56c81454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:21:00.417579439Z [2024-03-28 00:21:00,417: INFO/ForkPoolWorker-16] [f2a569ec-9d97-4e54-b965-9d19ab9d5797] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:21:00.763626253Z [2024-03-28 00:21:00,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:21:00.767983251Z [2024-03-28 00:21:00,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:21:00.895654325Z [2024-03-28 00:21:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:21:01.092613020Z [2024-03-28 00:21:01,092: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:21:01.097151610Z [2024-03-28 00:21:01,096: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:21:01.137540572Z [2024-03-28 00:21:01,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:21:01.140651460Z [2024-03-28 00:21:01,140: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:21:01.141079462Z [2024-03-28 00:21:01,140: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:21:01.141400870Z [2024-03-28 00:21:01,141: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:21:01.142475402Z [2024-03-28 00:21:01,142: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:21:01.306094578Z [2024-03-28 00:21:01,305: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:21:02.082230911Z [2024-03-28 00:21:02,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2a569ec-9d97-4e54-b965-9d19ab9d5797] succeeded in 1.6796246869998868s: None 2024-03-28T00:21:02.264023091Z [2024-03-28 00:21:02,263: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:21:02.268008662Z [2024-03-28 00:21:02,267: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:21:02.303031296Z [2024-03-28 00:21:02,302: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:21:02.306574293Z [2024-03-28 00:21:02,306: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:21:02.306791941Z [2024-03-28 00:21:02,306: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:21:02.307165459Z [2024-03-28 00:21:02,306: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:21:02.307356666Z [2024-03-28 00:21:02,307: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:21:02.308075601Z [2024-03-28 00:21:02,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:21:02.308422229Z [2024-03-28 00:21:02,308: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:21:02.435567903Z [2024-03-28 00:21:02,435: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:21:02.529394851Z [2024-03-28 00:21:02,528: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:21:02.533266498Z [2024-03-28 00:21:02,532: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:21:02.565651813Z [2024-03-28 00:21:02,564: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:21:02.567721105Z [2024-03-28 00:21:02,567: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:21:02.567768130Z [2024-03-28 00:21:02,567: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:21:02.567992306Z [2024-03-28 00:21:02,567: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:21:02.568010559Z [2024-03-28 00:21:02,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:21:02.568383473Z [2024-03-28 00:21:02,568: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:21:02.568398019Z [2024-03-28 00:21:02,568: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:21:02.667313149Z [2024-03-28 00:21:02,666: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:21:04.174478633Z [2024-03-28 00:21:04,173: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e686471a-aabd-4050-b0b9-9b6c0b411de7] succeeded in 3.7853367309999157s: None 2024-03-28T00:21:04.548205431Z [2024-03-28 00:21:04,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b00f9c47-eff3-4405-849b-b68b56c81454] succeeded in 4.148575327999879s: None 2024-03-28T00:22:00.764982402Z [2024-03-28 00:22:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc583f04-3531-413b-b3f0-ea0f46b4a427] received 2024-03-28T00:22:00.773711694Z [2024-03-28 00:22:00,773: INFO/ForkPoolWorker-15] [dc583f04-3531-413b-b3f0-ea0f46b4a427] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:22:00.775474037Z [2024-03-28 00:22:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89e1b03b-a2c2-4a13-822e-7b0591cb1b19] received 2024-03-28T00:22:00.783215159Z [2024-03-28 00:22:00,782: INFO/ForkPoolWorker-16] [89e1b03b-a2c2-4a13-822e-7b0591cb1b19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:22:00.787824319Z [2024-03-28 00:22:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d9fbaa8-bbfa-469e-b62f-03233867f5dc] received 2024-03-28T00:22:00.795299017Z [2024-03-28 00:22:00,794: INFO/ForkPoolWorker-1] [8d9fbaa8-bbfa-469e-b62f-03233867f5dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:22:00.795827970Z [2024-03-28 00:22:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f1b1c67-940f-4375-a95a-f1a63af473d6] received 2024-03-28T00:22:00.803176302Z [2024-03-28 00:22:00,802: INFO/ForkPoolWorker-2] [9f1b1c67-940f-4375-a95a-f1a63af473d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:22:01.280825220Z [2024-03-28 00:22:01,276: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:22:01.348660870Z [2024-03-28 00:22:01,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:22:01.388703287Z [2024-03-28 00:22:01,385: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:22:01.509403095Z [2024-03-28 00:22:01,503: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:22:01.554220121Z [2024-03-28 00:22:01,553: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:22:01.561220852Z [2024-03-28 00:22:01,560: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:22:01.594846555Z [2024-03-28 00:22:01,594: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:22:01.596466403Z [2024-03-28 00:22:01,596: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:22:01.596594875Z [2024-03-28 00:22:01,596: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:22:01.596691023Z [2024-03-28 00:22:01,596: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:22:01.597091397Z [2024-03-28 00:22:01,596: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:22:01.690218478Z [2024-03-28 00:22:01,689: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:22:01.836009391Z [2024-03-28 00:22:01,835: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:22:02.552321838Z [2024-03-28 00:22:02,551: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc583f04-3531-413b-b3f0-ea0f46b4a427] succeeded in 1.7854179300002215s: None 2024-03-28T00:22:02.662821359Z [2024-03-28 00:22:02,662: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f1b1c67-940f-4375-a95a-f1a63af473d6] succeeded in 1.865159821999896s: None 2024-03-28T00:22:03.176674725Z [2024-03-28 00:22:03,176: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:22:03.180833695Z [2024-03-28 00:22:03,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:22:03.205914009Z [2024-03-28 00:22:03,205: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:22:03.208233128Z [2024-03-28 00:22:03,207: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:22:03.208258351Z [2024-03-28 00:22:03,208: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:22:03.208573241Z [2024-03-28 00:22:03,208: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:22:03.208717532Z [2024-03-28 00:22:03,208: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:22:03.209403268Z [2024-03-28 00:22:03,209: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:22:03.209834669Z [2024-03-28 00:22:03,209: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:22:03.313544212Z [2024-03-28 00:22:03,313: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:22:03.356521231Z [2024-03-28 00:22:03,356: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:22:03.360585973Z [2024-03-28 00:22:03,360: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:22:03.383492296Z [2024-03-28 00:22:03,383: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:22:03.385291100Z [2024-03-28 00:22:03,385: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:22:03.385423407Z [2024-03-28 00:22:03,385: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:22:03.385694127Z [2024-03-28 00:22:03,385: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:22:03.385840527Z [2024-03-28 00:22:03,385: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:22:03.386226659Z [2024-03-28 00:22:03,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:22:03.386650652Z [2024-03-28 00:22:03,386: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:22:03.481499841Z [2024-03-28 00:22:03,481: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:22:05.332922394Z [2024-03-28 00:22:05,332: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d9fbaa8-bbfa-469e-b62f-03233867f5dc] succeeded in 4.54353398000012s: None 2024-03-28T00:22:05.942365492Z [2024-03-28 00:22:05,941: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89e1b03b-a2c2-4a13-822e-7b0591cb1b19] succeeded in 5.164932724000209s: None 2024-03-28T00:23:01.117355320Z [2024-03-28 00:23:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ac83a9f-ad79-4353-ad86-635ada22e1a0] received 2024-03-28T00:23:01.120691852Z [2024-03-28 00:23:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[808906a4-5973-4af7-b9a8-1328d5afe82e] received 2024-03-28T00:23:01.126668715Z [2024-03-28 00:23:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbd0584e-438e-4ec7-9def-457102a370e3] received 2024-03-28T00:23:01.128225452Z [2024-03-28 00:23:01,127: INFO/ForkPoolWorker-15] [5ac83a9f-ad79-4353-ad86-635ada22e1a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:23:01.133825267Z [2024-03-28 00:23:01,133: INFO/ForkPoolWorker-16] [808906a4-5973-4af7-b9a8-1328d5afe82e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:23:01.146120461Z [2024-03-28 00:23:01,145: INFO/ForkPoolWorker-1] [cbd0584e-438e-4ec7-9def-457102a370e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:23:01.465643052Z [2024-03-28 00:23:01,462: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:23:01.486744025Z [2024-03-28 00:23:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:23:01.632905066Z [2024-03-28 00:23:01,628: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:23:01.822304805Z [2024-03-28 00:23:01,821: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:23:01.827848159Z [2024-03-28 00:23:01,826: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:23:01.873794808Z [2024-03-28 00:23:01,873: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:23:01.877603032Z [2024-03-28 00:23:01,877: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:23:01.877968311Z [2024-03-28 00:23:01,877: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:23:01.878117367Z [2024-03-28 00:23:01,877: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:23:01.878447088Z [2024-03-28 00:23:01,878: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:23:02.013080085Z [2024-03-28 00:23:02,012: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:23:02.893121863Z [2024-03-28 00:23:02,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbd0584e-438e-4ec7-9def-457102a370e3] succeeded in 1.7628627779999988s: None 2024-03-28T00:23:02.990191018Z [2024-03-28 00:23:02,989: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:23:02.994439326Z [2024-03-28 00:23:02,993: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:23:03.026884371Z [2024-03-28 00:23:03,026: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:23:03.028549684Z [2024-03-28 00:23:03,028: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:23:03.028670099Z [2024-03-28 00:23:03,028: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:23:03.028876560Z [2024-03-28 00:23:03,028: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:23:03.028965070Z [2024-03-28 00:23:03,028: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:23:03.029386238Z [2024-03-28 00:23:03,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:23:03.029393667Z [2024-03-28 00:23:03,029: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:23:03.144541763Z [2024-03-28 00:23:03,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:23:03.540451294Z [2024-03-28 00:23:03,540: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:23:03.544662270Z [2024-03-28 00:23:03,544: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:23:03.598318761Z [2024-03-28 00:23:03,598: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:23:03.602333008Z [2024-03-28 00:23:03,602: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:23:03.602378702Z [2024-03-28 00:23:03,602: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:23:03.602493983Z [2024-03-28 00:23:03,602: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:23:03.602543877Z [2024-03-28 00:23:03,602: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:23:03.605600952Z [2024-03-28 00:23:03,605: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:23:03.605689345Z [2024-03-28 00:23:03,605: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:23:03.745213450Z [2024-03-28 00:23:03,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:23:05.169520903Z [2024-03-28 00:23:05,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[808906a4-5973-4af7-b9a8-1328d5afe82e] succeeded in 4.046494043000166s: None 2024-03-28T00:23:05.388482981Z [2024-03-28 00:23:05,387: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ac83a9f-ad79-4353-ad86-635ada22e1a0] succeeded in 4.267284136999933s: None 2024-03-28T00:24:00.530992636Z [2024-03-28 00:24:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5934574-b7ce-4948-88d4-2ef9f3e17632] received 2024-03-28T00:24:00.536416502Z [2024-03-28 00:24:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d17fbbf3-a137-4199-ac0b-54329ba2b622] received 2024-03-28T00:24:00.551495985Z [2024-03-28 00:24:00,551: INFO/ForkPoolWorker-16] [d17fbbf3-a137-4199-ac0b-54329ba2b622] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:24:00.554657890Z [2024-03-28 00:24:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed9c8566-2f2b-4651-ada4-06032fc4fe19] received 2024-03-28T00:24:00.557700644Z [2024-03-28 00:24:00,555: INFO/ForkPoolWorker-15] [b5934574-b7ce-4948-88d4-2ef9f3e17632] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:24:00.570832512Z [2024-03-28 00:24:00,570: INFO/ForkPoolWorker-1] [ed9c8566-2f2b-4651-ada4-06032fc4fe19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:24:00.592099247Z [2024-03-28 00:24:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d506ff-2aeb-4e52-af7e-83d17673b5b7] received 2024-03-28T00:24:00.631461048Z [2024-03-28 00:24:00,625: INFO/ForkPoolWorker-2] [43d506ff-2aeb-4e52-af7e-83d17673b5b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:24:01.752857546Z [2024-03-28 00:24:01,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:24:01.955792953Z [2024-03-28 00:24:01,950: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:24:01.977265517Z [2024-03-28 00:24:01,972: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:24:02.008350468Z [2024-03-28 00:24:01,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:24:02.257505769Z [2024-03-28 00:24:02,256: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:24:02.263134824Z [2024-03-28 00:24:02,262: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:24:02.371294406Z [2024-03-28 00:24:02,371: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:24:02.380114857Z [2024-03-28 00:24:02,379: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:24:02.382141935Z [2024-03-28 00:24:02,379: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:24:02.382731505Z [2024-03-28 00:24:02,382: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:24:02.383083790Z [2024-03-28 00:24:02,382: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:24:02.777357982Z [2024-03-28 00:24:02,776: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:24:02.924815601Z [2024-03-28 00:24:02,924: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:24:04.840018129Z [2024-03-28 00:24:04,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[43d506ff-2aeb-4e52-af7e-83d17673b5b7] succeeded in 4.244552470000144s: None 2024-03-28T00:24:05.374222531Z [2024-03-28 00:24:05,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5934574-b7ce-4948-88d4-2ef9f3e17632] succeeded in 4.836254878000091s: None 2024-03-28T00:24:06.047551431Z [2024-03-28 00:24:06,047: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:24:06.051087886Z [2024-03-28 00:24:06,050: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:24:06.103017189Z [2024-03-28 00:24:06,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:24:06.104493645Z [2024-03-28 00:24:06,104: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:24:06.104564581Z [2024-03-28 00:24:06,104: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:24:06.104707471Z [2024-03-28 00:24:06,104: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:24:06.104788517Z [2024-03-28 00:24:06,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:24:06.105110506Z [2024-03-28 00:24:06,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:24:06.105204602Z [2024-03-28 00:24:06,105: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:24:06.276112200Z [2024-03-28 00:24:06,275: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:24:06.590085059Z [2024-03-28 00:24:06,589: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:24:06.594904480Z [2024-03-28 00:24:06,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:24:06.659895719Z [2024-03-28 00:24:06,659: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:24:06.661166434Z [2024-03-28 00:24:06,660: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:24:06.661180279Z [2024-03-28 00:24:06,661: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:24:06.661309482Z [2024-03-28 00:24:06,661: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:24:06.661383198Z [2024-03-28 00:24:06,661: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:24:06.661673862Z [2024-03-28 00:24:06,661: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:24:06.661741648Z [2024-03-28 00:24:06,661: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:24:06.835237830Z [2024-03-28 00:24:06,834: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:24:08.946268579Z [2024-03-28 00:24:08,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d17fbbf3-a137-4199-ac0b-54329ba2b622] succeeded in 8.408343413999773s: None 2024-03-28T00:24:09.644539542Z [2024-03-28 00:24:09,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed9c8566-2f2b-4651-ada4-06032fc4fe19] succeeded in 9.085173831000247s: None 2024-03-28T00:25:00.499101329Z [2024-03-28 00:25:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab199cdc-4cdf-4a73-94f9-21c06591b090] received 2024-03-28T00:25:00.502517309Z [2024-03-28 00:25:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9da761e-3646-45f8-8ca3-f67fcd07bf55] received 2024-03-28T00:25:00.507483369Z [2024-03-28 00:25:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63af5bef-d6ab-44ba-b609-35299cdeab89] received 2024-03-28T00:25:00.518484799Z [2024-03-28 00:25:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1aa4aedf-364f-4bb9-94e4-d17929f70181] received 2024-03-28T00:25:00.519361539Z [2024-03-28 00:25:00,518: INFO/ForkPoolWorker-15] [ab199cdc-4cdf-4a73-94f9-21c06591b090] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:25:00.539167501Z [2024-03-28 00:25:00,518: INFO/ForkPoolWorker-16] [e9da761e-3646-45f8-8ca3-f67fcd07bf55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:25:00.540335217Z [2024-03-28 00:25:00,539: INFO/ForkPoolWorker-2] [1aa4aedf-364f-4bb9-94e4-d17929f70181] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:25:00.541788047Z [2024-03-28 00:25:00,541: INFO/ForkPoolWorker-1] [63af5bef-d6ab-44ba-b609-35299cdeab89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:25:00.928956360Z [2024-03-28 00:25:00,924: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:25:01.058077172Z [2024-03-28 00:25:01,054: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:25:01.164210288Z [2024-03-28 00:25:01,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:25:01.267018114Z [2024-03-28 00:25:01,262: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:25:01.625786307Z [2024-03-28 00:25:01,623: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:25:01.638880201Z [2024-03-28 00:25:01,635: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:01.713908588Z [2024-03-28 00:25:01,713: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:25:01.718117971Z [2024-03-28 00:25:01,717: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:25:01.719868357Z [2024-03-28 00:25:01,718: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:25:01.722287408Z [2024-03-28 00:25:01,722: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:25:01.724972070Z [2024-03-28 00:25:01,723: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:25:01.920295163Z [2024-03-28 00:25:01,920: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:03.101768035Z [2024-03-28 00:25:03,101: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1aa4aedf-364f-4bb9-94e4-d17929f70181] succeeded in 2.5745261039996876s: None 2024-03-28T00:25:03.867515698Z [2024-03-28 00:25:03,867: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:25:03.872229396Z [2024-03-28 00:25:03,871: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:03.917332115Z [2024-03-28 00:25:03,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:25:03.923707594Z [2024-03-28 00:25:03,923: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:03.924488667Z [2024-03-28 00:25:03,923: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:03.925723851Z [2024-03-28 00:25:03,924: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:03.926595506Z [2024-03-28 00:25:03,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:25:03.929009443Z [2024-03-28 00:25:03,928: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:25:03.929494605Z [2024-03-28 00:25:03,929: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:04.073467070Z [2024-03-28 00:25:04,072: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:25:04.101880925Z [2024-03-28 00:25:04,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:04.192494166Z [2024-03-28 00:25:04,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:25:04.193974213Z [2024-03-28 00:25:04,193: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:04.194166335Z [2024-03-28 00:25:04,193: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:04.194396228Z [2024-03-28 00:25:04,194: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:04.194574570Z [2024-03-28 00:25:04,194: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:25:04.200707993Z [2024-03-28 00:25:04,200: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:25:04.200737623Z [2024-03-28 00:25:04,200: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:04.244806863Z [2024-03-28 00:25:04,244: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:04.400818667Z [2024-03-28 00:25:04,400: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:25:04.407747952Z [2024-03-28 00:25:04,407: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:04.441566783Z [2024-03-28 00:25:04,441: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:25:04.463027773Z [2024-03-28 00:25:04,462: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:04.463405234Z [2024-03-28 00:25:04,462: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:04.463700123Z [2024-03-28 00:25:04,463: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:04.463930176Z [2024-03-28 00:25:04,463: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:25:04.464354047Z [2024-03-28 00:25:04,464: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:25:04.464408000Z [2024-03-28 00:25:04,464: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:04.466019737Z [2024-03-28 00:25:04,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:04.679561247Z [2024-03-28 00:25:04,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:05.472961029Z [2024-03-28 00:25:05,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab199cdc-4cdf-4a73-94f9-21c06591b090] succeeded in 4.9662941199999295s: None 2024-03-28T00:25:06.316583325Z [2024-03-28 00:25:06,316: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9da761e-3646-45f8-8ca3-f67fcd07bf55] succeeded in 5.8101297090001935s: None 2024-03-28T00:25:06.395079141Z [2024-03-28 00:25:06,394: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63af5bef-d6ab-44ba-b609-35299cdeab89] succeeded in 5.881614787000217s: None 2024-03-28T00:25:06.466670607Z [2024-03-28 00:25:06,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[509074d8-b957-4f74-9514-f605e46aede1] received 2024-03-28T00:25:06.475077939Z [2024-03-28 00:25:06,474: INFO/ForkPoolWorker-15] [509074d8-b957-4f74-9514-f605e46aede1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:25:06.794743640Z [2024-03-28 00:25:06,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:25:08.222332026Z [2024-03-28 00:25:08,221: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:25:08.225934706Z [2024-03-28 00:25:08,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:08.251314596Z [2024-03-28 00:25:08,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:25:08.252668890Z [2024-03-28 00:25:08,252: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:08.252813664Z [2024-03-28 00:25:08,252: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:08.253007492Z [2024-03-28 00:25:08,252: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:08.253091972Z [2024-03-28 00:25:08,252: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:25:08.253455641Z [2024-03-28 00:25:08,253: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:25:08.253616824Z [2024-03-28 00:25:08,253: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:08.330584085Z [2024-03-28 00:25:08,330: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:09.297298162Z [2024-03-28 00:25:09,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[509074d8-b957-4f74-9514-f605e46aede1] succeeded in 2.8286033520003s: None 2024-03-28T00:25:10.243116011Z [2024-03-28 00:25:10,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ea4e04f-1fa8-44a2-8874-e44e8b1342ef] received 2024-03-28T00:25:10.266208216Z [2024-03-28 00:25:10,265: INFO/ForkPoolWorker-15] [1ea4e04f-1fa8-44a2-8874-e44e8b1342ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:25:10.587826791Z [2024-03-28 00:25:10,583: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:25:11.958089304Z [2024-03-28 00:25:11,957: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:25:11.961502379Z [2024-03-28 00:25:11,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:11.980372046Z [2024-03-28 00:25:11,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:25:11.981764698Z [2024-03-28 00:25:11,981: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:11.981777649Z [2024-03-28 00:25:11,981: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:11.982029670Z [2024-03-28 00:25:11,981: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:11.982112586Z [2024-03-28 00:25:11,981: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:25:11.982382919Z [2024-03-28 00:25:11,982: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:25:11.982458154Z [2024-03-28 00:25:11,982: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:12.067824911Z [2024-03-28 00:25:12,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:12.675562885Z [2024-03-28 00:25:12,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ea4e04f-1fa8-44a2-8874-e44e8b1342ef] succeeded in 2.428191029000118s: None 2024-03-28T00:25:13.113075456Z [2024-03-28 00:25:13,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50eaeb33-2c60-4403-940c-2130b58d100a] received 2024-03-28T00:25:13.133752874Z [2024-03-28 00:25:13,133: INFO/ForkPoolWorker-15] [50eaeb33-2c60-4403-940c-2130b58d100a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:25:13.480836022Z [2024-03-28 00:25:13,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:25:14.926292105Z [2024-03-28 00:25:14,925: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:25:14.930393283Z [2024-03-28 00:25:14,929: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:25:14.955040962Z [2024-03-28 00:25:14,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:25:14.956673289Z [2024-03-28 00:25:14,956: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:25:14.956914226Z [2024-03-28 00:25:14,956: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:25:14.957159039Z [2024-03-28 00:25:14,956: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:25:14.957323049Z [2024-03-28 00:25:14,957: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:25:14.958787194Z [2024-03-28 00:25:14,958: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:25:14.958997787Z [2024-03-28 00:25:14,958: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:25:15.068034342Z [2024-03-28 00:25:15,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:25:16.011237999Z [2024-03-28 00:25:16,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50eaeb33-2c60-4403-940c-2130b58d100a] succeeded in 2.8930066999996598s: None 2024-03-28T00:26:00.814477250Z [2024-03-28 00:26:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86975223-087a-4611-be46-cc8dc2480d5c] received 2024-03-28T00:26:00.819145198Z [2024-03-28 00:26:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6feda9d0-24b7-40d7-8613-50aed1e2c19a] received 2024-03-28T00:26:00.824616398Z [2024-03-28 00:26:00,824: INFO/ForkPoolWorker-15] [86975223-087a-4611-be46-cc8dc2480d5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:26:00.826158715Z [2024-03-28 00:26:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baafd794-ba75-47aa-a8f6-232c6f8d52c2] received 2024-03-28T00:26:00.828424012Z [2024-03-28 00:26:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3320050-a25c-404a-8fbe-f71100ba8261] received 2024-03-28T00:26:00.831194799Z [2024-03-28 00:26:00,828: INFO/ForkPoolWorker-16] [6feda9d0-24b7-40d7-8613-50aed1e2c19a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:26:00.838121734Z [2024-03-28 00:26:00,837: INFO/ForkPoolWorker-2] [e3320050-a25c-404a-8fbe-f71100ba8261] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:26:00.838799859Z [2024-03-28 00:26:00,838: INFO/ForkPoolWorker-1] [baafd794-ba75-47aa-a8f6-232c6f8d52c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:26:01.157566972Z [2024-03-28 00:26:01,154: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:26:01.161644357Z [2024-03-28 00:26:01,157: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:26:01.222726346Z [2024-03-28 00:26:01,218: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:26:01.423725686Z [2024-03-28 00:26:01,419: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:26:01.585029844Z [2024-03-28 00:26:01,584: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:26:01.592867701Z [2024-03-28 00:26:01,592: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:26:01.630285911Z [2024-03-28 00:26:01,629: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:26:01.632740050Z [2024-03-28 00:26:01,632: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:26:01.633677431Z [2024-03-28 00:26:01,632: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:26:01.634255009Z [2024-03-28 00:26:01,633: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:26:01.634791881Z [2024-03-28 00:26:01,634: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:26:01.664745027Z [2024-03-28 00:26:01,664: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:26:01.818651143Z [2024-03-28 00:26:01,818: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:26:02.516741844Z [2024-03-28 00:26:02,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86975223-087a-4611-be46-cc8dc2480d5c] succeeded in 1.7000801279996267s: None 2024-03-28T00:26:02.728137224Z [2024-03-28 00:26:02,727: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3320050-a25c-404a-8fbe-f71100ba8261] succeeded in 1.8958310929997424s: None 2024-03-28T00:26:02.775464812Z [2024-03-28 00:26:02,775: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:26:02.779772506Z [2024-03-28 00:26:02,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:26:02.805586514Z [2024-03-28 00:26:02,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:26:02.808015952Z [2024-03-28 00:26:02,807: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:26:02.812130722Z [2024-03-28 00:26:02,807: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:26:02.814278400Z [2024-03-28 00:26:02,812: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:26:02.815931510Z [2024-03-28 00:26:02,814: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:26:02.817329031Z [2024-03-28 00:26:02,817: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:26:02.817720612Z [2024-03-28 00:26:02,817: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:26:02.955725233Z [2024-03-28 00:26:02,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:26:03.150047044Z [2024-03-28 00:26:03,149: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:26:03.154270242Z [2024-03-28 00:26:03,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:26:03.178324915Z [2024-03-28 00:26:03,178: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:26:03.181234827Z [2024-03-28 00:26:03,180: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:26:03.181453714Z [2024-03-28 00:26:03,181: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:26:03.181736348Z [2024-03-28 00:26:03,181: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:26:03.181943162Z [2024-03-28 00:26:03,181: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:26:03.182358172Z [2024-03-28 00:26:03,182: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:26:03.182503137Z [2024-03-28 00:26:03,182: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:26:03.281806507Z [2024-03-28 00:26:03,281: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:26:04.863016403Z [2024-03-28 00:26:04,862: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6feda9d0-24b7-40d7-8613-50aed1e2c19a] succeeded in 4.041339431999859s: None 2024-03-28T00:26:04.958409786Z [2024-03-28 00:26:04,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[baafd794-ba75-47aa-a8f6-232c6f8d52c2] succeeded in 4.1296451060002255s: None 2024-03-28T00:27:01.024509819Z [2024-03-28 00:27:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[161f0267-881f-42eb-ac57-73808c633ff2] received 2024-03-28T00:27:01.028767981Z [2024-03-28 00:27:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24abd338-6f56-4f41-9b19-fa297f7045d0] received 2024-03-28T00:27:01.035385520Z [2024-03-28 00:27:01,035: INFO/ForkPoolWorker-15] [161f0267-881f-42eb-ac57-73808c633ff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:27:01.036345938Z [2024-03-28 00:27:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67e11b69-f7b9-4915-bfae-95754645031c] received 2024-03-28T00:27:01.041880551Z [2024-03-28 00:27:01,041: INFO/ForkPoolWorker-16] [24abd338-6f56-4f41-9b19-fa297f7045d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:27:01.048410296Z [2024-03-28 00:27:01,047: INFO/ForkPoolWorker-1] [67e11b69-f7b9-4915-bfae-95754645031c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:27:01.400791616Z [2024-03-28 00:27:01,395: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:27:01.586991500Z [2024-03-28 00:27:01,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:27:01.607756249Z [2024-03-28 00:27:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:27:01.777379133Z [2024-03-28 00:27:01,776: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:27:01.781934552Z [2024-03-28 00:27:01,781: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:27:01.816710070Z [2024-03-28 00:27:01,816: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:27:01.818723423Z [2024-03-28 00:27:01,818: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:27:01.818839236Z [2024-03-28 00:27:01,818: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:27:01.818895728Z [2024-03-28 00:27:01,818: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:27:01.819493813Z [2024-03-28 00:27:01,819: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:27:01.962848702Z [2024-03-28 00:27:01,962: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:27:02.731374463Z [2024-03-28 00:27:02,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67e11b69-f7b9-4915-bfae-95754645031c] succeeded in 1.6920460830001502s: None 2024-03-28T00:27:02.842804735Z [2024-03-28 00:27:02,842: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:27:02.847029825Z [2024-03-28 00:27:02,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:27:02.885669621Z [2024-03-28 00:27:02,885: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:27:02.887371809Z [2024-03-28 00:27:02,887: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:27:02.887593740Z [2024-03-28 00:27:02,887: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:27:02.887857751Z [2024-03-28 00:27:02,887: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:27:02.888014947Z [2024-03-28 00:27:02,887: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:27:02.888503272Z [2024-03-28 00:27:02,888: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:27:02.888898058Z [2024-03-28 00:27:02,888: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:27:02.968847198Z [2024-03-28 00:27:02,968: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:27:02.972481570Z [2024-03-28 00:27:02,971: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:27:02.995487241Z [2024-03-28 00:27:02,995: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:27:02.999134126Z [2024-03-28 00:27:02,998: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:27:02.999163027Z [2024-03-28 00:27:02,999: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:27:02.999241536Z [2024-03-28 00:27:02,999: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:27:02.999275106Z [2024-03-28 00:27:02,999: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:27:02.999636394Z [2024-03-28 00:27:02,999: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:27:02.999650637Z [2024-03-28 00:27:02,999: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:27:03.002604142Z [2024-03-28 00:27:03,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:27:03.101436381Z [2024-03-28 00:27:03,100: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:27:05.263951120Z [2024-03-28 00:27:05,263: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[161f0267-881f-42eb-ac57-73808c633ff2] succeeded in 4.233709147999889s: None 2024-03-28T00:27:06.228849195Z [2024-03-28 00:27:06,228: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24abd338-6f56-4f41-9b19-fa297f7045d0] succeeded in 5.1956219959997725s: None 2024-03-28T00:28:00.651543977Z [2024-03-28 00:28:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53f4145c-6d1d-4ea3-86fb-a0b40144a343] received 2024-03-28T00:28:00.653256694Z [2024-03-28 00:28:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22a04cf2-afd5-4063-a9f9-08b71021bac6] received 2024-03-28T00:28:00.656257398Z [2024-03-28 00:28:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9be3c348-e587-440d-bbf4-e870d7cb0403] received 2024-03-28T00:28:00.658236934Z [2024-03-28 00:28:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27573bf6-b447-4199-aef2-4b52d367d669] received 2024-03-28T00:28:00.670956555Z [2024-03-28 00:28:00,670: INFO/ForkPoolWorker-15] [53f4145c-6d1d-4ea3-86fb-a0b40144a343] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:28:00.673517668Z [2024-03-28 00:28:00,673: INFO/ForkPoolWorker-1] [9be3c348-e587-440d-bbf4-e870d7cb0403] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:28:00.675684854Z [2024-03-28 00:28:00,675: INFO/ForkPoolWorker-16] [22a04cf2-afd5-4063-a9f9-08b71021bac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:28:00.678199088Z [2024-03-28 00:28:00,677: INFO/ForkPoolWorker-2] [27573bf6-b447-4199-aef2-4b52d367d669] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:28:00.989975342Z [2024-03-28 00:28:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:28:01.080560575Z [2024-03-28 00:28:01,068: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:28:01.114620759Z [2024-03-28 00:28:01,110: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:28:01.131914575Z [2024-03-28 00:28:01,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:28:01.315382336Z [2024-03-28 00:28:01,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:28:01.367489729Z [2024-03-28 00:28:01,367: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:28:01.371579881Z [2024-03-28 00:28:01,371: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:28:01.410314792Z [2024-03-28 00:28:01,410: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:28:01.414305485Z [2024-03-28 00:28:01,412: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:28:01.414805491Z [2024-03-28 00:28:01,414: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:28:01.414965421Z [2024-03-28 00:28:01,414: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:28:01.415915427Z [2024-03-28 00:28:01,415: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:28:01.550349099Z [2024-03-28 00:28:01,550: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:28:01.926142431Z [2024-03-28 00:28:01,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53f4145c-6d1d-4ea3-86fb-a0b40144a343] succeeded in 1.2718078590000914s: None 2024-03-28T00:28:02.276557150Z [2024-03-28 00:28:02,276: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27573bf6-b447-4199-aef2-4b52d367d669] succeeded in 1.6163275630001408s: None 2024-03-28T00:28:02.504468835Z [2024-03-28 00:28:02,504: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:28:02.508147579Z [2024-03-28 00:28:02,507: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:28:02.535858744Z [2024-03-28 00:28:02,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:28:02.537783558Z [2024-03-28 00:28:02,537: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:28:02.538052688Z [2024-03-28 00:28:02,537: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:28:02.538308194Z [2024-03-28 00:28:02,537: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:28:02.538505927Z [2024-03-28 00:28:02,538: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:28:02.539080109Z [2024-03-28 00:28:02,538: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:28:02.539618938Z [2024-03-28 00:28:02,539: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:28:02.676421881Z [2024-03-28 00:28:02,675: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:28:02.680208257Z [2024-03-28 00:28:02,679: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:28:02.688183398Z [2024-03-28 00:28:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:28:02.702717355Z [2024-03-28 00:28:02,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:28:02.704408566Z [2024-03-28 00:28:02,704: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:28:02.704447626Z [2024-03-28 00:28:02,704: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:28:02.704649254Z [2024-03-28 00:28:02,704: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:28:02.704738477Z [2024-03-28 00:28:02,704: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:28:02.705245013Z [2024-03-28 00:28:02,704: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:28:02.705416499Z [2024-03-28 00:28:02,705: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:28:02.833439130Z [2024-03-28 00:28:02,833: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:28:04.466277811Z [2024-03-28 00:28:04,465: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9be3c348-e587-440d-bbf4-e870d7cb0403] succeeded in 3.8058792379997612s: None 2024-03-28T00:28:04.682123050Z [2024-03-28 00:28:04,681: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22a04cf2-afd5-4063-a9f9-08b71021bac6] succeeded in 4.025756542999716s: None 2024-03-28T00:29:00.241442585Z [2024-03-28 00:29:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03b3e0d1-bf07-46f8-aeb3-8b14d7442cb3] received 2024-03-28T00:29:00.242993508Z [2024-03-28 00:29:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9767ee99-d79c-46d8-91b9-3215a64981dc] received 2024-03-28T00:29:00.247497769Z [2024-03-28 00:29:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6fd1d2c-b5ec-4262-9c59-eff81cf3e77f] received 2024-03-28T00:29:00.256551189Z [2024-03-28 00:29:00,256: INFO/ForkPoolWorker-15] [03b3e0d1-bf07-46f8-aeb3-8b14d7442cb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:29:00.257441844Z [2024-03-28 00:29:00,257: INFO/ForkPoolWorker-16] [9767ee99-d79c-46d8-91b9-3215a64981dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:29:00.260764332Z [2024-03-28 00:29:00,260: INFO/ForkPoolWorker-1] [f6fd1d2c-b5ec-4262-9c59-eff81cf3e77f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:29:00.535502704Z [2024-03-28 00:29:00,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:29:00.549816204Z [2024-03-28 00:29:00,546: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:29:00.584378995Z [2024-03-28 00:29:00,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:29:00.724788820Z [2024-03-28 00:29:00,724: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:29:00.729257585Z [2024-03-28 00:29:00,728: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:29:00.749332432Z [2024-03-28 00:29:00,749: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:29:00.750464957Z [2024-03-28 00:29:00,750: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:29:00.750515252Z [2024-03-28 00:29:00,750: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:29:00.750524166Z [2024-03-28 00:29:00,750: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:29:00.750773645Z [2024-03-28 00:29:00,750: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:29:00.848076146Z [2024-03-28 00:29:00,847: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:29:01.618663796Z [2024-03-28 00:29:01,617: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6fd1d2c-b5ec-4262-9c59-eff81cf3e77f] succeeded in 1.3687828730003275s: None 2024-03-28T00:29:01.924017266Z [2024-03-28 00:29:01,923: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:29:01.937549028Z [2024-03-28 00:29:01,936: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:29:01.976342953Z [2024-03-28 00:29:01,976: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:29:01.977801248Z [2024-03-28 00:29:01,977: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:29:01.977948347Z [2024-03-28 00:29:01,977: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:29:01.978164328Z [2024-03-28 00:29:01,977: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:29:01.978320436Z [2024-03-28 00:29:01,978: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:29:01.978853563Z [2024-03-28 00:29:01,978: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:29:01.978969943Z [2024-03-28 00:29:01,978: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:29:02.078101422Z [2024-03-28 00:29:02,077: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:29:02.170185625Z [2024-03-28 00:29:02,169: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:29:02.174559240Z [2024-03-28 00:29:02,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:29:02.196947359Z [2024-03-28 00:29:02,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:29:02.199156501Z [2024-03-28 00:29:02,198: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:29:02.199328262Z [2024-03-28 00:29:02,199: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:29:02.199563328Z [2024-03-28 00:29:02,199: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:29:02.199693859Z [2024-03-28 00:29:02,199: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:29:02.200008533Z [2024-03-28 00:29:02,199: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:29:02.200196289Z [2024-03-28 00:29:02,200: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:29:02.304354213Z [2024-03-28 00:29:02,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:29:03.602721166Z [2024-03-28 00:29:03,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9767ee99-d79c-46d8-91b9-3215a64981dc] succeeded in 3.357893607999813s: None 2024-03-28T00:29:04.273049345Z [2024-03-28 00:29:04,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03b3e0d1-bf07-46f8-aeb3-8b14d7442cb3] succeeded in 4.028077132999897s: None 2024-03-28T00:30:00.886779685Z [2024-03-28 00:30:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd283d8f-8119-4f46-9528-8e6ed7e015bf] received 2024-03-28T00:30:00.890313891Z [2024-03-28 00:30:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29cdbe11-0131-497e-9f74-f8b80c9a6b05] received 2024-03-28T00:30:00.892834579Z [2024-03-28 00:30:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cee25906-3fd9-4553-b029-9c9c122d3b87] received 2024-03-28T00:30:00.896060002Z [2024-03-28 00:30:00,895: INFO/ForkPoolWorker-15] [bd283d8f-8119-4f46-9528-8e6ed7e015bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:30:00.903473771Z [2024-03-28 00:30:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2fc7047-b758-420f-a1a6-c5d6af96920d] received 2024-03-28T00:30:00.904519881Z [2024-03-28 00:30:00,904: INFO/ForkPoolWorker-1] [cee25906-3fd9-4553-b029-9c9c122d3b87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:30:00.909992701Z [2024-03-28 00:30:00,909: INFO/ForkPoolWorker-16] [29cdbe11-0131-497e-9f74-f8b80c9a6b05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:30:00.927299383Z [2024-03-28 00:30:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3035420b-64f9-4668-a07a-448d06bc034d] received 2024-03-28T00:30:00.929931362Z [2024-03-28 00:30:00,929: INFO/ForkPoolWorker-2] [b2fc7047-b758-420f-a1a6-c5d6af96920d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:30:00.967513461Z [2024-03-28 00:30:00,967: INFO/ForkPoolWorker-3] [3035420b-64f9-4668-a07a-448d06bc034d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:30:01.321433943Z [2024-03-28 00:30:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:30:01.545406422Z [2024-03-28 00:30:01,541: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:30:01.633080168Z [2024-03-28 00:30:01,628: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:30:01.815108117Z [2024-03-28 00:30:01,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:30:01.833804211Z [2024-03-28 00:30:01,832: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T00:30:01.839288670Z [2024-03-28 00:30:01,838: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:01.905641480Z [2024-03-28 00:30:01,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:30:01.910793930Z [2024-03-28 00:30:01,910: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:30:01.916296929Z [2024-03-28 00:30:01,916: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:30:01.921535441Z [2024-03-28 00:30:01,916: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:30:01.923785139Z [2024-03-28 00:30:01,921: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T00:30:01.924218829Z [2024-03-28 00:30:01,924: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:30:02.070168912Z [2024-03-28 00:30:02,069: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:02.110296617Z [2024-03-28 00:30:02,109: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:03.198800481Z [2024-03-28 00:30:03,198: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3035420b-64f9-4668-a07a-448d06bc034d] succeeded in 2.2641820530002406s: None 2024-03-28T00:30:03.243353635Z [2024-03-28 00:30:03,242: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b2fc7047-b758-420f-a1a6-c5d6af96920d] succeeded in 2.327941856000052s: None 2024-03-28T00:30:03.686418494Z [2024-03-28 00:30:03,685: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:30:03.690500072Z [2024-03-28 00:30:03,689: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:03.731766789Z [2024-03-28 00:30:03,731: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:30:03.738015712Z [2024-03-28 00:30:03,737: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:03.738152459Z [2024-03-28 00:30:03,737: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:03.738372469Z [2024-03-28 00:30:03,738: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:03.738483077Z [2024-03-28 00:30:03,738: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:30:03.738817559Z [2024-03-28 00:30:03,738: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:30:03.741629597Z [2024-03-28 00:30:03,739: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:03.750614336Z [2024-03-28 00:30:03,750: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:30:03.757958124Z [2024-03-28 00:30:03,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:03.817566513Z [2024-03-28 00:30:03,816: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:30:03.818955827Z [2024-03-28 00:30:03,817: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:03.818967726Z [2024-03-28 00:30:03,817: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:03.818994647Z [2024-03-28 00:30:03,818: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:03.819001937Z [2024-03-28 00:30:03,818: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:30:03.819007681Z [2024-03-28 00:30:03,818: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:30:03.819013259Z [2024-03-28 00:30:03,818: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:03.872753804Z [2024-03-28 00:30:03,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:03.946832555Z [2024-03-28 00:30:03,946: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:04.032954549Z [2024-03-28 00:30:04,032: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:30:04.036704517Z [2024-03-28 00:30:04,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:04.067120740Z [2024-03-28 00:30:04,066: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:30:04.068555832Z [2024-03-28 00:30:04,068: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:04.068615711Z [2024-03-28 00:30:04,068: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:04.068758578Z [2024-03-28 00:30:04,068: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:04.068837313Z [2024-03-28 00:30:04,068: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:30:04.069189845Z [2024-03-28 00:30:04,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:30:04.069204579Z [2024-03-28 00:30:04,069: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:04.176879295Z [2024-03-28 00:30:04,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:04.700104834Z [2024-03-28 00:30:04,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29cdbe11-0131-497e-9f74-f8b80c9a6b05] succeeded in 3.8061702489999334s: None 2024-03-28T00:30:05.538963075Z [2024-03-28 00:30:05,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8174031e-14c7-43fb-886d-c70f4bdb9e81] received 2024-03-28T00:30:05.547736069Z [2024-03-28 00:30:05,547: INFO/ForkPoolWorker-16] [8174031e-14c7-43fb-886d-c70f4bdb9e81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:30:05.842938564Z [2024-03-28 00:30:05,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:30:05.953147411Z [2024-03-28 00:30:05,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cee25906-3fd9-4553-b029-9c9c122d3b87] succeeded in 5.058019904000048s: None 2024-03-28T00:30:07.159102758Z [2024-03-28 00:30:07,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd283d8f-8119-4f46-9528-8e6ed7e015bf] succeeded in 6.270325714000137s: None 2024-03-28T00:30:07.368481847Z [2024-03-28 00:30:07,367: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:30:07.372511209Z [2024-03-28 00:30:07,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:07.411559659Z [2024-03-28 00:30:07,411: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:30:07.413042990Z [2024-03-28 00:30:07,412: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:07.413108163Z [2024-03-28 00:30:07,412: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:07.413158657Z [2024-03-28 00:30:07,413: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:07.413291659Z [2024-03-28 00:30:07,413: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:30:07.413749606Z [2024-03-28 00:30:07,413: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:30:07.413897965Z [2024-03-28 00:30:07,413: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:07.526500153Z [2024-03-28 00:30:07,526: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:08.281853931Z [2024-03-28 00:30:08,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8174031e-14c7-43fb-886d-c70f4bdb9e81] succeeded in 2.7400352949998705s: None 2024-03-28T00:30:08.314320416Z [2024-03-28 00:30:08,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29db8dca-5fa3-4f49-8ab2-647e470be15c] received 2024-03-28T00:30:08.336910505Z [2024-03-28 00:30:08,336: INFO/ForkPoolWorker-15] [29db8dca-5fa3-4f49-8ab2-647e470be15c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:30:08.788610357Z [2024-03-28 00:30:08,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:30:10.065764215Z [2024-03-28 00:30:10,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:30:10.069125518Z [2024-03-28 00:30:10,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:10.094315606Z [2024-03-28 00:30:10,094: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:30:10.095737044Z [2024-03-28 00:30:10,095: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:10.095842556Z [2024-03-28 00:30:10,095: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:10.096090371Z [2024-03-28 00:30:10,095: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:10.096216351Z [2024-03-28 00:30:10,096: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:30:10.096563504Z [2024-03-28 00:30:10,096: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:30:10.096782414Z [2024-03-28 00:30:10,096: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:10.182274374Z [2024-03-28 00:30:10,181: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:10.863320908Z [2024-03-28 00:30:10,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29db8dca-5fa3-4f49-8ab2-647e470be15c] succeeded in 2.5466924780002955s: None 2024-03-28T00:30:10.870106119Z [2024-03-28 00:30:10,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6e4674f-6867-46b5-a53b-1327df4423ad] received 2024-03-28T00:30:10.894603773Z [2024-03-28 00:30:10,894: INFO/ForkPoolWorker-15] [c6e4674f-6867-46b5-a53b-1327df4423ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:30:11.314792486Z [2024-03-28 00:30:11,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:30:12.519028164Z [2024-03-28 00:30:12,518: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:30:12.522428962Z [2024-03-28 00:30:12,521: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:30:12.555200418Z [2024-03-28 00:30:12,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:30:12.556440354Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:30:12.556459978Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:30:12.556590379Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:30:12.556627446Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:30:12.557047342Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:30:12.557220021Z [2024-03-28 00:30:12,556: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:30:12.638218020Z [2024-03-28 00:30:12,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:30:13.294242148Z [2024-03-28 00:30:13,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6e4674f-6867-46b5-a53b-1327df4423ad] succeeded in 2.4193533939996996s: None 2024-03-28T00:31:00.204560921Z [2024-03-28 00:31:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f2e02e8-ff25-4061-924f-183ffe76879e] received 2024-03-28T00:31:00.206598406Z [2024-03-28 00:31:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30800b3b-dd70-4b42-8e8c-a6bb3e8861c1] received 2024-03-28T00:31:00.215901862Z [2024-03-28 00:31:00,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40ff2832-8b49-427a-9aaa-3bbc8ed422f5] received 2024-03-28T00:31:00.220940923Z [2024-03-28 00:31:00,220: INFO/ForkPoolWorker-15] [4f2e02e8-ff25-4061-924f-183ffe76879e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:31:00.221225037Z [2024-03-28 00:31:00,220: INFO/ForkPoolWorker-16] [30800b3b-dd70-4b42-8e8c-a6bb3e8861c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:31:00.222786066Z [2024-03-28 00:31:00,222: INFO/ForkPoolWorker-1] [40ff2832-8b49-427a-9aaa-3bbc8ed422f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:31:00.538544291Z [2024-03-28 00:31:00,534: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:31:00.540395591Z [2024-03-28 00:31:00,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:31:00.566793934Z [2024-03-28 00:31:00,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:31:00.713626049Z [2024-03-28 00:31:00,713: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:31:00.718113260Z [2024-03-28 00:31:00,717: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:31:00.744497938Z [2024-03-28 00:31:00,744: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:31:00.746824336Z [2024-03-28 00:31:00,746: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:31:00.747138130Z [2024-03-28 00:31:00,746: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:31:00.747374710Z [2024-03-28 00:31:00,747: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:31:00.747761353Z [2024-03-28 00:31:00,747: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:31:00.871740093Z [2024-03-28 00:31:00,871: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:31:01.692925442Z [2024-03-28 00:31:01,692: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[40ff2832-8b49-427a-9aaa-3bbc8ed422f5] succeeded in 1.4749855459999708s: None 2024-03-28T00:31:01.889830952Z [2024-03-28 00:31:01,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:31:01.893714640Z [2024-03-28 00:31:01,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:31:01.926378472Z [2024-03-28 00:31:01,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:31:01.927311529Z [2024-03-28 00:31:01,926: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:31:01.932859819Z [2024-03-28 00:31:01,932: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:31:01.933671267Z [2024-03-28 00:31:01,933: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:31:01.933791924Z [2024-03-28 00:31:01,933: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:31:01.934007127Z [2024-03-28 00:31:01,933: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:31:01.934056451Z [2024-03-28 00:31:01,933: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:31:01.934520504Z [2024-03-28 00:31:01,934: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:31:01.934527690Z [2024-03-28 00:31:01,934: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:31:01.968247506Z [2024-03-28 00:31:01,967: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:31:01.969843532Z [2024-03-28 00:31:01,969: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:31:01.971892428Z [2024-03-28 00:31:01,969: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:31:01.972125625Z [2024-03-28 00:31:01,971: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:31:01.972249890Z [2024-03-28 00:31:01,972: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:31:01.972609040Z [2024-03-28 00:31:01,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:31:01.972782777Z [2024-03-28 00:31:01,972: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:31:02.026188381Z [2024-03-28 00:31:02,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:31:02.080966669Z [2024-03-28 00:31:02,080: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:31:03.611881681Z [2024-03-28 00:31:03,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f2e02e8-ff25-4061-924f-183ffe76879e] succeeded in 3.4032557890000135s: None 2024-03-28T00:31:03.980623620Z [2024-03-28 00:31:03,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30800b3b-dd70-4b42-8e8c-a6bb3e8861c1] succeeded in 3.7675921879999805s: None 2024-03-28T00:32:00.969524771Z [2024-03-28 00:32:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03be757f-0bb5-46ae-a7da-001971cbaa4c] received 2024-03-28T00:32:00.972297638Z [2024-03-28 00:32:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd332c2b-a14e-4aed-916d-0fb37b4a1430] received 2024-03-28T00:32:00.978087698Z [2024-03-28 00:32:00,977: INFO/ForkPoolWorker-15] [03be757f-0bb5-46ae-a7da-001971cbaa4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:32:00.979698289Z [2024-03-28 00:32:00,979: INFO/ForkPoolWorker-16] [dd332c2b-a14e-4aed-916d-0fb37b4a1430] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:32:00.984951414Z [2024-03-28 00:32:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[155e5568-0682-4640-9426-a1b37194f9af] received 2024-03-28T00:32:00.987276363Z [2024-03-28 00:32:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9add01f6-4897-4eed-8723-5862294af3c8] received 2024-03-28T00:32:01.018616759Z [2024-03-28 00:32:01,014: INFO/ForkPoolWorker-2] [9add01f6-4897-4eed-8723-5862294af3c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:32:01.023287105Z [2024-03-28 00:32:01,022: INFO/ForkPoolWorker-1] [155e5568-0682-4640-9426-a1b37194f9af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:32:01.327631083Z [2024-03-28 00:32:01,324: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:32:01.395190096Z [2024-03-28 00:32:01,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:32:01.543185116Z [2024-03-28 00:32:01,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:32:01.644955394Z [2024-03-28 00:32:01,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:32:01.762151607Z [2024-03-28 00:32:01,759: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:32:01.768803625Z [2024-03-28 00:32:01,768: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:32:01.837234967Z [2024-03-28 00:32:01,836: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:32:01.840037227Z [2024-03-28 00:32:01,839: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:32:01.840081994Z [2024-03-28 00:32:01,839: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:32:01.840181490Z [2024-03-28 00:32:01,840: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:32:01.842949541Z [2024-03-28 00:32:01,840: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:32:01.967879234Z [2024-03-28 00:32:01,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:32:02.010100122Z [2024-03-28 00:32:02,009: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:32:02.854895404Z [2024-03-28 00:32:02,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03be757f-0bb5-46ae-a7da-001971cbaa4c] succeeded in 1.8815190870000151s: None 2024-03-28T00:32:02.903429933Z [2024-03-28 00:32:02,902: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9add01f6-4897-4eed-8723-5862294af3c8] succeeded in 1.9088121240001783s: None 2024-03-28T00:32:03.323854486Z [2024-03-28 00:32:03,323: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:32:03.327972556Z [2024-03-28 00:32:03,327: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:32:03.360203109Z [2024-03-28 00:32:03,359: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:32:03.362076988Z [2024-03-28 00:32:03,361: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:32:03.362229673Z [2024-03-28 00:32:03,362: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:32:03.362408141Z [2024-03-28 00:32:03,362: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:32:03.362611857Z [2024-03-28 00:32:03,362: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:32:03.362948324Z [2024-03-28 00:32:03,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:32:03.363584094Z [2024-03-28 00:32:03,363: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:32:03.467975429Z [2024-03-28 00:32:03,467: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:32:03.477161871Z [2024-03-28 00:32:03,476: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:32:03.485099092Z [2024-03-28 00:32:03,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:32:03.513612674Z [2024-03-28 00:32:03,513: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:32:03.514834219Z [2024-03-28 00:32:03,514: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:32:03.514851363Z [2024-03-28 00:32:03,514: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:32:03.514992783Z [2024-03-28 00:32:03,514: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:32:03.515007239Z [2024-03-28 00:32:03,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:32:03.515283995Z [2024-03-28 00:32:03,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:32:03.515299873Z [2024-03-28 00:32:03,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:32:03.655634359Z [2024-03-28 00:32:03,655: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:32:05.069001296Z [2024-03-28 00:32:05,068: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[155e5568-0682-4640-9426-a1b37194f9af] succeeded in 4.079043185000046s: None 2024-03-28T00:32:05.809046335Z [2024-03-28 00:32:05,808: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd332c2b-a14e-4aed-916d-0fb37b4a1430] succeeded in 4.834085113000128s: None 2024-03-28T00:33:00.694684618Z [2024-03-28 00:33:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06045d31-ae3e-457e-8bec-ca92a9c7ff67] received 2024-03-28T00:33:00.700047622Z [2024-03-28 00:33:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b11c0bab-487d-431c-bec3-eb6b6a46d4fa] received 2024-03-28T00:33:00.702448737Z [2024-03-28 00:33:00,702: INFO/ForkPoolWorker-15] [06045d31-ae3e-457e-8bec-ca92a9c7ff67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:33:00.711269656Z [2024-03-28 00:33:00,709: INFO/ForkPoolWorker-16] [b11c0bab-487d-431c-bec3-eb6b6a46d4fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:33:00.711647057Z [2024-03-28 00:33:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31055029-c615-4d6e-997c-9dcd14170ba8] received 2024-03-28T00:33:00.721338219Z [2024-03-28 00:33:00,721: INFO/ForkPoolWorker-1] [31055029-c615-4d6e-997c-9dcd14170ba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:33:01.115642776Z [2024-03-28 00:33:01,112: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:33:01.146810192Z [2024-03-28 00:33:01,143: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:33:01.205117236Z [2024-03-28 00:33:01,200: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:33:01.404645349Z [2024-03-28 00:33:01,404: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:33:01.413365207Z [2024-03-28 00:33:01,412: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:33:01.444166197Z [2024-03-28 00:33:01,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:33:01.445792236Z [2024-03-28 00:33:01,445: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:33:01.446078372Z [2024-03-28 00:33:01,445: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:33:01.446227724Z [2024-03-28 00:33:01,446: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:33:01.446541138Z [2024-03-28 00:33:01,446: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:33:01.544462853Z [2024-03-28 00:33:01,544: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:33:02.249770849Z [2024-03-28 00:33:02,249: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31055029-c615-4d6e-997c-9dcd14170ba8] succeeded in 1.5359259060001023s: None 2024-03-28T00:33:02.453554762Z [2024-03-28 00:33:02,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:33:02.457416940Z [2024-03-28 00:33:02,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:33:02.484831950Z [2024-03-28 00:33:02,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:33:02.486520167Z [2024-03-28 00:33:02,486: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:33:02.486723348Z [2024-03-28 00:33:02,486: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:33:02.486937698Z [2024-03-28 00:33:02,486: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:33:02.487106097Z [2024-03-28 00:33:02,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:33:02.487480904Z [2024-03-28 00:33:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:33:02.487661876Z [2024-03-28 00:33:02,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:33:02.570927482Z [2024-03-28 00:33:02,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:33:02.576952712Z [2024-03-28 00:33:02,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:33:02.588569284Z [2024-03-28 00:33:02,588: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:33:02.603666957Z [2024-03-28 00:33:02,603: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:33:02.605888140Z [2024-03-28 00:33:02,605: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:33:02.605986592Z [2024-03-28 00:33:02,605: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:33:02.606309912Z [2024-03-28 00:33:02,605: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:33:02.606555992Z [2024-03-28 00:33:02,606: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:33:02.607002742Z [2024-03-28 00:33:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:33:02.607185323Z [2024-03-28 00:33:02,607: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:33:02.757688857Z [2024-03-28 00:33:02,757: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:33:04.492425133Z [2024-03-28 00:33:04,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06045d31-ae3e-457e-8bec-ca92a9c7ff67] succeeded in 3.795689236000271s: None 2024-03-28T00:33:04.558243045Z [2024-03-28 00:33:04,557: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b11c0bab-487d-431c-bec3-eb6b6a46d4fa] succeeded in 3.855529775999912s: None 2024-03-28T00:34:01.151681994Z [2024-03-28 00:34:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19e8a262-93c6-48f1-b76d-1c488e64e34b] received 2024-03-28T00:34:01.154984983Z [2024-03-28 00:34:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1658ce4e-f433-432b-b41f-e89c57a264a0] received 2024-03-28T00:34:01.163508260Z [2024-03-28 00:34:01,163: INFO/ForkPoolWorker-16] [1658ce4e-f433-432b-b41f-e89c57a264a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:34:01.166024893Z [2024-03-28 00:34:01,165: INFO/ForkPoolWorker-15] [19e8a262-93c6-48f1-b76d-1c488e64e34b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:34:01.170861013Z [2024-03-28 00:34:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0baa5738-1b5c-4ca2-a452-cd15f9dd45d9] received 2024-03-28T00:34:01.178345488Z [2024-03-28 00:34:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12d7ea4a-fa75-435a-a5d7-84a8c7893ac8] received 2024-03-28T00:34:01.178372178Z [2024-03-28 00:34:01,178: INFO/ForkPoolWorker-1] [0baa5738-1b5c-4ca2-a452-cd15f9dd45d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:34:01.187517538Z [2024-03-28 00:34:01,187: INFO/ForkPoolWorker-2] [12d7ea4a-fa75-435a-a5d7-84a8c7893ac8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:34:01.564381983Z [2024-03-28 00:34:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:34:01.577056236Z [2024-03-28 00:34:01,573: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:34:01.585022270Z [2024-03-28 00:34:01,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:34:01.663335322Z [2024-03-28 00:34:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:34:01.781178589Z [2024-03-28 00:34:01,780: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:34:01.785738917Z [2024-03-28 00:34:01,785: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:34:01.818583292Z [2024-03-28 00:34:01,818: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:34:01.820572124Z [2024-03-28 00:34:01,820: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:34:01.820603997Z [2024-03-28 00:34:01,820: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:34:01.820672099Z [2024-03-28 00:34:01,820: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:34:01.821431250Z [2024-03-28 00:34:01,820: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:34:01.910416350Z [2024-03-28 00:34:01,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:34:01.986135222Z [2024-03-28 00:34:01,985: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:34:02.648570982Z [2024-03-28 00:34:02,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19e8a262-93c6-48f1-b76d-1c488e64e34b] succeeded in 1.4944456240000363s: None 2024-03-28T00:34:02.769029846Z [2024-03-28 00:34:02,768: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[12d7ea4a-fa75-435a-a5d7-84a8c7893ac8] succeeded in 1.5883809440001642s: None 2024-03-28T00:34:03.240980502Z [2024-03-28 00:34:03,240: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:34:03.244618422Z [2024-03-28 00:34:03,244: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:34:03.245679337Z [2024-03-28 00:34:03,245: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:34:03.250642048Z [2024-03-28 00:34:03,250: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:34:03.265169436Z [2024-03-28 00:34:03,264: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:34:03.266460655Z [2024-03-28 00:34:03,266: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:34:03.266655443Z [2024-03-28 00:34:03,266: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:34:03.266827612Z [2024-03-28 00:34:03,266: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:34:03.266932864Z [2024-03-28 00:34:03,266: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:34:03.267243115Z [2024-03-28 00:34:03,267: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:34:03.267629496Z [2024-03-28 00:34:03,267: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:34:03.280151698Z [2024-03-28 00:34:03,279: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:34:03.281424272Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:34:03.281442416Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:34:03.281631094Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:34:03.281648123Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:34:03.281907153Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:34:03.281915393Z [2024-03-28 00:34:03,281: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:34:03.352816409Z [2024-03-28 00:34:03,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:34:03.417416942Z [2024-03-28 00:34:03,417: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:34:04.874509564Z [2024-03-28 00:34:04,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0baa5738-1b5c-4ca2-a452-cd15f9dd45d9] succeeded in 3.7019999449998977s: None 2024-03-28T00:34:05.440200168Z [2024-03-28 00:34:05,439: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1658ce4e-f433-432b-b41f-e89c57a264a0] succeeded in 4.283163149000302s: None 2024-03-28T00:35:00.727349603Z [2024-03-28 00:35:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da000eea-70cb-4c39-84c7-6ba48ba1f64d] received 2024-03-28T00:35:00.730086629Z [2024-03-28 00:35:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ef757a1-cdc3-4f4c-b203-897f9ed7a9c0] received 2024-03-28T00:35:00.736363619Z [2024-03-28 00:35:00,736: INFO/ForkPoolWorker-15] [da000eea-70cb-4c39-84c7-6ba48ba1f64d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:35:00.750482388Z [2024-03-28 00:35:00,750: INFO/ForkPoolWorker-16] [0ef757a1-cdc3-4f4c-b203-897f9ed7a9c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:35:00.751019595Z [2024-03-28 00:35:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[525847fc-8cb9-462b-afbf-70f3f31461a2] received 2024-03-28T00:35:00.754249527Z [2024-03-28 00:35:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68c3bec1-823d-439d-b9fc-a428d6a32455] received 2024-03-28T00:35:00.762763396Z [2024-03-28 00:35:00,762: INFO/ForkPoolWorker-2] [68c3bec1-823d-439d-b9fc-a428d6a32455] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:35:00.779656860Z [2024-03-28 00:35:00,779: INFO/ForkPoolWorker-1] [525847fc-8cb9-462b-afbf-70f3f31461a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:35:01.061297701Z [2024-03-28 00:35:01,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:35:01.281647816Z [2024-03-28 00:35:01,277: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:35:01.348324721Z [2024-03-28 00:35:01,344: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:35:01.423584501Z [2024-03-28 00:35:01,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:35:01.529759955Z [2024-03-28 00:35:01,529: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:35:01.534672121Z [2024-03-28 00:35:01,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:01.590690298Z [2024-03-28 00:35:01,590: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:35:01.594717249Z [2024-03-28 00:35:01,594: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:35:01.595122110Z [2024-03-28 00:35:01,594: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:35:01.595360425Z [2024-03-28 00:35:01,595: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:35:01.595812656Z [2024-03-28 00:35:01,595: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:35:01.732522368Z [2024-03-28 00:35:01,732: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:02.679978306Z [2024-03-28 00:35:02,679: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[68c3bec1-823d-439d-b9fc-a428d6a32455] succeeded in 1.9237046529997315s: None 2024-03-28T00:35:02.813961571Z [2024-03-28 00:35:02,813: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:35:02.818484893Z [2024-03-28 00:35:02,817: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:02.856310393Z [2024-03-28 00:35:02,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:35:02.858725335Z [2024-03-28 00:35:02,858: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:02.858922194Z [2024-03-28 00:35:02,858: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:02.859255558Z [2024-03-28 00:35:02,858: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:02.859496729Z [2024-03-28 00:35:02,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:35:02.859883537Z [2024-03-28 00:35:02,859: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:35:02.859901484Z [2024-03-28 00:35:02,859: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:02.999103952Z [2024-03-28 00:35:02,998: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:35:03.002973513Z [2024-03-28 00:35:03,002: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:03.041699771Z [2024-03-28 00:35:03,041: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:35:03.043742627Z [2024-03-28 00:35:03,043: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:03.043763921Z [2024-03-28 00:35:03,043: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:03.044006613Z [2024-03-28 00:35:03,043: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:03.044155304Z [2024-03-28 00:35:03,043: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:35:03.044625543Z [2024-03-28 00:35:03,044: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:35:03.044798117Z [2024-03-28 00:35:03,044: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:03.060152996Z [2024-03-28 00:35:03,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:03.161799860Z [2024-03-28 00:35:03,161: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:03.716152452Z [2024-03-28 00:35:03,715: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:35:03.721167758Z [2024-03-28 00:35:03,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:03.742874827Z [2024-03-28 00:35:03,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:35:03.744980335Z [2024-03-28 00:35:03,744: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:03.745122466Z [2024-03-28 00:35:03,744: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:03.745343295Z [2024-03-28 00:35:03,745: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:03.745421983Z [2024-03-28 00:35:03,745: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:35:03.746026247Z [2024-03-28 00:35:03,745: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:35:03.746034528Z [2024-03-28 00:35:03,745: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:03.855708600Z [2024-03-28 00:35:03,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da000eea-70cb-4c39-84c7-6ba48ba1f64d] succeeded in 3.1243030860000545s: None 2024-03-28T00:35:03.875936667Z [2024-03-28 00:35:03,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:04.185549493Z [2024-03-28 00:35:04,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bee7e236-2bfd-406d-b272-528d659cd38f] received 2024-03-28T00:35:04.212767928Z [2024-03-28 00:35:04,212: INFO/ForkPoolWorker-15] [bee7e236-2bfd-406d-b272-528d659cd38f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:35:04.582246737Z [2024-03-28 00:35:04,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:35:05.027735701Z [2024-03-28 00:35:05,027: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[525847fc-8cb9-462b-afbf-70f3f31461a2] succeeded in 4.272826475999864s: None 2024-03-28T00:35:05.744127072Z [2024-03-28 00:35:05,743: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ef757a1-cdc3-4f4c-b203-897f9ed7a9c0] succeeded in 5.010709369999859s: None 2024-03-28T00:35:05.979712572Z [2024-03-28 00:35:05,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:35:05.983536874Z [2024-03-28 00:35:05,983: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:06.015637844Z [2024-03-28 00:35:06,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:35:06.018470379Z [2024-03-28 00:35:06,018: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:06.018794031Z [2024-03-28 00:35:06,018: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:06.019764564Z [2024-03-28 00:35:06,018: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:06.019988592Z [2024-03-28 00:35:06,019: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:35:06.020724770Z [2024-03-28 00:35:06,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:35:06.020979231Z [2024-03-28 00:35:06,020: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:06.122615711Z [2024-03-28 00:35:06,122: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:06.830937529Z [2024-03-28 00:35:06,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bee7e236-2bfd-406d-b272-528d659cd38f] succeeded in 2.643621403999987s: None 2024-03-28T00:35:07.437292758Z [2024-03-28 00:35:07,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a83a6a5-6059-425d-ae48-d7d7181a9254] received 2024-03-28T00:35:07.443733331Z [2024-03-28 00:35:07,443: INFO/ForkPoolWorker-15] [1a83a6a5-6059-425d-ae48-d7d7181a9254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:35:07.757087881Z [2024-03-28 00:35:07,753: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:35:09.451364921Z [2024-03-28 00:35:09,450: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:35:09.455077142Z [2024-03-28 00:35:09,454: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:09.499402016Z [2024-03-28 00:35:09,499: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:35:09.500802802Z [2024-03-28 00:35:09,500: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:09.500943486Z [2024-03-28 00:35:09,500: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:09.501133301Z [2024-03-28 00:35:09,500: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:09.501228456Z [2024-03-28 00:35:09,501: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:35:09.501555176Z [2024-03-28 00:35:09,501: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:35:09.502031965Z [2024-03-28 00:35:09,501: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:09.597643899Z [2024-03-28 00:35:09,597: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:10.345056325Z [2024-03-28 00:35:10,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a83a6a5-6059-425d-ae48-d7d7181a9254] succeeded in 2.905848766999952s: None 2024-03-28T00:35:11.022198694Z [2024-03-28 00:35:11,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0404a1d0-79cf-468d-b210-633d6a418704] received 2024-03-28T00:35:11.050864567Z [2024-03-28 00:35:11,050: INFO/ForkPoolWorker-15] [0404a1d0-79cf-468d-b210-633d6a418704] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:35:11.391866795Z [2024-03-28 00:35:11,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:35:12.593231197Z [2024-03-28 00:35:12,592: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:35:12.597098590Z [2024-03-28 00:35:12,596: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:35:12.620314027Z [2024-03-28 00:35:12,620: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:35:12.621711816Z [2024-03-28 00:35:12,621: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:35:12.621906757Z [2024-03-28 00:35:12,621: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:35:12.622222817Z [2024-03-28 00:35:12,621: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:35:12.622372043Z [2024-03-28 00:35:12,622: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:35:12.622724146Z [2024-03-28 00:35:12,622: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:35:12.622892731Z [2024-03-28 00:35:12,622: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:35:12.750383152Z [2024-03-28 00:35:12,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:35:13.415523413Z [2024-03-28 00:35:13,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0404a1d0-79cf-468d-b210-633d6a418704] succeeded in 2.3915381950000665s: None 2024-03-28T00:36:00.548538713Z [2024-03-28 00:36:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d35860c7-9789-4a32-831c-b121c3716bab] received 2024-03-28T00:36:00.553827199Z [2024-03-28 00:36:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e53e5493-6af3-4cc8-8e07-60a2775e6a97] received 2024-03-28T00:36:00.560717613Z [2024-03-28 00:36:00,560: INFO/ForkPoolWorker-15] [d35860c7-9789-4a32-831c-b121c3716bab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:36:00.561675613Z [2024-03-28 00:36:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b453fcb-ab7b-4419-adda-6a2a461f3010] received 2024-03-28T00:36:00.564692637Z [2024-03-28 00:36:00,564: INFO/ForkPoolWorker-16] [e53e5493-6af3-4cc8-8e07-60a2775e6a97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:36:00.571430920Z [2024-03-28 00:36:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e7e9248-95d6-48a0-b08e-8aec325a4a24] received 2024-03-28T00:36:00.574959820Z [2024-03-28 00:36:00,574: INFO/ForkPoolWorker-1] [5b453fcb-ab7b-4419-adda-6a2a461f3010] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:36:00.580096810Z [2024-03-28 00:36:00,579: INFO/ForkPoolWorker-2] [9e7e9248-95d6-48a0-b08e-8aec325a4a24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:36:00.901565328Z [2024-03-28 00:36:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:36:00.939049243Z [2024-03-28 00:36:00,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:36:00.997699070Z [2024-03-28 00:36:00,993: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:36:01.050552572Z [2024-03-28 00:36:01,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:36:01.288509145Z [2024-03-28 00:36:01,287: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:36:01.292856591Z [2024-03-28 00:36:01,292: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:36:01.316796843Z [2024-03-28 00:36:01,316: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:36:01.318419688Z [2024-03-28 00:36:01,318: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:36:01.318491076Z [2024-03-28 00:36:01,318: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:36:01.318504464Z [2024-03-28 00:36:01,318: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:36:01.318774254Z [2024-03-28 00:36:01,318: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:36:01.386713273Z [2024-03-28 00:36:01,386: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:36:01.457157396Z [2024-03-28 00:36:01,456: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:36:02.135769218Z [2024-03-28 00:36:02,135: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d35860c7-9789-4a32-831c-b121c3716bab] succeeded in 1.5853542370000469s: None 2024-03-28T00:36:02.431734440Z [2024-03-28 00:36:02,430: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e7e9248-95d6-48a0-b08e-8aec325a4a24] succeeded in 1.8566372750001392s: None 2024-03-28T00:36:02.804664012Z [2024-03-28 00:36:02,804: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:36:02.812092568Z [2024-03-28 00:36:02,810: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:36:02.843627677Z [2024-03-28 00:36:02,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:36:02.846484900Z [2024-03-28 00:36:02,846: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:36:02.846758283Z [2024-03-28 00:36:02,846: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:36:02.846992455Z [2024-03-28 00:36:02,846: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:36:02.847020572Z [2024-03-28 00:36:02,846: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:36:02.848570390Z [2024-03-28 00:36:02,848: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:36:02.848591436Z [2024-03-28 00:36:02,848: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:36:02.986366884Z [2024-03-28 00:36:02,985: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:36:03.087490567Z [2024-03-28 00:36:03,086: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:36:03.091438901Z [2024-03-28 00:36:03,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:36:03.114475283Z [2024-03-28 00:36:03,114: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:36:03.116136208Z [2024-03-28 00:36:03,115: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:36:03.116258768Z [2024-03-28 00:36:03,116: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:36:03.116459377Z [2024-03-28 00:36:03,116: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:36:03.116573324Z [2024-03-28 00:36:03,116: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:36:03.116905341Z [2024-03-28 00:36:03,116: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:36:03.117080914Z [2024-03-28 00:36:03,116: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:36:03.205801736Z [2024-03-28 00:36:03,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:36:04.662295519Z [2024-03-28 00:36:04,661: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b453fcb-ab7b-4419-adda-6a2a461f3010] succeeded in 4.09770805800008s: None 2024-03-28T00:36:05.395856766Z [2024-03-28 00:36:05,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e53e5493-6af3-4cc8-8e07-60a2775e6a97] succeeded in 4.839361542000006s: None 2024-03-28T00:37:00.291214125Z [2024-03-28 00:37:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76fae84a-9b3f-4c88-a19e-532adcb240f3] received 2024-03-28T00:37:00.293854371Z [2024-03-28 00:37:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[719c8624-ab5b-4499-8ede-5b0fade0d963] received 2024-03-28T00:37:00.296896283Z [2024-03-28 00:37:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8f8fc96-d232-48dd-8e3b-9d0ad95e452b] received 2024-03-28T00:37:00.297632283Z [2024-03-28 00:37:00,297: INFO/ForkPoolWorker-15] [76fae84a-9b3f-4c88-a19e-532adcb240f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:37:00.302382373Z [2024-03-28 00:37:00,301: INFO/ForkPoolWorker-16] [719c8624-ab5b-4499-8ede-5b0fade0d963] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:37:00.312499430Z [2024-03-28 00:37:00,311: INFO/ForkPoolWorker-1] [b8f8fc96-d232-48dd-8e3b-9d0ad95e452b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:37:00.615206125Z [2024-03-28 00:37:00,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:37:00.799603426Z [2024-03-28 00:37:00,799: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:37:00.804267298Z [2024-03-28 00:37:00,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:37:00.811353941Z [2024-03-28 00:37:00,807: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:37:00.827332761Z [2024-03-28 00:37:00,827: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:37:00.829090123Z [2024-03-28 00:37:00,828: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:37:00.829234253Z [2024-03-28 00:37:00,828: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:37:00.829840660Z [2024-03-28 00:37:00,829: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:37:00.830260974Z [2024-03-28 00:37:00,829: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:37:00.845695269Z [2024-03-28 00:37:00,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:37:00.942565574Z [2024-03-28 00:37:00,942: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:37:01.717847201Z [2024-03-28 00:37:01,717: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8f8fc96-d232-48dd-8e3b-9d0ad95e452b] succeeded in 1.4172796220000237s: None 2024-03-28T00:37:02.297267538Z [2024-03-28 00:37:02,296: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:37:02.301047364Z [2024-03-28 00:37:02,300: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:37:02.316508936Z [2024-03-28 00:37:02,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:37:02.320401441Z [2024-03-28 00:37:02,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:37:02.324719775Z [2024-03-28 00:37:02,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:37:02.326329546Z [2024-03-28 00:37:02,326: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:37:02.326498205Z [2024-03-28 00:37:02,326: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:37:02.326714478Z [2024-03-28 00:37:02,326: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:37:02.326843846Z [2024-03-28 00:37:02,326: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:37:02.327156630Z [2024-03-28 00:37:02,327: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:37:02.327296226Z [2024-03-28 00:37:02,327: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:37:02.346079005Z [2024-03-28 00:37:02,345: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:37:02.347540906Z [2024-03-28 00:37:02,347: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:37:02.347628086Z [2024-03-28 00:37:02,347: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:37:02.347791333Z [2024-03-28 00:37:02,347: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:37:02.347884822Z [2024-03-28 00:37:02,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:37:02.348186166Z [2024-03-28 00:37:02,348: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:37:02.348321791Z [2024-03-28 00:37:02,348: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:37:02.457008471Z [2024-03-28 00:37:02,456: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:37:02.468531379Z [2024-03-28 00:37:02,468: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:37:04.038946879Z [2024-03-28 00:37:04,038: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76fae84a-9b3f-4c88-a19e-532adcb240f3] succeeded in 3.7457326519997878s: None 2024-03-28T00:37:04.299147525Z [2024-03-28 00:37:04,298: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[719c8624-ab5b-4499-8ede-5b0fade0d963] succeeded in 4.002537391999795s: None 2024-03-28T00:38:01.186229174Z [2024-03-28 00:38:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f5157e1-1f24-4a74-85a5-9af5cd492f3b] received 2024-03-28T00:38:01.188583886Z [2024-03-28 00:38:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ec5d51c-9f94-404b-97e8-f2b1202f6626] received 2024-03-28T00:38:01.191618408Z [2024-03-28 00:38:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[370a931e-8e97-4088-9ad1-6f9583a785b9] received 2024-03-28T00:38:01.196199121Z [2024-03-28 00:38:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590fd5b3-04f3-4f18-96f2-e6475e0ae737] received 2024-03-28T00:38:01.201665000Z [2024-03-28 00:38:01,201: INFO/ForkPoolWorker-16] [3ec5d51c-9f94-404b-97e8-f2b1202f6626] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:38:01.202936012Z [2024-03-28 00:38:01,202: INFO/ForkPoolWorker-1] [370a931e-8e97-4088-9ad1-6f9583a785b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:38:01.204743044Z [2024-03-28 00:38:01,204: INFO/ForkPoolWorker-15] [1f5157e1-1f24-4a74-85a5-9af5cd492f3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:38:01.219289044Z [2024-03-28 00:38:01,218: INFO/ForkPoolWorker-2] [590fd5b3-04f3-4f18-96f2-e6475e0ae737] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:38:01.536616544Z [2024-03-28 00:38:01,533: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:38:01.567530627Z [2024-03-28 00:38:01,563: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:38:01.598777126Z [2024-03-28 00:38:01,595: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:38:01.752979747Z [2024-03-28 00:38:01,752: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:38:01.757317912Z [2024-03-28 00:38:01,756: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:38:01.779525713Z [2024-03-28 00:38:01,779: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:38:01.780797401Z [2024-03-28 00:38:01,780: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:38:01.781010499Z [2024-03-28 00:38:01,780: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:38:01.781136909Z [2024-03-28 00:38:01,780: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:38:01.781356876Z [2024-03-28 00:38:01,781: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:38:01.870722395Z [2024-03-28 00:38:01,870: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:38:01.890639119Z [2024-03-28 00:38:01,890: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:38:01.947841105Z [2024-03-28 00:38:01,944: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:38:02.449914440Z [2024-03-28 00:38:02,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ec5d51c-9f94-404b-97e8-f2b1202f6626] succeeded in 1.2596330490000582s: None 2024-03-28T00:38:02.603685402Z [2024-03-28 00:38:02,603: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[590fd5b3-04f3-4f18-96f2-e6475e0ae737] succeeded in 1.4007284760000402s: None 2024-03-28T00:38:03.095071052Z [2024-03-28 00:38:03,094: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:38:03.098636313Z [2024-03-28 00:38:03,098: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:38:03.132178788Z [2024-03-28 00:38:03,131: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:38:03.135442713Z [2024-03-28 00:38:03,135: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:38:03.135491084Z [2024-03-28 00:38:03,135: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:38:03.135757155Z [2024-03-28 00:38:03,135: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:38:03.135817749Z [2024-03-28 00:38:03,135: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:38:03.136213475Z [2024-03-28 00:38:03,136: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:38:03.136271503Z [2024-03-28 00:38:03,136: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:38:03.252737732Z [2024-03-28 00:38:03,252: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:38:03.362799891Z [2024-03-28 00:38:03,362: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:38:03.366558964Z [2024-03-28 00:38:03,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:38:03.389442934Z [2024-03-28 00:38:03,389: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:38:03.405674848Z [2024-03-28 00:38:03,402: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:38:03.405810452Z [2024-03-28 00:38:03,402: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:38:03.405821800Z [2024-03-28 00:38:03,402: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:38:03.405827666Z [2024-03-28 00:38:03,402: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:38:03.405852352Z [2024-03-28 00:38:03,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:38:03.405857392Z [2024-03-28 00:38:03,403: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:38:03.507694849Z [2024-03-28 00:38:03,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:38:05.187255639Z [2024-03-28 00:38:05,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f5157e1-1f24-4a74-85a5-9af5cd492f3b] succeeded in 3.9944499660000474s: None 2024-03-28T00:38:05.725031839Z [2024-03-28 00:38:05,724: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[370a931e-8e97-4088-9ad1-6f9583a785b9] succeeded in 4.5293869259999155s: None 2024-03-28T00:39:00.943773320Z [2024-03-28 00:39:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[418561f0-aeff-4ba2-9c9d-0d6464fd59cc] received 2024-03-28T00:39:00.954144707Z [2024-03-28 00:39:00,953: INFO/ForkPoolWorker-15] [418561f0-aeff-4ba2-9c9d-0d6464fd59cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:39:00.959165936Z [2024-03-28 00:39:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802f8e57-eb7a-4099-84ca-6c828df7345c] received 2024-03-28T00:39:00.966300158Z [2024-03-28 00:39:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df4b1aa5-8586-4474-bd17-3e57c756ea9d] received 2024-03-28T00:39:00.977287188Z [2024-03-28 00:39:00,976: INFO/ForkPoolWorker-1] [df4b1aa5-8586-4474-bd17-3e57c756ea9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:39:00.980716560Z [2024-03-28 00:39:00,980: INFO/ForkPoolWorker-16] [802f8e57-eb7a-4099-84ca-6c828df7345c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:39:01.276407175Z [2024-03-28 00:39:01,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:39:01.418764907Z [2024-03-28 00:39:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:39:01.514812235Z [2024-03-28 00:39:01,510: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:39:01.802829751Z [2024-03-28 00:39:01,800: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:39:01.808832180Z [2024-03-28 00:39:01,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:39:01.834059170Z [2024-03-28 00:39:01,833: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:39:01.835613288Z [2024-03-28 00:39:01,835: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:39:01.835699864Z [2024-03-28 00:39:01,835: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:39:01.835741453Z [2024-03-28 00:39:01,835: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:39:01.836064214Z [2024-03-28 00:39:01,835: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:39:01.974053949Z [2024-03-28 00:39:01,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:39:02.631709654Z [2024-03-28 00:39:02,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df4b1aa5-8586-4474-bd17-3e57c756ea9d] succeeded in 1.6626970050001546s: None 2024-03-28T00:39:02.761296034Z [2024-03-28 00:39:02,760: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:39:02.765032981Z [2024-03-28 00:39:02,764: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:39:02.786646160Z [2024-03-28 00:39:02,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:39:02.790953896Z [2024-03-28 00:39:02,790: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:39:02.791051746Z [2024-03-28 00:39:02,790: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:39:02.791101264Z [2024-03-28 00:39:02,790: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:39:02.791127007Z [2024-03-28 00:39:02,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:39:02.791255136Z [2024-03-28 00:39:02,791: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:39:02.791276435Z [2024-03-28 00:39:02,791: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:39:02.905004561Z [2024-03-28 00:39:02,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:39:02.916135962Z [2024-03-28 00:39:02,915: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:39:02.920317656Z [2024-03-28 00:39:02,919: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:39:02.955406809Z [2024-03-28 00:39:02,955: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:39:02.960997099Z [2024-03-28 00:39:02,960: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:39:02.961071495Z [2024-03-28 00:39:02,960: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:39:02.961393902Z [2024-03-28 00:39:02,961: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:39:02.961617184Z [2024-03-28 00:39:02,961: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:39:02.962110996Z [2024-03-28 00:39:02,961: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:39:02.962257228Z [2024-03-28 00:39:02,962: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:39:03.091582017Z [2024-03-28 00:39:03,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:39:04.737291270Z [2024-03-28 00:39:04,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[802f8e57-eb7a-4099-84ca-6c828df7345c] succeeded in 3.774401420999766s: None 2024-03-28T00:39:04.865981788Z [2024-03-28 00:39:04,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[418561f0-aeff-4ba2-9c9d-0d6464fd59cc] succeeded in 3.9197575560001496s: None 2024-03-28T00:40:00.352521550Z [2024-03-28 00:40:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667d411c-d5e7-42a4-9942-a0658b99f9ad] received 2024-03-28T00:40:00.354673042Z [2024-03-28 00:40:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b3a26b8-52e7-4e18-b1d1-b4055c8f8088] received 2024-03-28T00:40:00.357893500Z [2024-03-28 00:40:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c481a44d-85fb-4856-ba6f-c40b40d4e061] received 2024-03-28T00:40:00.359659135Z [2024-03-28 00:40:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee73eb81-d5db-4057-909a-b7d9abd2669e] received 2024-03-28T00:40:00.361978441Z [2024-03-28 00:40:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb9db120-8d20-40cc-9782-572ce8831d3d] received 2024-03-28T00:40:00.375185717Z [2024-03-28 00:40:00,374: INFO/ForkPoolWorker-2] [ee73eb81-d5db-4057-909a-b7d9abd2669e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:40:00.376898973Z [2024-03-28 00:40:00,374: INFO/ForkPoolWorker-1] [c481a44d-85fb-4856-ba6f-c40b40d4e061] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:40:00.380013565Z [2024-03-28 00:40:00,379: INFO/ForkPoolWorker-15] [667d411c-d5e7-42a4-9942-a0658b99f9ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:40:00.387302591Z [2024-03-28 00:40:00,386: INFO/ForkPoolWorker-3] [bb9db120-8d20-40cc-9782-572ce8831d3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:40:00.387495644Z [2024-03-28 00:40:00,387: INFO/ForkPoolWorker-16] [3b3a26b8-52e7-4e18-b1d1-b4055c8f8088] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:40:00.886302406Z [2024-03-28 00:40:00,876: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:40:00.900619536Z [2024-03-28 00:40:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:40:00.947771650Z [2024-03-28 00:40:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:40:00.986816712Z [2024-03-28 00:40:00,982: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:40:01.117493241Z [2024-03-28 00:40:01,112: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:40:01.387876164Z [2024-03-28 00:40:01,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:01.465854696Z [2024-03-28 00:40:01,465: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T00:40:01.479953550Z [2024-03-28 00:40:01,478: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:01.580709333Z [2024-03-28 00:40:01,580: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:40:01.589567123Z [2024-03-28 00:40:01,589: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:40:01.589763504Z [2024-03-28 00:40:01,589: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:40:01.589858565Z [2024-03-28 00:40:01,589: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T00:40:01.593582693Z [2024-03-28 00:40:01,593: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:40:01.790936235Z [2024-03-28 00:40:01,790: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:02.303871065Z [2024-03-28 00:40:02,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c481a44d-85fb-4856-ba6f-c40b40d4e061] succeeded in 1.9431088609999279s: None 2024-03-28T00:40:02.994856318Z [2024-03-28 00:40:02,994: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bb9db120-8d20-40cc-9782-572ce8831d3d] succeeded in 2.626321516999724s: None 2024-03-28T00:40:03.252340325Z [2024-03-28 00:40:03,251: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:40:03.260355936Z [2024-03-28 00:40:03,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:03.356127674Z [2024-03-28 00:40:03,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:40:03.366221468Z [2024-03-28 00:40:03,365: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:03.366244408Z [2024-03-28 00:40:03,366: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:03.370004173Z [2024-03-28 00:40:03,366: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:03.370202418Z [2024-03-28 00:40:03,369: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:40:03.370549297Z [2024-03-28 00:40:03,370: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:40:03.370637618Z [2024-03-28 00:40:03,370: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:03.474920821Z [2024-03-28 00:40:03,474: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:40:03.486163153Z [2024-03-28 00:40:03,482: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:03.630167267Z [2024-03-28 00:40:03,625: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:03.689548134Z [2024-03-28 00:40:03,687: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:40:03.697561469Z [2024-03-28 00:40:03,696: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:03.697584366Z [2024-03-28 00:40:03,696: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:03.697591012Z [2024-03-28 00:40:03,696: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:03.697595601Z [2024-03-28 00:40:03,696: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:40:03.697599262Z [2024-03-28 00:40:03,697: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:40:03.697602613Z [2024-03-28 00:40:03,697: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:03.874407503Z [2024-03-28 00:40:03,873: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:40:03.891453369Z [2024-03-28 00:40:03,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:03.952282406Z [2024-03-28 00:40:03,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:40:03.958985917Z [2024-03-28 00:40:03,958: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:03.959014317Z [2024-03-28 00:40:03,958: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:03.959259281Z [2024-03-28 00:40:03,959: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:03.959360371Z [2024-03-28 00:40:03,959: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:40:03.959780297Z [2024-03-28 00:40:03,959: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:40:03.959800744Z [2024-03-28 00:40:03,959: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:03.977906580Z [2024-03-28 00:40:03,977: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:04.055831475Z [2024-03-28 00:40:04,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:04.614191840Z [2024-03-28 00:40:04,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f790fb7-7d6d-42b2-a6e9-607dedcfe26e] received 2024-03-28T00:40:04.638031349Z [2024-03-28 00:40:04,637: INFO/ForkPoolWorker-1] [1f790fb7-7d6d-42b2-a6e9-607dedcfe26e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:40:04.756520151Z [2024-03-28 00:40:04,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b3a26b8-52e7-4e18-b1d1-b4055c8f8088] succeeded in 4.397783130999869s: None 2024-03-28T00:40:05.133494156Z [2024-03-28 00:40:05,129: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:40:06.323515450Z [2024-03-28 00:40:06,323: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:40:06.326885103Z [2024-03-28 00:40:06,326: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:06.350360206Z [2024-03-28 00:40:06,350: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:40:06.351681056Z [2024-03-28 00:40:06,351: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:06.351788968Z [2024-03-28 00:40:06,351: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:06.351825721Z [2024-03-28 00:40:06,351: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:06.351890383Z [2024-03-28 00:40:06,351: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:40:06.352236862Z [2024-03-28 00:40:06,352: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:40:06.352717070Z [2024-03-28 00:40:06,352: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:06.430771999Z [2024-03-28 00:40:06,430: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:06.500261510Z [2024-03-28 00:40:06,499: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ee73eb81-d5db-4057-909a-b7d9abd2669e] succeeded in 6.137383408999995s: None 2024-03-28T00:40:06.600187331Z [2024-03-28 00:40:06,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[667d411c-d5e7-42a4-9942-a0658b99f9ad] succeeded in 6.2444369150002785s: None 2024-03-28T00:40:07.044415914Z [2024-03-28 00:40:07,043: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f790fb7-7d6d-42b2-a6e9-607dedcfe26e] succeeded in 2.4276795089999723s: None 2024-03-28T00:40:07.383840604Z [2024-03-28 00:40:07,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b23732c-5755-4dd2-8884-ef9fc724688c] received 2024-03-28T00:40:07.391846700Z [2024-03-28 00:40:07,391: INFO/ForkPoolWorker-15] [8b23732c-5755-4dd2-8884-ef9fc724688c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:40:07.678152288Z [2024-03-28 00:40:07,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:40:09.056359567Z [2024-03-28 00:40:09,055: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:40:09.065322900Z [2024-03-28 00:40:09,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:09.110320190Z [2024-03-28 00:40:09,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:40:09.117753435Z [2024-03-28 00:40:09,117: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:09.118011406Z [2024-03-28 00:40:09,117: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:09.118246653Z [2024-03-28 00:40:09,118: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:09.118392737Z [2024-03-28 00:40:09,118: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:40:09.118848718Z [2024-03-28 00:40:09,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:40:09.119030552Z [2024-03-28 00:40:09,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:09.308690935Z [2024-03-28 00:40:09,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:10.162360598Z [2024-03-28 00:40:10,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b23732c-5755-4dd2-8884-ef9fc724688c] succeeded in 2.7747223839996877s: None 2024-03-28T00:40:10.334140153Z [2024-03-28 00:40:10,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4444c81c-cce0-49be-b2d0-6181d985f23f] received 2024-03-28T00:40:10.344410065Z [2024-03-28 00:40:10,344: INFO/ForkPoolWorker-15] [4444c81c-cce0-49be-b2d0-6181d985f23f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:40:10.688614190Z [2024-03-28 00:40:10,684: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:40:11.916374742Z [2024-03-28 00:40:11,915: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:40:11.919870385Z [2024-03-28 00:40:11,919: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:40:11.943277670Z [2024-03-28 00:40:11,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:40:11.944519221Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:40:11.944641000Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:40:11.944665117Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:40:11.944673914Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:40:11.945018598Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:40:11.945036350Z [2024-03-28 00:40:11,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:40:12.033611431Z [2024-03-28 00:40:12,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:40:12.603076138Z [2024-03-28 00:40:12,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4444c81c-cce0-49be-b2d0-6181d985f23f] succeeded in 2.2669940589998987s: None 2024-03-28T00:41:00.701581057Z [2024-03-28 00:41:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec0e42f6-eddc-423c-bcd9-29cfcc5f0d1b] received 2024-03-28T00:41:00.710533139Z [2024-03-28 00:41:00,710: INFO/ForkPoolWorker-15] [ec0e42f6-eddc-423c-bcd9-29cfcc5f0d1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:41:00.713896608Z [2024-03-28 00:41:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebae81bc-4c54-4e55-80ed-ff09b186caff] received 2024-03-28T00:41:00.721178553Z [2024-03-28 00:41:00,720: INFO/ForkPoolWorker-16] [ebae81bc-4c54-4e55-80ed-ff09b186caff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:41:00.722708267Z [2024-03-28 00:41:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe846fc3-2823-4ce4-a7f0-bc8f75ca9215] received 2024-03-28T00:41:00.731991566Z [2024-03-28 00:41:00,731: INFO/ForkPoolWorker-1] [fe846fc3-2823-4ce4-a7f0-bc8f75ca9215] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:41:01.088671428Z [2024-03-28 00:41:01,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:41:01.111216464Z [2024-03-28 00:41:01,107: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:41:01.179823875Z [2024-03-28 00:41:01,176: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:41:01.380558976Z [2024-03-28 00:41:01,380: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:41:01.384928004Z [2024-03-28 00:41:01,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:41:01.409871501Z [2024-03-28 00:41:01,409: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:41:01.411242180Z [2024-03-28 00:41:01,410: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:41:01.411401834Z [2024-03-28 00:41:01,411: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:41:01.411526223Z [2024-03-28 00:41:01,411: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:41:01.411893473Z [2024-03-28 00:41:01,411: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:41:01.514424392Z [2024-03-28 00:41:01,514: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:41:02.188336062Z [2024-03-28 00:41:02,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe846fc3-2823-4ce4-a7f0-bc8f75ca9215] succeeded in 1.4630104180000671s: None 2024-03-28T00:41:02.317074340Z [2024-03-28 00:41:02,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:41:02.320797759Z [2024-03-28 00:41:02,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:41:02.341632716Z [2024-03-28 00:41:02,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:41:02.343102571Z [2024-03-28 00:41:02,342: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:41:02.343128297Z [2024-03-28 00:41:02,342: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:41:02.343377544Z [2024-03-28 00:41:02,343: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:41:02.343422056Z [2024-03-28 00:41:02,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:41:02.343938992Z [2024-03-28 00:41:02,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:41:02.344037430Z [2024-03-28 00:41:02,343: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:41:02.398561662Z [2024-03-28 00:41:02,398: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:41:02.402047495Z [2024-03-28 00:41:02,401: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:41:02.428013939Z [2024-03-28 00:41:02,427: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:41:02.430514818Z [2024-03-28 00:41:02,430: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:41:02.431863151Z [2024-03-28 00:41:02,431: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:41:02.431881877Z [2024-03-28 00:41:02,431: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:41:02.433010483Z [2024-03-28 00:41:02,431: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:41:02.433106608Z [2024-03-28 00:41:02,432: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:41:02.433453518Z [2024-03-28 00:41:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:41:02.433596098Z [2024-03-28 00:41:02,433: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:41:02.515785327Z [2024-03-28 00:41:02,515: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:41:04.295679356Z [2024-03-28 00:41:04,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec0e42f6-eddc-423c-bcd9-29cfcc5f0d1b] succeeded in 3.592588070000147s: None 2024-03-28T00:41:05.627853675Z [2024-03-28 00:41:05,627: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebae81bc-4c54-4e55-80ed-ff09b186caff] succeeded in 4.912186441999893s: None 2024-03-28T00:42:01.277696063Z [2024-03-28 00:42:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[408958d4-c406-444c-baa3-8796f5972b37] received 2024-03-28T00:42:01.280303007Z [2024-03-28 00:42:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579431f9-8a4e-499f-ac1d-a6e2e9e43576] received 2024-03-28T00:42:01.282410007Z [2024-03-28 00:42:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea22fc76-8b6e-41e1-8a39-54274bc9874d] received 2024-03-28T00:42:01.304534154Z [2024-03-28 00:42:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e01ad89-2475-44ff-a796-271012c8a486] received 2024-03-28T00:42:01.304576450Z [2024-03-28 00:42:01,295: INFO/ForkPoolWorker-2] [4e01ad89-2475-44ff-a796-271012c8a486] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:42:01.304583186Z [2024-03-28 00:42:01,297: INFO/ForkPoolWorker-16] [579431f9-8a4e-499f-ac1d-a6e2e9e43576] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:42:01.304588844Z [2024-03-28 00:42:01,302: INFO/ForkPoolWorker-1] [ea22fc76-8b6e-41e1-8a39-54274bc9874d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:42:01.307739776Z [2024-03-28 00:42:01,306: INFO/ForkPoolWorker-15] [408958d4-c406-444c-baa3-8796f5972b37] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:42:01.861353090Z [2024-03-28 00:42:01,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:42:01.920160943Z [2024-03-28 00:42:01,915: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:42:01.970047627Z [2024-03-28 00:42:01,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:42:02.008072632Z [2024-03-28 00:42:02,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:42:02.279950708Z [2024-03-28 00:42:02,279: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:42:02.332140568Z [2024-03-28 00:42:02,331: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:42:02.336865597Z [2024-03-28 00:42:02,336: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:42:02.396498181Z [2024-03-28 00:42:02,396: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:42:02.398501877Z [2024-03-28 00:42:02,398: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:42:02.398769124Z [2024-03-28 00:42:02,398: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:42:02.399075426Z [2024-03-28 00:42:02,398: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:42:02.400183753Z [2024-03-28 00:42:02,400: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:42:02.513630666Z [2024-03-28 00:42:02,513: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:42:03.052830671Z [2024-03-28 00:42:03,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[408958d4-c406-444c-baa3-8796f5972b37] succeeded in 1.770391090999965s: None 2024-03-28T00:42:03.296273112Z [2024-03-28 00:42:03,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea22fc76-8b6e-41e1-8a39-54274bc9874d] succeeded in 2.009875232000013s: None 2024-03-28T00:42:03.601073307Z [2024-03-28 00:42:03,599: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:42:03.605560668Z [2024-03-28 00:42:03,603: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:42:03.628382271Z [2024-03-28 00:42:03,627: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:42:03.630153853Z [2024-03-28 00:42:03,629: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:42:03.630170096Z [2024-03-28 00:42:03,630: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:42:03.630414403Z [2024-03-28 00:42:03,630: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:42:03.630425449Z [2024-03-28 00:42:03,630: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:42:03.630776567Z [2024-03-28 00:42:03,630: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:42:03.630968024Z [2024-03-28 00:42:03,630: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:42:03.738481807Z [2024-03-28 00:42:03,738: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:42:03.780752328Z [2024-03-28 00:42:03,780: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:42:03.786818578Z [2024-03-28 00:42:03,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:42:03.807574107Z [2024-03-28 00:42:03,807: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:42:03.808859021Z [2024-03-28 00:42:03,808: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:42:03.808873463Z [2024-03-28 00:42:03,808: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:42:03.808981730Z [2024-03-28 00:42:03,808: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:42:03.808997419Z [2024-03-28 00:42:03,808: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:42:03.809263256Z [2024-03-28 00:42:03,809: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:42:03.809338353Z [2024-03-28 00:42:03,809: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:42:03.912198501Z [2024-03-28 00:42:03,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:42:05.520176406Z [2024-03-28 00:42:05,519: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[579431f9-8a4e-499f-ac1d-a6e2e9e43576] succeeded in 4.237046758000361s: None 2024-03-28T00:42:06.477807344Z [2024-03-28 00:42:06,477: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4e01ad89-2475-44ff-a796-271012c8a486] succeeded in 5.189203593000002s: None 2024-03-28T00:43:01.157578854Z [2024-03-28 00:43:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d16dd914-0c2d-48d2-aed9-1f433df79347] received 2024-03-28T00:43:01.159736002Z [2024-03-28 00:43:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55dca2c2-d221-4907-a633-20c43de3782f] received 2024-03-28T00:43:01.169610547Z [2024-03-28 00:43:01,169: INFO/ForkPoolWorker-16] [55dca2c2-d221-4907-a633-20c43de3782f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:43:01.170425315Z [2024-03-28 00:43:01,170: INFO/ForkPoolWorker-15] [d16dd914-0c2d-48d2-aed9-1f433df79347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:43:01.182143069Z [2024-03-28 00:43:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f97ad31e-6135-4774-835d-111733b7f3ba] received 2024-03-28T00:43:01.189536060Z [2024-03-28 00:43:01,189: INFO/ForkPoolWorker-1] [f97ad31e-6135-4774-835d-111733b7f3ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:43:01.509089382Z [2024-03-28 00:43:01,505: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:43:01.520850183Z [2024-03-28 00:43:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:43:01.531274896Z [2024-03-28 00:43:01,527: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:43:01.683751317Z [2024-03-28 00:43:01,683: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:43:01.688125751Z [2024-03-28 00:43:01,687: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:43:01.717845242Z [2024-03-28 00:43:01,717: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:43:01.719771055Z [2024-03-28 00:43:01,719: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:43:01.720083209Z [2024-03-28 00:43:01,719: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:43:01.720355848Z [2024-03-28 00:43:01,720: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:43:01.720949857Z [2024-03-28 00:43:01,720: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:43:01.824448974Z [2024-03-28 00:43:01,824: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:43:02.529757053Z [2024-03-28 00:43:02,529: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f97ad31e-6135-4774-835d-111733b7f3ba] succeeded in 1.345828549000089s: None 2024-03-28T00:43:03.076045988Z [2024-03-28 00:43:03,075: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:43:03.079813278Z [2024-03-28 00:43:03,079: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:43:03.100261138Z [2024-03-28 00:43:03,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:43:03.101548262Z [2024-03-28 00:43:03,101: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:43:03.101564393Z [2024-03-28 00:43:03,101: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:43:03.101772541Z [2024-03-28 00:43:03,101: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:43:03.101819206Z [2024-03-28 00:43:03,101: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:43:03.102248639Z [2024-03-28 00:43:03,102: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:43:03.102291683Z [2024-03-28 00:43:03,102: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:43:03.117559681Z [2024-03-28 00:43:03,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:43:03.121277869Z [2024-03-28 00:43:03,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:43:03.143263974Z [2024-03-28 00:43:03,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:43:03.146291610Z [2024-03-28 00:43:03,146: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:43:03.146580021Z [2024-03-28 00:43:03,146: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:43:03.146844889Z [2024-03-28 00:43:03,146: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:43:03.147036037Z [2024-03-28 00:43:03,146: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:43:03.147414403Z [2024-03-28 00:43:03,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:43:03.147611878Z [2024-03-28 00:43:03,147: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:43:03.190526133Z [2024-03-28 00:43:03,190: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:43:03.224421283Z [2024-03-28 00:43:03,224: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:43:04.895861776Z [2024-03-28 00:43:04,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d16dd914-0c2d-48d2-aed9-1f433df79347] succeeded in 3.7347422449997794s: None 2024-03-28T00:43:05.164469637Z [2024-03-28 00:43:05,164: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55dca2c2-d221-4907-a633-20c43de3782f] succeeded in 4.0022662179999315s: None 2024-03-28T00:44:00.902714718Z [2024-03-28 00:44:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03185134-2b29-4ed2-9cd0-ab6871b957d1] received 2024-03-28T00:44:00.907611940Z [2024-03-28 00:44:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[075aa0b0-1a4e-4f28-ba71-9030dfe1afc7] received 2024-03-28T00:44:00.911027686Z [2024-03-28 00:44:00,910: INFO/ForkPoolWorker-15] [03185134-2b29-4ed2-9cd0-ab6871b957d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:44:00.911617777Z [2024-03-28 00:44:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[284d8016-2793-4a5e-97fb-fdc3d0be4558] received 2024-03-28T00:44:00.915137125Z [2024-03-28 00:44:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8178d95-ca2b-4b44-bec6-2a290796e5bc] received 2024-03-28T00:44:00.925186954Z [2024-03-28 00:44:00,924: INFO/ForkPoolWorker-2] [a8178d95-ca2b-4b44-bec6-2a290796e5bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:44:00.928496146Z [2024-03-28 00:44:00,927: INFO/ForkPoolWorker-1] [284d8016-2793-4a5e-97fb-fdc3d0be4558] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:44:00.934596705Z [2024-03-28 00:44:00,934: INFO/ForkPoolWorker-16] [075aa0b0-1a4e-4f28-ba71-9030dfe1afc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:44:01.255553066Z [2024-03-28 00:44:01,251: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:44:01.347314372Z [2024-03-28 00:44:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:44:01.395862544Z [2024-03-28 00:44:01,392: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:44:01.443653998Z [2024-03-28 00:44:01,426: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:44:01.558398731Z [2024-03-28 00:44:01,557: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:44:01.564292773Z [2024-03-28 00:44:01,563: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:44:01.594605468Z [2024-03-28 00:44:01,594: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:44:01.595801489Z [2024-03-28 00:44:01,595: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:44:01.595891468Z [2024-03-28 00:44:01,595: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:44:01.595984441Z [2024-03-28 00:44:01,595: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:44:01.596644960Z [2024-03-28 00:44:01,596: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:44:01.642261085Z [2024-03-28 00:44:01,641: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:44:01.694909895Z [2024-03-28 00:44:01,694: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:44:02.400790020Z [2024-03-28 00:44:02,400: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[284d8016-2793-4a5e-97fb-fdc3d0be4558] succeeded in 1.487226001000181s: None 2024-03-28T00:44:02.414208263Z [2024-03-28 00:44:02,413: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[075aa0b0-1a4e-4f28-ba71-9030dfe1afc7] succeeded in 1.504591322000124s: None 2024-03-28T00:44:03.101187143Z [2024-03-28 00:44:03,100: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:44:03.105241780Z [2024-03-28 00:44:03,104: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:44:03.128265449Z [2024-03-28 00:44:03,128: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:44:03.129849444Z [2024-03-28 00:44:03,129: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:44:03.129989302Z [2024-03-28 00:44:03,129: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:44:03.130300416Z [2024-03-28 00:44:03,130: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:44:03.130420717Z [2024-03-28 00:44:03,130: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:44:03.130815997Z [2024-03-28 00:44:03,130: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:44:03.130949959Z [2024-03-28 00:44:03,130: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:44:03.149900088Z [2024-03-28 00:44:03,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:44:03.153589760Z [2024-03-28 00:44:03,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:44:03.178045070Z [2024-03-28 00:44:03,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:44:03.179613349Z [2024-03-28 00:44:03,179: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:44:03.179883206Z [2024-03-28 00:44:03,179: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:44:03.180084708Z [2024-03-28 00:44:03,179: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:44:03.180134609Z [2024-03-28 00:44:03,180: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:44:03.180503750Z [2024-03-28 00:44:03,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:44:03.180619954Z [2024-03-28 00:44:03,180: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:44:03.228428587Z [2024-03-28 00:44:03,227: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:44:03.288432423Z [2024-03-28 00:44:03,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:44:05.215270783Z [2024-03-28 00:44:05,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03185134-2b29-4ed2-9cd0-ab6871b957d1] succeeded in 4.309357060999901s: None 2024-03-28T00:44:05.659339397Z [2024-03-28 00:44:05,658: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a8178d95-ca2b-4b44-bec6-2a290796e5bc] succeeded in 4.742103384000075s: None 2024-03-28T00:45:01.204691843Z [2024-03-28 00:45:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9155295a-0565-43b9-9e95-8d80e790f638] received 2024-03-28T00:45:01.208131796Z [2024-03-28 00:45:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42acabc3-b842-4847-a726-79007999f38a] received 2024-03-28T00:45:01.214514670Z [2024-03-28 00:45:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd25f9d-d4ab-4169-991b-e741fbdd9c44] received 2024-03-28T00:45:01.216598112Z [2024-03-28 00:45:01,216: INFO/ForkPoolWorker-16] [42acabc3-b842-4847-a726-79007999f38a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:45:01.219100769Z [2024-03-28 00:45:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb755ae3-cdcc-4276-929c-113b6ba0d1e9] received 2024-03-28T00:45:01.225620537Z [2024-03-28 00:45:01,225: INFO/ForkPoolWorker-15] [9155295a-0565-43b9-9e95-8d80e790f638] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:45:01.231593068Z [2024-03-28 00:45:01,227: INFO/ForkPoolWorker-1] [cdd25f9d-d4ab-4169-991b-e741fbdd9c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:45:01.233130241Z [2024-03-28 00:45:01,232: INFO/ForkPoolWorker-2] [cb755ae3-cdcc-4276-929c-113b6ba0d1e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:45:01.600760216Z [2024-03-28 00:45:01,596: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:45:01.630855591Z [2024-03-28 00:45:01,627: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:45:01.637080176Z [2024-03-28 00:45:01,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:45:01.851223623Z [2024-03-28 00:45:01,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:45:01.856527862Z [2024-03-28 00:45:01,855: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:45:01.867080458Z [2024-03-28 00:45:01,866: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:01.903447400Z [2024-03-28 00:45:01,903: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:45:01.905807503Z [2024-03-28 00:45:01,905: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:45:01.906674477Z [2024-03-28 00:45:01,906: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:45:01.906895069Z [2024-03-28 00:45:01,906: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:45:01.907898963Z [2024-03-28 00:45:01,907: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:45:02.077678862Z [2024-03-28 00:45:02,077: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:02.784717121Z [2024-03-28 00:45:02,784: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb755ae3-cdcc-4276-929c-113b6ba0d1e9] succeeded in 1.563489724000192s: None 2024-03-28T00:45:03.074044873Z [2024-03-28 00:45:03,073: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:45:03.079745257Z [2024-03-28 00:45:03,079: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:03.104930536Z [2024-03-28 00:45:03,104: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:45:03.107461315Z [2024-03-28 00:45:03,106: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:03.107665631Z [2024-03-28 00:45:03,107: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:03.107922140Z [2024-03-28 00:45:03,107: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:03.107978497Z [2024-03-28 00:45:03,107: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:45:03.108415892Z [2024-03-28 00:45:03,108: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:45:03.108449333Z [2024-03-28 00:45:03,108: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:03.124658913Z [2024-03-28 00:45:03,123: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:45:03.128825212Z [2024-03-28 00:45:03,128: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:03.157132426Z [2024-03-28 00:45:03,156: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:45:03.158647555Z [2024-03-28 00:45:03,158: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:03.158717613Z [2024-03-28 00:45:03,158: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:03.158927521Z [2024-03-28 00:45:03,158: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:03.158998663Z [2024-03-28 00:45:03,158: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:45:03.159352668Z [2024-03-28 00:45:03,159: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:45:03.159555696Z [2024-03-28 00:45:03,159: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:03.238422013Z [2024-03-28 00:45:03,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:03.323307236Z [2024-03-28 00:45:03,323: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:03.723139719Z [2024-03-28 00:45:03,722: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:45:03.727816155Z [2024-03-28 00:45:03,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:03.768947327Z [2024-03-28 00:45:03,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:45:03.776349968Z [2024-03-28 00:45:03,775: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:03.776601762Z [2024-03-28 00:45:03,776: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:03.776954058Z [2024-03-28 00:45:03,776: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:03.777403076Z [2024-03-28 00:45:03,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:45:03.781302981Z [2024-03-28 00:45:03,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:45:03.781775938Z [2024-03-28 00:45:03,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:03.933037137Z [2024-03-28 00:45:03,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:04.651835256Z [2024-03-28 00:45:04,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9155295a-0565-43b9-9e95-8d80e790f638] succeeded in 3.439960722000251s: None 2024-03-28T00:45:04.734296531Z [2024-03-28 00:45:04,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3fc4262-b96a-4301-852b-358ab93ee95a] received 2024-03-28T00:45:04.746030244Z [2024-03-28 00:45:04,745: INFO/ForkPoolWorker-15] [f3fc4262-b96a-4301-852b-358ab93ee95a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:45:05.042078639Z [2024-03-28 00:45:05,038: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:45:05.244300373Z [2024-03-28 00:45:05,243: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cdd25f9d-d4ab-4169-991b-e741fbdd9c44] succeeded in 4.0275693990001855s: None 2024-03-28T00:45:05.506131371Z [2024-03-28 00:45:05,505: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42acabc3-b842-4847-a726-79007999f38a] succeeded in 4.296475878000365s: None 2024-03-28T00:45:06.254139283Z [2024-03-28 00:45:06,253: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:45:06.257590960Z [2024-03-28 00:45:06,257: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:06.284000627Z [2024-03-28 00:45:06,283: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:45:06.289713995Z [2024-03-28 00:45:06,286: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:06.289724594Z [2024-03-28 00:45:06,286: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:06.289733929Z [2024-03-28 00:45:06,286: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:06.289741495Z [2024-03-28 00:45:06,287: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:45:06.289746662Z [2024-03-28 00:45:06,287: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:45:06.289751710Z [2024-03-28 00:45:06,287: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:06.419877192Z [2024-03-28 00:45:06,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:07.003753796Z [2024-03-28 00:45:07,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3fc4262-b96a-4301-852b-358ab93ee95a] succeeded in 2.2661071519996767s: None 2024-03-28T00:45:07.439390691Z [2024-03-28 00:45:07,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[996b8b12-fc2b-4ab4-9350-b395a1a8e132] received 2024-03-28T00:45:07.449553503Z [2024-03-28 00:45:07,449: INFO/ForkPoolWorker-15] [996b8b12-fc2b-4ab4-9350-b395a1a8e132] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:45:07.742214310Z [2024-03-28 00:45:07,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:45:09.089507652Z [2024-03-28 00:45:09,089: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:45:09.093102510Z [2024-03-28 00:45:09,092: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:09.112032242Z [2024-03-28 00:45:09,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:45:09.113275790Z [2024-03-28 00:45:09,113: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:09.113413915Z [2024-03-28 00:45:09,113: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:09.113657855Z [2024-03-28 00:45:09,113: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:09.113789124Z [2024-03-28 00:45:09,113: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:45:09.114116709Z [2024-03-28 00:45:09,113: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:45:09.114245281Z [2024-03-28 00:45:09,114: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:09.198166232Z [2024-03-28 00:45:09,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:09.742663078Z [2024-03-28 00:45:09,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[996b8b12-fc2b-4ab4-9350-b395a1a8e132] succeeded in 2.300351464999949s: None 2024-03-28T00:45:09.914220502Z [2024-03-28 00:45:09,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f41c9c7-9178-4e01-b783-723d94b2680f] received 2024-03-28T00:45:09.935154106Z [2024-03-28 00:45:09,934: INFO/ForkPoolWorker-15] [7f41c9c7-9178-4e01-b783-723d94b2680f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:45:10.307595919Z [2024-03-28 00:45:10,303: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:45:11.549885756Z [2024-03-28 00:45:11,549: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:45:11.554031656Z [2024-03-28 00:45:11,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:45:11.578106096Z [2024-03-28 00:45:11,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:45:11.579683915Z [2024-03-28 00:45:11,579: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:45:11.579929596Z [2024-03-28 00:45:11,579: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:45:11.580210013Z [2024-03-28 00:45:11,579: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:45:11.580366875Z [2024-03-28 00:45:11,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:45:11.580796306Z [2024-03-28 00:45:11,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:45:11.580995882Z [2024-03-28 00:45:11,580: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:45:11.662876014Z [2024-03-28 00:45:11,662: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:45:12.258587403Z [2024-03-28 00:45:12,258: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f41c9c7-9178-4e01-b783-723d94b2680f] succeeded in 2.3422259799999665s: None 2024-03-28T00:46:00.374480234Z [2024-03-28 00:46:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0391ff5e-0367-485d-92e7-0d0fe855d3a7] received 2024-03-28T00:46:00.380397648Z [2024-03-28 00:46:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf1ce456-3510-4bef-9a25-c9c9335a506d] received 2024-03-28T00:46:00.382270860Z [2024-03-28 00:46:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2de72db-0b48-408d-9616-f39cabce2f1d] received 2024-03-28T00:46:00.383835475Z [2024-03-28 00:46:00,383: INFO/ForkPoolWorker-15] [0391ff5e-0367-485d-92e7-0d0fe855d3a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:46:00.391136332Z [2024-03-28 00:46:00,390: INFO/ForkPoolWorker-1] [f2de72db-0b48-408d-9616-f39cabce2f1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:46:00.392812143Z [2024-03-28 00:46:00,392: INFO/ForkPoolWorker-16] [cf1ce456-3510-4bef-9a25-c9c9335a506d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:46:00.396687236Z [2024-03-28 00:46:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b41c209-3dcf-4172-ab2b-ec7c1f1cd8c9] received 2024-03-28T00:46:00.413261089Z [2024-03-28 00:46:00,412: INFO/ForkPoolWorker-2] [6b41c209-3dcf-4172-ab2b-ec7c1f1cd8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:46:00.735382475Z [2024-03-28 00:46:00,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:46:00.739040833Z [2024-03-28 00:46:00,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:46:00.744058376Z [2024-03-28 00:46:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:46:00.767489308Z [2024-03-28 00:46:00,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:46:00.931337314Z [2024-03-28 00:46:00,930: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:46:00.935601802Z [2024-03-28 00:46:00,935: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:46:00.986644885Z [2024-03-28 00:46:00,986: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:46:00.994626598Z [2024-03-28 00:46:00,994: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:46:00.994970171Z [2024-03-28 00:46:00,994: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:46:00.995020791Z [2024-03-28 00:46:00,994: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:46:00.995362194Z [2024-03-28 00:46:00,995: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:46:01.090362098Z [2024-03-28 00:46:01,089: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:46:01.224759052Z [2024-03-28 00:46:01,224: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:46:01.830420222Z [2024-03-28 00:46:01,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0391ff5e-0367-485d-92e7-0d0fe855d3a7] succeeded in 1.4539185720000205s: None 2024-03-28T00:46:02.119073603Z [2024-03-28 00:46:02,118: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6b41c209-3dcf-4172-ab2b-ec7c1f1cd8c9] succeeded in 1.719421302000228s: None 2024-03-28T00:46:02.496262817Z [2024-03-28 00:46:02,495: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:46:02.499897843Z [2024-03-28 00:46:02,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:46:02.526813521Z [2024-03-28 00:46:02,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:46:02.530733903Z [2024-03-28 00:46:02,530: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:46:02.530763408Z [2024-03-28 00:46:02,530: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:46:02.530907273Z [2024-03-28 00:46:02,530: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:46:02.530967751Z [2024-03-28 00:46:02,530: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:46:02.531272878Z [2024-03-28 00:46:02,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:46:02.531327296Z [2024-03-28 00:46:02,531: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:46:02.636882244Z [2024-03-28 00:46:02,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:46:02.792464676Z [2024-03-28 00:46:02,792: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:46:02.796437982Z [2024-03-28 00:46:02,795: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:46:02.828661180Z [2024-03-28 00:46:02,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:46:02.830723321Z [2024-03-28 00:46:02,830: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:46:02.830787014Z [2024-03-28 00:46:02,830: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:46:02.831108455Z [2024-03-28 00:46:02,830: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:46:02.831253317Z [2024-03-28 00:46:02,831: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:46:02.831777588Z [2024-03-28 00:46:02,831: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:46:02.831963954Z [2024-03-28 00:46:02,831: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:46:02.950444195Z [2024-03-28 00:46:02,950: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:46:04.162431930Z [2024-03-28 00:46:04,161: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2de72db-0b48-408d-9616-f39cabce2f1d] succeeded in 3.77768340800003s: None 2024-03-28T00:46:04.898714827Z [2024-03-28 00:46:04,898: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf1ce456-3510-4bef-9a25-c9c9335a506d] succeeded in 4.516614793999906s: None 2024-03-28T00:47:01.134911104Z [2024-03-28 00:47:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91f6ff6b-5fcc-4f0c-a12f-12c8a8c97231] received 2024-03-28T00:47:01.137059260Z [2024-03-28 00:47:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9119090-a883-4592-8f80-7b97cbb0bbc5] received 2024-03-28T00:47:01.141959160Z [2024-03-28 00:47:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20f2b55f-28b4-41ff-a099-4bfe380226d6] received 2024-03-28T00:47:01.145004782Z [2024-03-28 00:47:01,144: INFO/ForkPoolWorker-15] [91f6ff6b-5fcc-4f0c-a12f-12c8a8c97231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:47:01.145628987Z [2024-03-28 00:47:01,145: INFO/ForkPoolWorker-16] [a9119090-a883-4592-8f80-7b97cbb0bbc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:47:01.156054767Z [2024-03-28 00:47:01,154: INFO/ForkPoolWorker-1] [20f2b55f-28b4-41ff-a099-4bfe380226d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:47:01.481872936Z [2024-03-28 00:47:01,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:47:01.513590540Z [2024-03-28 00:47:01,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:47:01.561379793Z [2024-03-28 00:47:01,557: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:47:01.709013412Z [2024-03-28 00:47:01,708: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:47:01.713499175Z [2024-03-28 00:47:01,712: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:47:01.738534926Z [2024-03-28 00:47:01,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:47:01.740817001Z [2024-03-28 00:47:01,740: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:47:01.741024920Z [2024-03-28 00:47:01,740: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:47:01.741126550Z [2024-03-28 00:47:01,740: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:47:01.741742195Z [2024-03-28 00:47:01,741: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:47:01.861907908Z [2024-03-28 00:47:01,861: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:47:02.703088257Z [2024-03-28 00:47:02,702: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20f2b55f-28b4-41ff-a099-4bfe380226d6] succeeded in 1.5593619300002501s: None 2024-03-28T00:47:02.967681745Z [2024-03-28 00:47:02,967: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:47:02.972096076Z [2024-03-28 00:47:02,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:47:03.012170356Z [2024-03-28 00:47:03,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:47:03.014444019Z [2024-03-28 00:47:03,014: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:47:03.014658350Z [2024-03-28 00:47:03,014: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:47:03.014812346Z [2024-03-28 00:47:03,014: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:47:03.014824801Z [2024-03-28 00:47:03,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:47:03.015682586Z [2024-03-28 00:47:03,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:47:03.015696120Z [2024-03-28 00:47:03,015: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:47:03.116231157Z [2024-03-28 00:47:03,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:47:03.120274035Z [2024-03-28 00:47:03,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:47:03.124994957Z [2024-03-28 00:47:03,124: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:47:03.143092003Z [2024-03-28 00:47:03,142: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:47:03.144794128Z [2024-03-28 00:47:03,144: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:47:03.145013669Z [2024-03-28 00:47:03,144: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:47:03.145261388Z [2024-03-28 00:47:03,145: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:47:03.145455997Z [2024-03-28 00:47:03,145: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:47:03.145864598Z [2024-03-28 00:47:03,145: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:47:03.146156088Z [2024-03-28 00:47:03,145: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:47:03.280555454Z [2024-03-28 00:47:03,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:47:05.426057809Z [2024-03-28 00:47:05,425: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9119090-a883-4592-8f80-7b97cbb0bbc5] succeeded in 4.287264942000093s: None 2024-03-28T00:47:05.485837185Z [2024-03-28 00:47:05,485: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91f6ff6b-5fcc-4f0c-a12f-12c8a8c97231] succeeded in 4.3477976379999745s: None 2024-03-28T00:48:00.875728277Z [2024-03-28 00:48:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b1318ac-d4b7-4849-bcd5-02187d3f5172] received 2024-03-28T00:48:00.878899115Z [2024-03-28 00:48:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8e3e03a-085a-4de8-b0d0-edefb4b91936] received 2024-03-28T00:48:00.881798822Z [2024-03-28 00:48:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a41b2ee-5725-4127-ae2f-4c9c09159aa2] received 2024-03-28T00:48:00.894618571Z [2024-03-28 00:48:00,894: INFO/ForkPoolWorker-1] [2a41b2ee-5725-4127-ae2f-4c9c09159aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:48:00.894995097Z [2024-03-28 00:48:00,894: INFO/ForkPoolWorker-15] [1b1318ac-d4b7-4849-bcd5-02187d3f5172] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:48:00.900801640Z [2024-03-28 00:48:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ba1c425-296b-400a-994d-497d3aa0e825] received 2024-03-28T00:48:00.902723815Z [2024-03-28 00:48:00,902: INFO/ForkPoolWorker-16] [b8e3e03a-085a-4de8-b0d0-edefb4b91936] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:48:00.909009831Z [2024-03-28 00:48:00,908: INFO/ForkPoolWorker-2] [1ba1c425-296b-400a-994d-497d3aa0e825] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:48:01.404248545Z [2024-03-28 00:48:01,400: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:48:01.697119094Z [2024-03-28 00:48:01,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:48:01.715376034Z [2024-03-28 00:48:01,711: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:48:02.021178937Z [2024-03-28 00:48:02,020: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:48:02.036912574Z [2024-03-28 00:48:02,036: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:48:02.102662787Z [2024-03-28 00:48:02,102: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:48:02.105702800Z [2024-03-28 00:48:02,105: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:48:02.106106890Z [2024-03-28 00:48:02,105: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:48:02.106181683Z [2024-03-28 00:48:02,106: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:48:02.106417071Z [2024-03-28 00:48:02,106: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:48:02.129253790Z [2024-03-28 00:48:02,106: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:48:02.324948294Z [2024-03-28 00:48:02,324: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:48:02.384150920Z [2024-03-28 00:48:02,383: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:48:03.258792906Z [2024-03-28 00:48:03,258: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1ba1c425-296b-400a-994d-497d3aa0e825] succeeded in 2.3563208000000486s: None 2024-03-28T00:48:03.530239439Z [2024-03-28 00:48:03,529: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:48:03.534367402Z [2024-03-28 00:48:03,533: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:48:03.587760496Z [2024-03-28 00:48:03,587: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:48:03.589882830Z [2024-03-28 00:48:03,589: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:48:03.589957010Z [2024-03-28 00:48:03,589: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:48:03.590183738Z [2024-03-28 00:48:03,589: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:48:03.590257322Z [2024-03-28 00:48:03,590: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:48:03.590678692Z [2024-03-28 00:48:03,590: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:48:03.590885371Z [2024-03-28 00:48:03,590: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:48:03.633312200Z [2024-03-28 00:48:03,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b1318ac-d4b7-4849-bcd5-02187d3f5172] succeeded in 2.753387155999917s: None 2024-03-28T00:48:03.780767324Z [2024-03-28 00:48:03,778: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:48:04.425229451Z [2024-03-28 00:48:04,424: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:48:04.428861947Z [2024-03-28 00:48:04,428: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:48:04.447118778Z [2024-03-28 00:48:04,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:48:04.448340058Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:48:04.448423122Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:48:04.448574840Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:48:04.448642928Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:48:04.448912971Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:48:04.448987187Z [2024-03-28 00:48:04,448: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:48:04.545350337Z [2024-03-28 00:48:04,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:48:05.479519449Z [2024-03-28 00:48:05,478: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a41b2ee-5725-4127-ae2f-4c9c09159aa2] succeeded in 4.595759240000007s: None 2024-03-28T00:48:06.335150538Z [2024-03-28 00:48:06,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8e3e03a-085a-4de8-b0d0-edefb4b91936] succeeded in 5.4480168249997405s: None 2024-03-28T00:49:00.530729816Z [2024-03-28 00:49:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3de940d4-28df-46e9-8d34-7295db93bc7b] received 2024-03-28T00:49:00.532864363Z [2024-03-28 00:49:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78c1b2b5-bf3c-46ac-bfe6-2e2c92033bf8] received 2024-03-28T00:49:00.539975493Z [2024-03-28 00:49:00,539: INFO/ForkPoolWorker-15] [3de940d4-28df-46e9-8d34-7295db93bc7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:49:00.543182217Z [2024-03-28 00:49:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[240ae83b-da1a-4730-88f0-2fdd220844bf] received 2024-03-28T00:49:00.543290491Z [2024-03-28 00:49:00,542: INFO/ForkPoolWorker-16] [78c1b2b5-bf3c-46ac-bfe6-2e2c92033bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:49:00.550492624Z [2024-03-28 00:49:00,550: INFO/ForkPoolWorker-1] [240ae83b-da1a-4730-88f0-2fdd220844bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:49:00.868317858Z [2024-03-28 00:49:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:49:00.875524229Z [2024-03-28 00:49:00,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:49:00.877213051Z [2024-03-28 00:49:00,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:49:01.057290418Z [2024-03-28 00:49:01,056: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:49:01.061884911Z [2024-03-28 00:49:01,061: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:49:01.084958247Z [2024-03-28 00:49:01,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:49:01.086843436Z [2024-03-28 00:49:01,086: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:49:01.087234596Z [2024-03-28 00:49:01,087: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:49:01.087340227Z [2024-03-28 00:49:01,087: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:49:01.087680730Z [2024-03-28 00:49:01,087: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:49:01.227291143Z [2024-03-28 00:49:01,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:49:01.992616485Z [2024-03-28 00:49:01,992: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[240ae83b-da1a-4730-88f0-2fdd220844bf] succeeded in 1.4471864070001175s: None 2024-03-28T00:49:02.119165157Z [2024-03-28 00:49:02,118: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:49:02.123131799Z [2024-03-28 00:49:02,122: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:49:02.129298008Z [2024-03-28 00:49:02,128: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:49:02.133132122Z [2024-03-28 00:49:02,132: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:49:02.149749597Z [2024-03-28 00:49:02,149: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:49:02.152976099Z [2024-03-28 00:49:02,152: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:49:02.153254019Z [2024-03-28 00:49:02,153: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:49:02.153684310Z [2024-03-28 00:49:02,153: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:49:02.153912635Z [2024-03-28 00:49:02,153: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:49:02.154506411Z [2024-03-28 00:49:02,154: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:49:02.154739400Z [2024-03-28 00:49:02,154: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:49:02.163285629Z [2024-03-28 00:49:02,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:49:02.166835143Z [2024-03-28 00:49:02,166: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:49:02.166864795Z [2024-03-28 00:49:02,166: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:49:02.166944413Z [2024-03-28 00:49:02,166: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:49:02.166973485Z [2024-03-28 00:49:02,166: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:49:02.167226144Z [2024-03-28 00:49:02,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:49:02.167328204Z [2024-03-28 00:49:02,167: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:49:02.295842547Z [2024-03-28 00:49:02,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:49:02.307560012Z [2024-03-28 00:49:02,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:49:03.887469687Z [2024-03-28 00:49:03,886: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3de940d4-28df-46e9-8d34-7295db93bc7b] succeeded in 3.353449544000341s: None 2024-03-28T00:49:04.239298082Z [2024-03-28 00:49:04,238: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78c1b2b5-bf3c-46ac-bfe6-2e2c92033bf8] succeeded in 3.6999552440001935s: None 2024-03-28T00:50:00.945849519Z [2024-03-28 00:50:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d7c777b-1a8f-4b38-a29f-6aec1484e8ff] received 2024-03-28T00:50:00.950082414Z [2024-03-28 00:50:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[764dbcc5-e4b8-4ccb-8c4d-397d4c4a86b6] received 2024-03-28T00:50:00.960838945Z [2024-03-28 00:50:00,960: INFO/ForkPoolWorker-15] [6d7c777b-1a8f-4b38-a29f-6aec1484e8ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:50:00.964099518Z [2024-03-28 00:50:00,963: INFO/ForkPoolWorker-16] [764dbcc5-e4b8-4ccb-8c4d-397d4c4a86b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:50:00.964623545Z [2024-03-28 00:50:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[981bf160-f64e-4747-9d5c-816f19db8e3f] received 2024-03-28T00:50:00.971506308Z [2024-03-28 00:50:00,971: INFO/ForkPoolWorker-1] [981bf160-f64e-4747-9d5c-816f19db8e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:50:00.987650112Z [2024-03-28 00:50:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef1dd388-db0b-4da8-9978-d295a57665f8] received 2024-03-28T00:50:00.996801826Z [2024-03-28 00:50:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58f8cc05-ea64-4cdf-8e28-6f220e1631c7] received 2024-03-28T00:50:00.998403484Z [2024-03-28 00:50:00,998: INFO/ForkPoolWorker-2] [ef1dd388-db0b-4da8-9978-d295a57665f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:50:01.034780326Z [2024-03-28 00:50:01,034: INFO/ForkPoolWorker-3] [58f8cc05-ea64-4cdf-8e28-6f220e1631c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:50:01.404932316Z [2024-03-28 00:50:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:50:01.616108417Z [2024-03-28 00:50:01,615: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:50:01.638287117Z [2024-03-28 00:50:01,637: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:01.689918192Z [2024-03-28 00:50:01,681: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:50:01.705779172Z [2024-03-28 00:50:01,705: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:50:01.712988833Z [2024-03-28 00:50:01,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:50:01.716567140Z [2024-03-28 00:50:01,716: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:50:01.721310977Z [2024-03-28 00:50:01,716: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:50:01.721775695Z [2024-03-28 00:50:01,721: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:50:01.722237514Z [2024-03-28 00:50:01,722: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:50:01.791672682Z [2024-03-28 00:50:01,785: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:50:01.857968902Z [2024-03-28 00:50:01,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:50:01.918786076Z [2024-03-28 00:50:01,918: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:02.286073634Z [2024-03-28 00:50:02,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:02.887577111Z [2024-03-28 00:50:02,886: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[981bf160-f64e-4747-9d5c-816f19db8e3f] succeeded in 1.9212335160000293s: None 2024-03-28T00:50:03.227077830Z [2024-03-28 00:50:03,226: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[764dbcc5-e4b8-4ccb-8c4d-397d4c4a86b6] succeeded in 2.273339061000115s: None 2024-03-28T00:50:03.730413020Z [2024-03-28 00:50:03,729: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T00:50:03.735925158Z [2024-03-28 00:50:03,733: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:03.762090434Z [2024-03-28 00:50:03,758: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T00:50:03.765614140Z [2024-03-28 00:50:03,762: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:03.765634310Z [2024-03-28 00:50:03,762: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:03.765639747Z [2024-03-28 00:50:03,763: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:03.765644121Z [2024-03-28 00:50:03,763: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T00:50:03.765647499Z [2024-03-28 00:50:03,763: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:50:03.765650918Z [2024-03-28 00:50:03,763: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:03.785985822Z [2024-03-28 00:50:03,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:50:03.789838924Z [2024-03-28 00:50:03,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:03.832575324Z [2024-03-28 00:50:03,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:50:03.833839037Z [2024-03-28 00:50:03,832: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:03.833968915Z [2024-03-28 00:50:03,832: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:03.833974312Z [2024-03-28 00:50:03,833: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:03.833980258Z [2024-03-28 00:50:03,833: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:50:03.833986124Z [2024-03-28 00:50:03,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:50:03.834117740Z [2024-03-28 00:50:03,833: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:03.860471865Z [2024-03-28 00:50:03,860: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:03.895542423Z [2024-03-28 00:50:03,895: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:50:03.901615409Z [2024-03-28 00:50:03,901: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:03.930511196Z [2024-03-28 00:50:03,930: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:50:03.932054272Z [2024-03-28 00:50:03,931: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:03.932082711Z [2024-03-28 00:50:03,931: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:03.932368447Z [2024-03-28 00:50:03,932: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:03.932541746Z [2024-03-28 00:50:03,932: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:50:03.932900193Z [2024-03-28 00:50:03,932: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:50:03.933005026Z [2024-03-28 00:50:03,932: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:03.944672006Z [2024-03-28 00:50:03,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:04.044707060Z [2024-03-28 00:50:04,044: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:04.700064951Z [2024-03-28 00:50:04,699: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d7c777b-1a8f-4b38-a29f-6aec1484e8ff] succeeded in 3.748152236000351s: None 2024-03-28T00:50:05.011333822Z [2024-03-28 00:50:05,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e34a3fb9-02a2-400c-a171-dc8e4e85944e] received 2024-03-28T00:50:05.028588994Z [2024-03-28 00:50:05,028: INFO/ForkPoolWorker-15] [e34a3fb9-02a2-400c-a171-dc8e4e85944e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:50:05.342696713Z [2024-03-28 00:50:05,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:50:05.403355903Z [2024-03-28 00:50:05,402: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[58f8cc05-ea64-4cdf-8e28-6f220e1631c7] succeeded in 4.402842079999573s: None 2024-03-28T00:50:06.452311641Z [2024-03-28 00:50:06,451: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef1dd388-db0b-4da8-9978-d295a57665f8] succeeded in 5.462564718000067s: None 2024-03-28T00:50:06.660631527Z [2024-03-28 00:50:06,660: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:50:06.664466261Z [2024-03-28 00:50:06,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:06.687326856Z [2024-03-28 00:50:06,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:50:06.689024395Z [2024-03-28 00:50:06,688: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:06.689214594Z [2024-03-28 00:50:06,689: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:06.689529737Z [2024-03-28 00:50:06,689: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:06.689764086Z [2024-03-28 00:50:06,689: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:50:06.690354354Z [2024-03-28 00:50:06,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:50:06.690573746Z [2024-03-28 00:50:06,690: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:06.790515160Z [2024-03-28 00:50:06,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:07.474914352Z [2024-03-28 00:50:07,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e34a3fb9-02a2-400c-a171-dc8e4e85944e] succeeded in 2.461637299999893s: None 2024-03-28T00:50:07.519414145Z [2024-03-28 00:50:07,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[635a9241-5c93-4f12-a72b-adcc92ed62bf] received 2024-03-28T00:50:07.527655449Z [2024-03-28 00:50:07,527: INFO/ForkPoolWorker-15] [635a9241-5c93-4f12-a72b-adcc92ed62bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:50:07.821029567Z [2024-03-28 00:50:07,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:50:09.193472979Z [2024-03-28 00:50:09,193: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:50:09.196965577Z [2024-03-28 00:50:09,196: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:09.254612349Z [2024-03-28 00:50:09,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:50:09.256068640Z [2024-03-28 00:50:09,255: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:09.256085214Z [2024-03-28 00:50:09,255: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:09.256176484Z [2024-03-28 00:50:09,256: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:09.256201544Z [2024-03-28 00:50:09,256: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:50:09.256443502Z [2024-03-28 00:50:09,256: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:50:09.256471777Z [2024-03-28 00:50:09,256: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:09.392178542Z [2024-03-28 00:50:09,391: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:10.097187912Z [2024-03-28 00:50:10,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[635a9241-5c93-4f12-a72b-adcc92ed62bf] succeeded in 2.5758091009993223s: None 2024-03-28T00:50:11.056176055Z [2024-03-28 00:50:11,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b266de5-b604-471f-a3fd-9fd0043f4232] received 2024-03-28T00:50:11.078827323Z [2024-03-28 00:50:11,078: INFO/ForkPoolWorker-15] [0b266de5-b604-471f-a3fd-9fd0043f4232] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:50:11.513980293Z [2024-03-28 00:50:11,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:50:12.684391750Z [2024-03-28 00:50:12,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:50:12.688009440Z [2024-03-28 00:50:12,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:50:12.705715846Z [2024-03-28 00:50:12,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:50:12.707219341Z [2024-03-28 00:50:12,707: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:50:12.707351255Z [2024-03-28 00:50:12,707: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:50:12.707549280Z [2024-03-28 00:50:12,707: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:50:12.707643959Z [2024-03-28 00:50:12,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:50:12.708053757Z [2024-03-28 00:50:12,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:50:12.708162923Z [2024-03-28 00:50:12,708: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:50:12.803399318Z [2024-03-28 00:50:12,802: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:50:13.400465562Z [2024-03-28 00:50:13,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b266de5-b604-471f-a3fd-9fd0043f4232] succeeded in 2.340931130000172s: None 2024-03-28T00:51:00.985563887Z [2024-03-28 00:51:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4df3cb4f-9ca7-408a-a89f-cecba98fbcb7] received 2024-03-28T00:51:00.992698471Z [2024-03-28 00:51:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7ce92e7-c73b-4194-a16e-27dbd330f308] received 2024-03-28T00:51:00.993705079Z [2024-03-28 00:51:00,993: INFO/ForkPoolWorker-15] [4df3cb4f-9ca7-408a-a89f-cecba98fbcb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:51:00.994680252Z [2024-03-28 00:51:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2fb36c2-e63a-4dcb-8de2-3b49fdc985a5] received 2024-03-28T00:51:01.004852482Z [2024-03-28 00:51:01,004: INFO/ForkPoolWorker-1] [c2fb36c2-e63a-4dcb-8de2-3b49fdc985a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:51:01.005739479Z [2024-03-28 00:51:01,005: INFO/ForkPoolWorker-16] [c7ce92e7-c73b-4194-a16e-27dbd330f308] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:51:01.361607522Z [2024-03-28 00:51:01,356: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:51:01.398762952Z [2024-03-28 00:51:01,394: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:51:01.616246985Z [2024-03-28 00:51:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:51:01.909119844Z [2024-03-28 00:51:01,908: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:51:01.916755714Z [2024-03-28 00:51:01,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:51:01.959679103Z [2024-03-28 00:51:01,959: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:51:01.962076360Z [2024-03-28 00:51:01,961: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:51:01.962334100Z [2024-03-28 00:51:01,961: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:51:01.962551190Z [2024-03-28 00:51:01,962: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:51:01.962939314Z [2024-03-28 00:51:01,962: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:51:02.122114550Z [2024-03-28 00:51:02,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:51:02.955916899Z [2024-03-28 00:51:02,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7ce92e7-c73b-4194-a16e-27dbd330f308] succeeded in 1.961502661999475s: None 2024-03-28T00:51:03.007800865Z [2024-03-28 00:51:03,007: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:51:03.011876600Z [2024-03-28 00:51:03,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:51:03.046237561Z [2024-03-28 00:51:03,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:51:03.048236322Z [2024-03-28 00:51:03,047: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:51:03.048263291Z [2024-03-28 00:51:03,048: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:51:03.048490905Z [2024-03-28 00:51:03,048: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:51:03.048548606Z [2024-03-28 00:51:03,048: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:51:03.048945065Z [2024-03-28 00:51:03,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:51:03.049064735Z [2024-03-28 00:51:03,048: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:51:03.060251546Z [2024-03-28 00:51:03,059: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:51:03.065027894Z [2024-03-28 00:51:03,064: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:51:03.115727976Z [2024-03-28 00:51:03,115: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:51:03.119242590Z [2024-03-28 00:51:03,118: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:51:03.119385822Z [2024-03-28 00:51:03,119: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:51:03.119689868Z [2024-03-28 00:51:03,119: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:51:03.119838383Z [2024-03-28 00:51:03,119: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:51:03.120198226Z [2024-03-28 00:51:03,120: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:51:03.120343401Z [2024-03-28 00:51:03,120: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:51:03.187813760Z [2024-03-28 00:51:03,187: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:51:03.229855354Z [2024-03-28 00:51:03,229: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:51:04.984054541Z [2024-03-28 00:51:04,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4df3cb4f-9ca7-408a-a89f-cecba98fbcb7] succeeded in 3.9963404099999025s: None 2024-03-28T00:51:05.346339241Z [2024-03-28 00:51:05,345: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2fb36c2-e63a-4dcb-8de2-3b49fdc985a5] succeeded in 4.350053090000074s: None 2024-03-28T00:52:00.871939310Z [2024-03-28 00:52:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a8cf282-3085-422f-90a9-c43801907c7f] received 2024-03-28T00:52:00.879123935Z [2024-03-28 00:52:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10e61fd5-1c40-4331-bd12-d0f128fe6374] received 2024-03-28T00:52:00.884767696Z [2024-03-28 00:52:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc2d6a90-0af8-4e35-a76c-f94e3c6a2389] received 2024-03-28T00:52:00.886913783Z [2024-03-28 00:52:00,886: INFO/ForkPoolWorker-15] [7a8cf282-3085-422f-90a9-c43801907c7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:52:00.888913727Z [2024-03-28 00:52:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac3a72de-9c81-4b70-b20f-0c254b213050] received 2024-03-28T00:52:00.891520437Z [2024-03-28 00:52:00,891: INFO/ForkPoolWorker-16] [10e61fd5-1c40-4331-bd12-d0f128fe6374] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:52:00.903218311Z [2024-03-28 00:52:00,897: INFO/ForkPoolWorker-1] [fc2d6a90-0af8-4e35-a76c-f94e3c6a2389] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:52:00.916687551Z [2024-03-28 00:52:00,916: INFO/ForkPoolWorker-2] [ac3a72de-9c81-4b70-b20f-0c254b213050] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:52:01.364336816Z [2024-03-28 00:52:01,360: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:52:01.389204318Z [2024-03-28 00:52:01,385: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:52:01.466253856Z [2024-03-28 00:52:01,462: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:52:01.550741300Z [2024-03-28 00:52:01,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:52:01.692040339Z [2024-03-28 00:52:01,691: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:52:01.899251163Z [2024-03-28 00:52:01,898: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:52:01.906565307Z [2024-03-28 00:52:01,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:52:01.937017896Z [2024-03-28 00:52:01,936: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:52:01.943094864Z [2024-03-28 00:52:01,942: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:52:01.943905318Z [2024-03-28 00:52:01,942: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:52:01.944099932Z [2024-03-28 00:52:01,943: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:52:01.944801497Z [2024-03-28 00:52:01,944: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:52:02.108169282Z [2024-03-28 00:52:02,107: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:52:02.499928449Z [2024-03-28 00:52:02,499: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc2d6a90-0af8-4e35-a76c-f94e3c6a2389] succeeded in 1.6126130069997089s: None 2024-03-28T00:52:02.859817420Z [2024-03-28 00:52:02,859: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10e61fd5-1c40-4331-bd12-d0f128fe6374] succeeded in 1.9779739320001681s: None 2024-03-28T00:52:02.959773601Z [2024-03-28 00:52:02,959: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:52:02.963757270Z [2024-03-28 00:52:02,963: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:52:02.988004300Z [2024-03-28 00:52:02,987: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:52:02.989379960Z [2024-03-28 00:52:02,989: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:52:02.989397033Z [2024-03-28 00:52:02,989: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:52:02.989707067Z [2024-03-28 00:52:02,989: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:52:02.989894240Z [2024-03-28 00:52:02,989: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:52:02.990455847Z [2024-03-28 00:52:02,990: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:52:02.990590708Z [2024-03-28 00:52:02,990: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:52:03.028459161Z [2024-03-28 00:52:03,028: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:52:03.032399260Z [2024-03-28 00:52:03,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:52:03.063068887Z [2024-03-28 00:52:03,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:52:03.065843065Z [2024-03-28 00:52:03,065: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:52:03.066614171Z [2024-03-28 00:52:03,065: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:52:03.067809175Z [2024-03-28 00:52:03,066: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:52:03.068719252Z [2024-03-28 00:52:03,067: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:52:03.069344723Z [2024-03-28 00:52:03,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:52:03.070265479Z [2024-03-28 00:52:03,069: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:52:03.086206413Z [2024-03-28 00:52:03,085: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:52:03.176349556Z [2024-03-28 00:52:03,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:52:05.221061734Z [2024-03-28 00:52:05,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac3a72de-9c81-4b70-b20f-0c254b213050] succeeded in 4.329258237999966s: None 2024-03-28T00:52:05.480488298Z [2024-03-28 00:52:05,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a8cf282-3085-422f-90a9-c43801907c7f] succeeded in 4.606257810999523s: None 2024-03-28T00:53:00.428722322Z [2024-03-28 00:53:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddda4161-bed0-4617-9c4c-766209e40177] received 2024-03-28T00:53:00.432370038Z [2024-03-28 00:53:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a8b77ca-a5c2-40a1-88d0-ec54f1883c94] received 2024-03-28T00:53:00.441575255Z [2024-03-28 00:53:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44966429-694a-455e-96f8-ed8574059798] received 2024-03-28T00:53:00.442439609Z [2024-03-28 00:53:00,442: INFO/ForkPoolWorker-16] [8a8b77ca-a5c2-40a1-88d0-ec54f1883c94] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:53:00.446385506Z [2024-03-28 00:53:00,446: INFO/ForkPoolWorker-15] [ddda4161-bed0-4617-9c4c-766209e40177] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:53:00.455943816Z [2024-03-28 00:53:00,455: INFO/ForkPoolWorker-1] [44966429-694a-455e-96f8-ed8574059798] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:53:00.800341579Z [2024-03-28 00:53:00,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:53:00.809455439Z [2024-03-28 00:53:00,806: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:53:00.882389621Z [2024-03-28 00:53:00,878: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:53:01.085277479Z [2024-03-28 00:53:01,084: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:53:01.095155130Z [2024-03-28 00:53:01,094: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:53:01.124459212Z [2024-03-28 00:53:01,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:53:01.126198192Z [2024-03-28 00:53:01,125: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:53:01.126401098Z [2024-03-28 00:53:01,126: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:53:01.126615804Z [2024-03-28 00:53:01,126: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:53:01.126916612Z [2024-03-28 00:53:01,126: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:53:01.256230036Z [2024-03-28 00:53:01,255: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:53:01.992971287Z [2024-03-28 00:53:01,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a8b77ca-a5c2-40a1-88d0-ec54f1883c94] succeeded in 1.5577562560001752s: None 2024-03-28T00:53:02.212285620Z [2024-03-28 00:53:02,211: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:53:02.216323463Z [2024-03-28 00:53:02,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:53:02.238298067Z [2024-03-28 00:53:02,238: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:53:02.239822700Z [2024-03-28 00:53:02,239: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:53:02.239953355Z [2024-03-28 00:53:02,239: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:53:02.240199722Z [2024-03-28 00:53:02,239: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:53:02.240478443Z [2024-03-28 00:53:02,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:53:02.241006599Z [2024-03-28 00:53:02,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:53:02.241121658Z [2024-03-28 00:53:02,240: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:53:02.285296203Z [2024-03-28 00:53:02,284: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:53:02.288965114Z [2024-03-28 00:53:02,288: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:53:02.313263605Z [2024-03-28 00:53:02,313: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:53:02.315207614Z [2024-03-28 00:53:02,314: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:53:02.315344778Z [2024-03-28 00:53:02,315: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:53:02.315568080Z [2024-03-28 00:53:02,315: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:53:02.315671333Z [2024-03-28 00:53:02,315: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:53:02.316153444Z [2024-03-28 00:53:02,315: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:53:02.316275104Z [2024-03-28 00:53:02,316: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:53:02.342224577Z [2024-03-28 00:53:02,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:53:02.457359598Z [2024-03-28 00:53:02,456: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:53:03.855781973Z [2024-03-28 00:53:03,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddda4161-bed0-4617-9c4c-766209e40177] succeeded in 3.4218210240005646s: None 2024-03-28T00:53:04.485169151Z [2024-03-28 00:53:04,484: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44966429-694a-455e-96f8-ed8574059798] succeeded in 4.0400475450005615s: None 2024-03-28T00:54:01.138495408Z [2024-03-28 00:54:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[accd0dc4-8f32-4aad-9b50-5b52a62b71c9] received 2024-03-28T00:54:01.140943502Z [2024-03-28 00:54:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee3f0531-6f9b-4b13-b65c-06f5ababf788] received 2024-03-28T00:54:01.144528067Z [2024-03-28 00:54:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa922674-00fc-4b15-ade7-08c01725ff76] received 2024-03-28T00:54:01.147844250Z [2024-03-28 00:54:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b707c9a2-d015-4859-a772-38767c15c1be] received 2024-03-28T00:54:01.151256894Z [2024-03-28 00:54:01,150: INFO/ForkPoolWorker-16] [ee3f0531-6f9b-4b13-b65c-06f5ababf788] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:54:01.151980392Z [2024-03-28 00:54:01,151: INFO/ForkPoolWorker-15] [accd0dc4-8f32-4aad-9b50-5b52a62b71c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:54:01.162382971Z [2024-03-28 00:54:01,162: INFO/ForkPoolWorker-1] [fa922674-00fc-4b15-ade7-08c01725ff76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:54:01.171705179Z [2024-03-28 00:54:01,171: INFO/ForkPoolWorker-2] [b707c9a2-d015-4859-a772-38767c15c1be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:54:01.522608736Z [2024-03-28 00:54:01,515: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:54:01.633823848Z [2024-03-28 00:54:01,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:54:01.650012756Z [2024-03-28 00:54:01,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:54:01.753287805Z [2024-03-28 00:54:01,749: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:54:01.831273506Z [2024-03-28 00:54:01,830: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:54:01.835881562Z [2024-03-28 00:54:01,835: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:54:01.880251811Z [2024-03-28 00:54:01,880: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:54:01.881513349Z [2024-03-28 00:54:01,881: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:54:01.881698180Z [2024-03-28 00:54:01,881: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:54:01.881790397Z [2024-03-28 00:54:01,881: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:54:01.882552684Z [2024-03-28 00:54:01,882: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:54:01.923374372Z [2024-03-28 00:54:01,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:54:01.998733540Z [2024-03-28 00:54:01,998: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:54:02.686789213Z [2024-03-28 00:54:02,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[accd0dc4-8f32-4aad-9b50-5b52a62b71c9] succeeded in 1.5441873529998702s: None 2024-03-28T00:54:02.754112631Z [2024-03-28 00:54:02,753: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b707c9a2-d015-4859-a772-38767c15c1be] succeeded in 1.6006899949998115s: None 2024-03-28T00:54:03.264821877Z [2024-03-28 00:54:03,264: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:54:03.272762391Z [2024-03-28 00:54:03,271: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:54:03.300032162Z [2024-03-28 00:54:03,299: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:54:03.301937439Z [2024-03-28 00:54:03,301: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:54:03.302118311Z [2024-03-28 00:54:03,301: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:54:03.302379081Z [2024-03-28 00:54:03,302: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:54:03.302619318Z [2024-03-28 00:54:03,302: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:54:03.303052518Z [2024-03-28 00:54:03,302: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:54:03.303227797Z [2024-03-28 00:54:03,303: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:54:03.436125319Z [2024-03-28 00:54:03,435: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:54:03.445912483Z [2024-03-28 00:54:03,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:54:03.449863631Z [2024-03-28 00:54:03,449: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:54:03.485149502Z [2024-03-28 00:54:03,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:54:03.486967662Z [2024-03-28 00:54:03,486: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:54:03.487059199Z [2024-03-28 00:54:03,486: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:54:03.487280557Z [2024-03-28 00:54:03,487: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:54:03.487342615Z [2024-03-28 00:54:03,487: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:54:03.487664582Z [2024-03-28 00:54:03,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:54:03.487723300Z [2024-03-28 00:54:03,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:54:03.607580775Z [2024-03-28 00:54:03,604: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:54:05.048484837Z [2024-03-28 00:54:05,047: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa922674-00fc-4b15-ade7-08c01725ff76] succeeded in 3.898573280999699s: None 2024-03-28T00:54:05.824686625Z [2024-03-28 00:54:05,824: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee3f0531-6f9b-4b13-b65c-06f5ababf788] succeeded in 4.681425943000249s: None 2024-03-28T00:55:00.924639948Z [2024-03-28 00:55:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c7db394-948a-4e1c-90f9-4654bdde23a6] received 2024-03-28T00:55:00.930135354Z [2024-03-28 00:55:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adf854a6-881d-4c11-8378-f91349ca1f5b] received 2024-03-28T00:55:00.938491554Z [2024-03-28 00:55:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21d63539-af41-4eec-bc7e-cfb1004cc861] received 2024-03-28T00:55:00.944816509Z [2024-03-28 00:55:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f3d253d-50c7-46d4-b091-81624357deb2] received 2024-03-28T00:55:00.945755873Z [2024-03-28 00:55:00,945: INFO/ForkPoolWorker-16] [adf854a6-881d-4c11-8378-f91349ca1f5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:55:00.954622104Z [2024-03-28 00:55:00,954: INFO/ForkPoolWorker-2] [8f3d253d-50c7-46d4-b091-81624357deb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:55:00.959561524Z [2024-03-28 00:55:00,959: INFO/ForkPoolWorker-1] [21d63539-af41-4eec-bc7e-cfb1004cc861] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:55:00.967138166Z [2024-03-28 00:55:00,966: INFO/ForkPoolWorker-15] [7c7db394-948a-4e1c-90f9-4654bdde23a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:55:01.297657182Z [2024-03-28 00:55:01,291: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:55:01.356187150Z [2024-03-28 00:55:01,352: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:55:01.490275953Z [2024-03-28 00:55:01,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:55:01.654676201Z [2024-03-28 00:55:01,654: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:55:01.667867851Z [2024-03-28 00:55:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:55:01.668209642Z [2024-03-28 00:55:01,661: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:01.739861959Z [2024-03-28 00:55:01,739: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:55:01.746286416Z [2024-03-28 00:55:01,745: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:55:01.746510952Z [2024-03-28 00:55:01,746: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:55:01.746694348Z [2024-03-28 00:55:01,746: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:55:01.747052920Z [2024-03-28 00:55:01,746: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:55:01.871109708Z [2024-03-28 00:55:01,870: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:02.924798893Z [2024-03-28 00:55:02,924: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:55:02.928651518Z [2024-03-28 00:55:02,928: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:02.943434398Z [2024-03-28 00:55:02,942: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8f3d253d-50c7-46d4-b091-81624357deb2] succeeded in 1.9958665029998883s: None 2024-03-28T00:55:02.962728935Z [2024-03-28 00:55:02,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:55:02.966729355Z [2024-03-28 00:55:02,966: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:02.966847451Z [2024-03-28 00:55:02,966: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:02.967063577Z [2024-03-28 00:55:02,966: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:02.967175811Z [2024-03-28 00:55:02,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:55:02.967476355Z [2024-03-28 00:55:02,967: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:55:02.967557391Z [2024-03-28 00:55:02,967: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:03.146198759Z [2024-03-28 00:55:03,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:03.353714992Z [2024-03-28 00:55:03,350: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:55:03.358167278Z [2024-03-28 00:55:03,357: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:03.465589451Z [2024-03-28 00:55:03,465: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:55:03.469560224Z [2024-03-28 00:55:03,469: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:03.469583752Z [2024-03-28 00:55:03,469: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:03.473553833Z [2024-03-28 00:55:03,469: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:03.473592785Z [2024-03-28 00:55:03,470: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:55:03.473597118Z [2024-03-28 00:55:03,470: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:55:03.473603946Z [2024-03-28 00:55:03,470: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:03.663518381Z [2024-03-28 00:55:03,663: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:03.756589173Z [2024-03-28 00:55:03,756: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:55:03.760518280Z [2024-03-28 00:55:03,760: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:03.788994398Z [2024-03-28 00:55:03,788: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:55:03.792013719Z [2024-03-28 00:55:03,791: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:03.792202899Z [2024-03-28 00:55:03,792: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:03.792434351Z [2024-03-28 00:55:03,792: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:03.792577383Z [2024-03-28 00:55:03,792: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:55:03.792946858Z [2024-03-28 00:55:03,792: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:55:03.793063136Z [2024-03-28 00:55:03,792: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:03.928416673Z [2024-03-28 00:55:03,928: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:04.362067840Z [2024-03-28 00:55:04,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c7db394-948a-4e1c-90f9-4654bdde23a6] succeeded in 3.428758347999974s: None 2024-03-28T00:55:04.777418755Z [2024-03-28 00:55:04,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6615524f-3586-4619-ade7-294dbd0c1783] received 2024-03-28T00:55:04.791211740Z [2024-03-28 00:55:04,790: INFO/ForkPoolWorker-15] [6615524f-3586-4619-ade7-294dbd0c1783] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:55:05.025580748Z [2024-03-28 00:55:05,024: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21d63539-af41-4eec-bc7e-cfb1004cc861] succeeded in 4.08193574500001s: None 2024-03-28T00:55:05.164469492Z [2024-03-28 00:55:05,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:55:06.094097543Z [2024-03-28 00:55:06,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[adf854a6-881d-4c11-8378-f91349ca1f5b] succeeded in 5.158696469999995s: None 2024-03-28T00:55:06.358022942Z [2024-03-28 00:55:06,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:55:06.361559118Z [2024-03-28 00:55:06,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:06.377866096Z [2024-03-28 00:55:06,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:55:06.379107248Z [2024-03-28 00:55:06,378: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:06.379255139Z [2024-03-28 00:55:06,379: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:06.379460760Z [2024-03-28 00:55:06,379: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:06.379585072Z [2024-03-28 00:55:06,379: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:55:06.379866316Z [2024-03-28 00:55:06,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:55:06.380006674Z [2024-03-28 00:55:06,379: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:06.452027736Z [2024-03-28 00:55:06,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:07.043810418Z [2024-03-28 00:55:07,043: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6615524f-3586-4619-ade7-294dbd0c1783] succeeded in 2.2631648449996646s: None 2024-03-28T00:55:07.636502471Z [2024-03-28 00:55:07,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbf3660-073b-4202-94b7-533bf627c330] received 2024-03-28T00:55:07.647495443Z [2024-03-28 00:55:07,647: INFO/ForkPoolWorker-15] [2bbf3660-073b-4202-94b7-533bf627c330] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T00:55:08.021151182Z [2024-03-28 00:55:08,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:55:09.379978733Z [2024-03-28 00:55:09,379: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:55:09.383495651Z [2024-03-28 00:55:09,383: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:09.431421138Z [2024-03-28 00:55:09,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:55:09.432658395Z [2024-03-28 00:55:09,432: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:09.432676438Z [2024-03-28 00:55:09,432: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:09.432785019Z [2024-03-28 00:55:09,432: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:09.432810238Z [2024-03-28 00:55:09,432: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:55:09.433049275Z [2024-03-28 00:55:09,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:55:09.433109271Z [2024-03-28 00:55:09,433: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:09.512587214Z [2024-03-28 00:55:09,512: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:10.232053876Z [2024-03-28 00:55:10,231: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bbf3660-073b-4202-94b7-533bf627c330] succeeded in 2.593624962000831s: None 2024-03-28T00:55:10.918688410Z [2024-03-28 00:55:10,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[887fb4ac-a7f0-4e43-9d1b-4126d2bab579] received 2024-03-28T00:55:10.948118271Z [2024-03-28 00:55:10,947: INFO/ForkPoolWorker-15] [887fb4ac-a7f0-4e43-9d1b-4126d2bab579] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T00:55:11.382608309Z [2024-03-28 00:55:11,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T00:55:12.519643549Z [2024-03-28 00:55:12,519: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:55:12.523300492Z [2024-03-28 00:55:12,522: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:55:12.540884506Z [2024-03-28 00:55:12,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:55:12.542999535Z [2024-03-28 00:55:12,542: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:55:12.543024255Z [2024-03-28 00:55:12,542: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:55:12.543341854Z [2024-03-28 00:55:12,542: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:55:12.543498117Z [2024-03-28 00:55:12,543: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:55:12.544036473Z [2024-03-28 00:55:12,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T00:55:12.544318143Z [2024-03-28 00:55:12,543: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:55:12.644383161Z [2024-03-28 00:55:12,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:55:13.180331769Z [2024-03-28 00:55:13,179: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[887fb4ac-a7f0-4e43-9d1b-4126d2bab579] succeeded in 2.258489634000398s: None 2024-03-28T00:56:00.641756734Z [2024-03-28 00:56:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[535dcda6-57aa-4480-9194-25f48ab58906] received 2024-03-28T00:56:00.648333183Z [2024-03-28 00:56:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3173cd3b-1280-412b-badf-937ceaa707a8] received 2024-03-28T00:56:00.651584562Z [2024-03-28 00:56:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[928daf4f-0c08-4b98-9ecb-1d571ddaf282] received 2024-03-28T00:56:00.655746399Z [2024-03-28 00:56:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[876e5822-94d2-459a-b90a-b61d38ede99c] received 2024-03-28T00:56:00.663009477Z [2024-03-28 00:56:00,662: INFO/ForkPoolWorker-15] [535dcda6-57aa-4480-9194-25f48ab58906] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:56:00.673044252Z [2024-03-28 00:56:00,672: INFO/ForkPoolWorker-2] [876e5822-94d2-459a-b90a-b61d38ede99c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:56:00.674885120Z [2024-03-28 00:56:00,672: INFO/ForkPoolWorker-1] [928daf4f-0c08-4b98-9ecb-1d571ddaf282] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:56:00.675848961Z [2024-03-28 00:56:00,675: INFO/ForkPoolWorker-16] [3173cd3b-1280-412b-badf-937ceaa707a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:56:00.999746006Z [2024-03-28 00:56:00,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:56:01.002357070Z [2024-03-28 00:56:00,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:56:01.021444484Z [2024-03-28 00:56:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:56:01.047019611Z [2024-03-28 00:56:01,043: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:56:01.242610229Z [2024-03-28 00:56:01,242: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:56:01.247097627Z [2024-03-28 00:56:01,246: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:56:01.280680832Z [2024-03-28 00:56:01,280: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:56:01.282125097Z [2024-03-28 00:56:01,281: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:56:01.282200174Z [2024-03-28 00:56:01,282: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:56:01.282237910Z [2024-03-28 00:56:01,282: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:56:01.282446684Z [2024-03-28 00:56:01,282: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:56:01.409738901Z [2024-03-28 00:56:01,409: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:56:01.462037875Z [2024-03-28 00:56:01,461: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:56:02.182286430Z [2024-03-28 00:56:02,181: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3173cd3b-1280-412b-badf-937ceaa707a8] succeeded in 1.5265465920001589s: None 2024-03-28T00:56:02.455005154Z [2024-03-28 00:56:02,454: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[928daf4f-0c08-4b98-9ecb-1d571ddaf282] succeeded in 1.8019458779999695s: None 2024-03-28T00:56:02.578171026Z [2024-03-28 00:56:02,577: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:56:02.586628289Z [2024-03-28 00:56:02,585: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:56:02.617363850Z [2024-03-28 00:56:02,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:56:02.619800250Z [2024-03-28 00:56:02,619: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:56:02.620091765Z [2024-03-28 00:56:02,619: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:56:02.620441076Z [2024-03-28 00:56:02,620: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:56:02.620716685Z [2024-03-28 00:56:02,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:56:02.621334690Z [2024-03-28 00:56:02,621: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:56:02.621622859Z [2024-03-28 00:56:02,621: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:56:02.661228334Z [2024-03-28 00:56:02,660: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T00:56:02.664806030Z [2024-03-28 00:56:02,664: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:56:02.688986313Z [2024-03-28 00:56:02,688: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:56:02.691693520Z [2024-03-28 00:56:02,691: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:56:02.691784192Z [2024-03-28 00:56:02,691: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:56:02.691949668Z [2024-03-28 00:56:02,691: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:56:02.692034375Z [2024-03-28 00:56:02,691: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T00:56:02.692438214Z [2024-03-28 00:56:02,692: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:56:02.692538077Z [2024-03-28 00:56:02,692: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:56:02.748073490Z [2024-03-28 00:56:02,747: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:56:02.829737100Z [2024-03-28 00:56:02,829: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:56:04.403255435Z [2024-03-28 00:56:04,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[535dcda6-57aa-4480-9194-25f48ab58906] succeeded in 3.7564468869995835s: None 2024-03-28T00:56:04.701628604Z [2024-03-28 00:56:04,701: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[876e5822-94d2-459a-b90a-b61d38ede99c] succeeded in 4.043855762999556s: None 2024-03-28T00:57:00.309529262Z [2024-03-28 00:57:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed3d380-241f-409d-b550-b69a539f7fb7] received 2024-03-28T00:57:00.326983425Z [2024-03-28 00:57:00,326: INFO/ForkPoolWorker-15] [8ed3d380-241f-409d-b550-b69a539f7fb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:57:00.334131576Z [2024-03-28 00:57:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ba5432c-f433-46ff-89d6-d1e7e26c8ace] received 2024-03-28T00:57:00.342493766Z [2024-03-28 00:57:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7fe0285-f99e-445b-b620-9f25645c5746] received 2024-03-28T00:57:00.342526926Z [2024-03-28 00:57:00,342: INFO/ForkPoolWorker-16] [1ba5432c-f433-46ff-89d6-d1e7e26c8ace] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:57:00.352010017Z [2024-03-28 00:57:00,351: INFO/ForkPoolWorker-1] [f7fe0285-f99e-445b-b620-9f25645c5746] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:57:00.656052491Z [2024-03-28 00:57:00,652: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:57:00.684083220Z [2024-03-28 00:57:00,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:57:00.701850449Z [2024-03-28 00:57:00,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:57:00.836676255Z [2024-03-28 00:57:00,836: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T00:57:00.840563315Z [2024-03-28 00:57:00,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:57:00.863499927Z [2024-03-28 00:57:00,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:57:00.864595224Z [2024-03-28 00:57:00,864: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:57:00.864773636Z [2024-03-28 00:57:00,864: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:57:00.864830637Z [2024-03-28 00:57:00,864: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T00:57:00.865045889Z [2024-03-28 00:57:00,864: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:57:00.947854227Z [2024-03-28 00:57:00,947: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:57:01.647801364Z [2024-03-28 00:57:01,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ba5432c-f433-46ff-89d6-d1e7e26c8ace] succeeded in 1.3119592040002317s: None 2024-03-28T00:57:01.917853446Z [2024-03-28 00:57:01,917: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:57:01.921542643Z [2024-03-28 00:57:01,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:57:01.946449925Z [2024-03-28 00:57:01,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:57:01.948335222Z [2024-03-28 00:57:01,948: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:57:01.948373754Z [2024-03-28 00:57:01,948: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:57:01.948584860Z [2024-03-28 00:57:01,948: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:57:01.948673519Z [2024-03-28 00:57:01,948: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:57:01.949062963Z [2024-03-28 00:57:01,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:57:01.949181690Z [2024-03-28 00:57:01,949: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:57:02.054516886Z [2024-03-28 00:57:02,054: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:57:02.123997327Z [2024-03-28 00:57:02,123: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:57:02.127832072Z [2024-03-28 00:57:02,127: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:57:02.150896856Z [2024-03-28 00:57:02,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:57:02.152914577Z [2024-03-28 00:57:02,152: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:57:02.153604276Z [2024-03-28 00:57:02,152: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:57:02.153627968Z [2024-03-28 00:57:02,153: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:57:02.153634937Z [2024-03-28 00:57:02,153: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:57:02.153949709Z [2024-03-28 00:57:02,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:57:02.154175174Z [2024-03-28 00:57:02,153: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:57:02.272641248Z [2024-03-28 00:57:02,272: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:57:03.775467725Z [2024-03-28 00:57:03,774: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7fe0285-f99e-445b-b620-9f25645c5746] succeeded in 3.4312363929993808s: None 2024-03-28T00:57:04.216622720Z [2024-03-28 00:57:04,216: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ed3d380-241f-409d-b550-b69a539f7fb7] succeeded in 3.90514271200027s: None 2024-03-28T00:58:00.313130403Z [2024-03-28 00:58:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bb55c1f-e237-46f7-8c69-8bab293aecf7] received 2024-03-28T00:58:00.315245488Z [2024-03-28 00:58:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0539e295-b3bc-4531-9df0-afcf40faec6f] received 2024-03-28T00:58:00.322347947Z [2024-03-28 00:58:00,322: INFO/ForkPoolWorker-16] [0539e295-b3bc-4531-9df0-afcf40faec6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:58:00.324583236Z [2024-03-28 00:58:00,324: INFO/ForkPoolWorker-15] [5bb55c1f-e237-46f7-8c69-8bab293aecf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T00:58:00.326948707Z [2024-03-28 00:58:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d83ea6d8-6b7f-4d70-93ae-20029cae55f5] received 2024-03-28T00:58:00.334861654Z [2024-03-28 00:58:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d94b55fe-d951-4fdf-82ee-12f44b5a36e2] received 2024-03-28T00:58:00.346322442Z [2024-03-28 00:58:00,345: INFO/ForkPoolWorker-1] [d83ea6d8-6b7f-4d70-93ae-20029cae55f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:58:00.372101136Z [2024-03-28 00:58:00,371: INFO/ForkPoolWorker-2] [d94b55fe-d951-4fdf-82ee-12f44b5a36e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:58:00.665304600Z [2024-03-28 00:58:00,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:58:00.690550205Z [2024-03-28 00:58:00,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T00:58:00.813444049Z [2024-03-28 00:58:00,810: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:58:00.832161159Z [2024-03-28 00:58:00,827: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:58:01.015053273Z [2024-03-28 00:58:01,014: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T00:58:01.019085239Z [2024-03-28 00:58:01,018: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:58:01.046329154Z [2024-03-28 00:58:01,046: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T00:58:01.047424090Z [2024-03-28 00:58:01,047: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:58:01.047620920Z [2024-03-28 00:58:01,047: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:58:01.047698535Z [2024-03-28 00:58:01,047: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T00:58:01.048028292Z [2024-03-28 00:58:01,047: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:58:01.144794310Z [2024-03-28 00:58:01,144: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:58:01.165910471Z [2024-03-28 00:58:01,165: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:58:01.758754075Z [2024-03-28 00:58:01,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bb55c1f-e237-46f7-8c69-8bab293aecf7] succeeded in 1.442323029000363s: None 2024-03-28T00:58:01.995715401Z [2024-03-28 00:58:01,995: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d94b55fe-d951-4fdf-82ee-12f44b5a36e2] succeeded in 1.6592118049993587s: None 2024-03-28T00:58:02.104335763Z [2024-03-28 00:58:02,103: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T00:58:02.108472665Z [2024-03-28 00:58:02,107: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:58:02.141013171Z [2024-03-28 00:58:02,140: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:58:02.143666608Z [2024-03-28 00:58:02,143: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:58:02.143756608Z [2024-03-28 00:58:02,143: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:58:02.144273707Z [2024-03-28 00:58:02,143: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:58:02.144290145Z [2024-03-28 00:58:02,143: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T00:58:02.145080101Z [2024-03-28 00:58:02,144: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:58:02.145436153Z [2024-03-28 00:58:02,144: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:58:02.183688691Z [2024-03-28 00:58:02,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:58:02.190016083Z [2024-03-28 00:58:02,189: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:58:02.215667856Z [2024-03-28 00:58:02,215: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:58:02.217463446Z [2024-03-28 00:58:02,217: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:58:02.217549442Z [2024-03-28 00:58:02,217: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:58:02.217728873Z [2024-03-28 00:58:02,217: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:58:02.217793552Z [2024-03-28 00:58:02,217: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:58:02.218207904Z [2024-03-28 00:58:02,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:58:02.218343056Z [2024-03-28 00:58:02,218: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:58:02.280915640Z [2024-03-28 00:58:02,280: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:58:02.323866629Z [2024-03-28 00:58:02,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:58:03.881167484Z [2024-03-28 00:58:03,880: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d83ea6d8-6b7f-4d70-93ae-20029cae55f5] succeeded in 3.5502159719999327s: None 2024-03-28T00:58:04.216813026Z [2024-03-28 00:58:04,216: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0539e295-b3bc-4531-9df0-afcf40faec6f] succeeded in 3.898382815000332s: None 2024-03-28T00:59:00.505367764Z [2024-03-28 00:59:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[441b08f9-62fc-47fa-bac7-85eb978ac0ec] received 2024-03-28T00:59:00.517836177Z [2024-03-28 00:59:00,517: INFO/ForkPoolWorker-15] [441b08f9-62fc-47fa-bac7-85eb978ac0ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T00:59:00.543992891Z [2024-03-28 00:59:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[160a7394-1bb5-48b8-9060-17e2f81b1909] received 2024-03-28T00:59:00.552534806Z [2024-03-28 00:59:00,552: INFO/ForkPoolWorker-16] [160a7394-1bb5-48b8-9060-17e2f81b1909] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T00:59:00.555638781Z [2024-03-28 00:59:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791eab81-7ced-4633-a8af-7266caebf0d7] received 2024-03-28T00:59:00.566609586Z [2024-03-28 00:59:00,566: INFO/ForkPoolWorker-1] [791eab81-7ced-4633-a8af-7266caebf0d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T00:59:00.983011747Z [2024-03-28 00:59:00,979: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T00:59:01.113462280Z [2024-03-28 00:59:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T00:59:01.212205130Z [2024-03-28 00:59:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T00:59:01.396210494Z [2024-03-28 00:59:01,395: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T00:59:01.401125343Z [2024-03-28 00:59:01,400: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:59:01.424630900Z [2024-03-28 00:59:01,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T00:59:01.426310973Z [2024-03-28 00:59:01,426: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T00:59:01.426445816Z [2024-03-28 00:59:01,426: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T00:59:01.426769333Z [2024-03-28 00:59:01,426: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T00:59:01.426918214Z [2024-03-28 00:59:01,426: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T00:59:01.533178430Z [2024-03-28 00:59:01,532: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:59:02.387945534Z [2024-03-28 00:59:02,387: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[791eab81-7ced-4633-a8af-7266caebf0d7] succeeded in 1.8294669690003502s: None 2024-03-28T00:59:02.641661725Z [2024-03-28 00:59:02,641: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T00:59:02.646353986Z [2024-03-28 00:59:02,645: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:59:02.668827551Z [2024-03-28 00:59:02,668: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T00:59:02.671631834Z [2024-03-28 00:59:02,671: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:59:02.672055723Z [2024-03-28 00:59:02,671: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:59:02.672481351Z [2024-03-28 00:59:02,672: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:59:02.672990742Z [2024-03-28 00:59:02,672: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T00:59:02.673667857Z [2024-03-28 00:59:02,673: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T00:59:02.673908738Z [2024-03-28 00:59:02,673: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:59:02.775876448Z [2024-03-28 00:59:02,775: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:59:03.024818626Z [2024-03-28 00:59:03,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T00:59:03.031742939Z [2024-03-28 00:59:03,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T00:59:03.057811591Z [2024-03-28 00:59:03,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T00:59:03.059847617Z [2024-03-28 00:59:03,059: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T00:59:03.059957474Z [2024-03-28 00:59:03,059: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T00:59:03.060112660Z [2024-03-28 00:59:03,059: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T00:59:03.060189928Z [2024-03-28 00:59:03,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T00:59:03.060641115Z [2024-03-28 00:59:03,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T00:59:03.060656450Z [2024-03-28 00:59:03,060: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T00:59:03.223970633Z [2024-03-28 00:59:03,223: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T00:59:04.748076536Z [2024-03-28 00:59:04,747: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[160a7394-1bb5-48b8-9060-17e2f81b1909] succeeded in 4.202582837000591s: None 2024-03-28T00:59:06.386292400Z [2024-03-28 00:59:06,385: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[441b08f9-62fc-47fa-bac7-85eb978ac0ec] succeeded in 5.8775372710006195s: None 2024-03-28T01:00:01.201887772Z [2024-03-28 01:00:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34803244-22da-4378-8ab5-f18e48fa1eed] received 2024-03-28T01:00:01.203728510Z [2024-03-28 01:00:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dc49766-f65b-4106-8941-a3079bec3b98] received 2024-03-28T01:00:01.206585197Z [2024-03-28 01:00:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cc67437-baef-4cdf-9f75-92eb2236474b] received 2024-03-28T01:00:01.210297999Z [2024-03-28 01:00:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec95bd40-b29b-4e0b-9fa9-82f190734410] received 2024-03-28T01:00:01.214973737Z [2024-03-28 01:00:01,214: INFO/ForkPoolWorker-15] [34803244-22da-4378-8ab5-f18e48fa1eed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:00:01.217770315Z [2024-03-28 01:00:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ec63e8-ff53-412e-81e9-6259897d554d] received 2024-03-28T01:00:01.220588973Z [2024-03-28 01:00:01,220: INFO/ForkPoolWorker-1] [8cc67437-baef-4cdf-9f75-92eb2236474b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:00:01.232463714Z [2024-03-28 01:00:01,232: INFO/ForkPoolWorker-2] [ec95bd40-b29b-4e0b-9fa9-82f190734410] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:00:01.241905977Z [2024-03-28 01:00:01,236: INFO/ForkPoolWorker-16] [4dc49766-f65b-4106-8941-a3079bec3b98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:00:01.253507438Z [2024-03-28 01:00:01,252: INFO/ForkPoolWorker-3] [c5ec63e8-ff53-412e-81e9-6259897d554d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:00:01.579890104Z [2024-03-28 01:00:01,576: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:00:01.728035859Z [2024-03-28 01:00:01,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:00:01.840617829Z [2024-03-28 01:00:01,833: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:00:01.933363546Z [2024-03-28 01:00:01,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:00:02.027327260Z [2024-03-28 01:00:02,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:00:02.428700103Z [2024-03-28 01:00:02,428: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:02.697338393Z [2024-03-28 01:00:02,696: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:00:02.704126925Z [2024-03-28 01:00:02,703: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:02.796289865Z [2024-03-28 01:00:02,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:00:02.806450817Z [2024-03-28 01:00:02,806: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:00:02.812784305Z [2024-03-28 01:00:02,806: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:00:02.813091769Z [2024-03-28 01:00:02,812: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:00:02.814426845Z [2024-03-28 01:00:02,814: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:00:03.087146211Z [2024-03-28 01:00:03,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:03.449585277Z [2024-03-28 01:00:03,446: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c5ec63e8-ff53-412e-81e9-6259897d554d] succeeded in 2.223503709000397s: None 2024-03-28T01:00:04.210868099Z [2024-03-28 01:00:04,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34803244-22da-4378-8ab5-f18e48fa1eed] succeeded in 3.0055305420000877s: None 2024-03-28T01:00:04.282595911Z [2024-03-28 01:00:04,282: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:00:04.286399451Z [2024-03-28 01:00:04,285: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:04.344405935Z [2024-03-28 01:00:04,344: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:00:04.352486488Z [2024-03-28 01:00:04,351: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:04.359287994Z [2024-03-28 01:00:04,359: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:00:04.368199399Z [2024-03-28 01:00:04,367: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:04.369359698Z [2024-03-28 01:00:04,369: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:04.369563214Z [2024-03-28 01:00:04,369: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:04.369686676Z [2024-03-28 01:00:04,369: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:00:04.370069771Z [2024-03-28 01:00:04,369: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:00:04.370117743Z [2024-03-28 01:00:04,369: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:04.382051904Z [2024-03-28 01:00:04,381: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:00:04.383685884Z [2024-03-28 01:00:04,383: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:04.383853314Z [2024-03-28 01:00:04,383: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:04.384122215Z [2024-03-28 01:00:04,383: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:04.384139741Z [2024-03-28 01:00:04,384: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:00:04.384589672Z [2024-03-28 01:00:04,384: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:00:04.384707592Z [2024-03-28 01:00:04,384: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:04.465754990Z [2024-03-28 01:00:04,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:00:04.472974754Z [2024-03-28 01:00:04,472: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:04.486499726Z [2024-03-28 01:00:04,486: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:04.496469197Z [2024-03-28 01:00:04,496: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:04.497809241Z [2024-03-28 01:00:04,497: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:00:04.499789214Z [2024-03-28 01:00:04,499: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:04.500027298Z [2024-03-28 01:00:04,499: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:04.500289856Z [2024-03-28 01:00:04,499: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:04.500449335Z [2024-03-28 01:00:04,500: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:00:04.500892606Z [2024-03-28 01:00:04,500: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:00:04.501186697Z [2024-03-28 01:00:04,500: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:04.645605095Z [2024-03-28 01:00:04,645: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:05.213616061Z [2024-03-28 01:00:05,212: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ec95bd40-b29b-4e0b-9fa9-82f190734410] succeeded in 3.9972343859999455s: None 2024-03-28T01:00:05.551120018Z [2024-03-28 01:00:05,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b03edbb-5dcb-4007-8991-2debe5a07048] received 2024-03-28T01:00:05.558663402Z [2024-03-28 01:00:05,558: INFO/ForkPoolWorker-15] [7b03edbb-5dcb-4007-8991-2debe5a07048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:00:05.874962220Z [2024-03-28 01:00:05,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:00:06.303946415Z [2024-03-28 01:00:06,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cc67437-baef-4cdf-9f75-92eb2236474b] succeeded in 5.094087620000209s: None 2024-03-28T01:00:06.636812350Z [2024-03-28 01:00:06,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4dc49766-f65b-4106-8941-a3079bec3b98] succeeded in 5.43120945299961s: None 2024-03-28T01:00:07.189207935Z [2024-03-28 01:00:07,188: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:00:07.192856063Z [2024-03-28 01:00:07,192: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:07.212240181Z [2024-03-28 01:00:07,212: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:00:07.213808295Z [2024-03-28 01:00:07,213: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:07.213964398Z [2024-03-28 01:00:07,213: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:07.214327855Z [2024-03-28 01:00:07,213: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:07.214435454Z [2024-03-28 01:00:07,214: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:00:07.214780260Z [2024-03-28 01:00:07,214: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:00:07.215292059Z [2024-03-28 01:00:07,215: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:07.307327524Z [2024-03-28 01:00:07,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:07.960364189Z [2024-03-28 01:00:07,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b03edbb-5dcb-4007-8991-2debe5a07048] succeeded in 2.4071231640000406s: None 2024-03-28T01:00:08.995615894Z [2024-03-28 01:00:08,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bc4fe68-40fa-4f52-a351-006a4fd57a87] received 2024-03-28T01:00:09.010293421Z [2024-03-28 01:00:09,009: INFO/ForkPoolWorker-15] [7bc4fe68-40fa-4f52-a351-006a4fd57a87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:00:09.400490795Z [2024-03-28 01:00:09,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:00:10.985092075Z [2024-03-28 01:00:10,984: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:00:10.991921745Z [2024-03-28 01:00:10,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:11.054915712Z [2024-03-28 01:00:11,054: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:00:11.056941168Z [2024-03-28 01:00:11,056: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:11.056980786Z [2024-03-28 01:00:11,056: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:11.057200864Z [2024-03-28 01:00:11,056: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:11.057299934Z [2024-03-28 01:00:11,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:00:11.057752997Z [2024-03-28 01:00:11,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:00:11.057831277Z [2024-03-28 01:00:11,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:11.255502382Z [2024-03-28 01:00:11,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:11.928720477Z [2024-03-28 01:00:11,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f345abb3-b77d-41ae-9e1c-4bb7cd1a17fb] received 2024-03-28T01:00:11.937028128Z [2024-03-28 01:00:11,936: INFO/ForkPoolWorker-16] [f345abb3-b77d-41ae-9e1c-4bb7cd1a17fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:00:11.999903057Z [2024-03-28 01:00:11,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bc4fe68-40fa-4f52-a351-006a4fd57a87] succeeded in 3.0020040839999638s: None 2024-03-28T01:00:12.309336434Z [2024-03-28 01:00:12,305: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:00:13.599017425Z [2024-03-28 01:00:13,598: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:00:13.602864776Z [2024-03-28 01:00:13,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:00:13.627998759Z [2024-03-28 01:00:13,627: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:00:13.633573953Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:00:13.633604560Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:00:13.633616258Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:00:13.633622741Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:00:13.633627460Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:00:13.633632910Z [2024-03-28 01:00:13,629: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:00:13.747407558Z [2024-03-28 01:00:13,747: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:00:14.487608177Z [2024-03-28 01:00:14,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f345abb3-b77d-41ae-9e1c-4bb7cd1a17fb] succeeded in 2.5573531979998734s: None 2024-03-28T01:01:00.841326028Z [2024-03-28 01:01:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5214c50-88ed-4036-a689-f594a3ce457c] received 2024-03-28T01:01:00.845027613Z [2024-03-28 01:01:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4b17bc6-6ac2-4b04-9127-83e2e449f2c7] received 2024-03-28T01:01:00.852249679Z [2024-03-28 01:01:00,851: INFO/ForkPoolWorker-15] [c5214c50-88ed-4036-a689-f594a3ce457c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:01:00.852866198Z [2024-03-28 01:01:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78763a4-b4ba-4aec-912d-044b3c35f90b] received 2024-03-28T01:01:00.854684897Z [2024-03-28 01:01:00,854: INFO/ForkPoolWorker-16] [b4b17bc6-6ac2-4b04-9127-83e2e449f2c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:01:00.867514366Z [2024-03-28 01:01:00,867: INFO/ForkPoolWorker-1] [c78763a4-b4ba-4aec-912d-044b3c35f90b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:01:01.221460079Z [2024-03-28 01:01:01,218: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:01:01.235658011Z [2024-03-28 01:01:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:01:01.259337367Z [2024-03-28 01:01:01,255: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:01:01.394338714Z [2024-03-28 01:01:01,393: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:01:01.398519616Z [2024-03-28 01:01:01,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:01:01.418186340Z [2024-03-28 01:01:01,417: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:01:01.419388306Z [2024-03-28 01:01:01,419: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:01:01.419555472Z [2024-03-28 01:01:01,419: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:01:01.419698968Z [2024-03-28 01:01:01,419: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:01:01.419960233Z [2024-03-28 01:01:01,419: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:01:01.557471826Z [2024-03-28 01:01:01,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:01:02.401932534Z [2024-03-28 01:01:02,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5214c50-88ed-4036-a689-f594a3ce457c] succeeded in 1.5584361780001927s: None 2024-03-28T01:01:02.552581094Z [2024-03-28 01:01:02,552: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:01:02.556755438Z [2024-03-28 01:01:02,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:01:02.588400528Z [2024-03-28 01:01:02,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:01:02.590315362Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:01:02.590340824Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:01:02.590541477Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:01:02.590694057Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:01:02.591036108Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:01:02.591102219Z [2024-03-28 01:01:02,590: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:01:02.628909324Z [2024-03-28 01:01:02,628: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:01:02.632703982Z [2024-03-28 01:01:02,632: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:01:02.663832272Z [2024-03-28 01:01:02,663: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:01:02.665430484Z [2024-03-28 01:01:02,665: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:01:02.665462089Z [2024-03-28 01:01:02,665: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:01:02.665760974Z [2024-03-28 01:01:02,665: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:01:02.665813242Z [2024-03-28 01:01:02,665: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:01:02.666188618Z [2024-03-28 01:01:02,666: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:01:02.666240753Z [2024-03-28 01:01:02,666: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:01:02.680325583Z [2024-03-28 01:01:02,680: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:01:02.764261043Z [2024-03-28 01:01:02,763: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:01:04.701097094Z [2024-03-28 01:01:04,700: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b4b17bc6-6ac2-4b04-9127-83e2e449f2c7] succeeded in 3.8539650160000747s: None 2024-03-28T01:01:05.059162699Z [2024-03-28 01:01:05,058: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c78763a4-b4ba-4aec-912d-044b3c35f90b] succeeded in 4.204142526999931s: None 2024-03-28T01:02:00.760300323Z [2024-03-28 01:02:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[398036bd-85f8-4f73-931c-1f1286cc1ded] received 2024-03-28T01:02:00.766050130Z [2024-03-28 01:02:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8607f62a-5fd7-429b-9ae1-3a19df230843] received 2024-03-28T01:02:00.766803012Z [2024-03-28 01:02:00,766: INFO/ForkPoolWorker-15] [398036bd-85f8-4f73-931c-1f1286cc1ded] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:02:00.768436751Z [2024-03-28 01:02:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5ccd56d-1d10-4449-84ad-e60be1d5d14d] received 2024-03-28T01:02:00.770436691Z [2024-03-28 01:02:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bd5e6c6-fab2-4786-b48b-dcb583cc593b] received 2024-03-28T01:02:00.779755319Z [2024-03-28 01:02:00,779: INFO/ForkPoolWorker-16] [8607f62a-5fd7-429b-9ae1-3a19df230843] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:02:00.785970020Z [2024-03-28 01:02:00,785: INFO/ForkPoolWorker-2] [0bd5e6c6-fab2-4786-b48b-dcb583cc593b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:02:00.786354087Z [2024-03-28 01:02:00,785: INFO/ForkPoolWorker-1] [f5ccd56d-1d10-4449-84ad-e60be1d5d14d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:02:01.243702240Z [2024-03-28 01:02:01,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:02:01.252339888Z [2024-03-28 01:02:01,248: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:02:01.266524019Z [2024-03-28 01:02:01,260: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:02:01.403088297Z [2024-03-28 01:02:01,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:02:01.533428800Z [2024-03-28 01:02:01,532: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:02:01.541105740Z [2024-03-28 01:02:01,540: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:02:01.585707030Z [2024-03-28 01:02:01,585: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:02:01.588221788Z [2024-03-28 01:02:01,587: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:02:01.588378792Z [2024-03-28 01:02:01,588: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:02:01.588567481Z [2024-03-28 01:02:01,588: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:02:01.589147779Z [2024-03-28 01:02:01,588: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:02:01.696556076Z [2024-03-28 01:02:01,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:02:01.750804275Z [2024-03-28 01:02:01,750: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:02:02.637032876Z [2024-03-28 01:02:02,636: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0bd5e6c6-fab2-4786-b48b-dcb583cc593b] succeeded in 1.862682539999696s: None 2024-03-28T01:02:02.659515344Z [2024-03-28 01:02:02,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[398036bd-85f8-4f73-931c-1f1286cc1ded] succeeded in 1.8970676239996465s: None 2024-03-28T01:02:02.927048964Z [2024-03-28 01:02:02,926: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:02:02.930858256Z [2024-03-28 01:02:02,930: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:02:02.957389327Z [2024-03-28 01:02:02,957: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:02:02.959077805Z [2024-03-28 01:02:02,958: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:02:02.959314471Z [2024-03-28 01:02:02,958: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:02:02.959589116Z [2024-03-28 01:02:02,959: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:02:02.959772967Z [2024-03-28 01:02:02,959: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:02:02.960159572Z [2024-03-28 01:02:02,959: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:02:02.960352753Z [2024-03-28 01:02:02,960: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:02:03.055577736Z [2024-03-28 01:02:03,055: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:02:03.138622922Z [2024-03-28 01:02:03,138: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:02:03.146055552Z [2024-03-28 01:02:03,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:02:03.182267907Z [2024-03-28 01:02:03,181: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:02:03.191610212Z [2024-03-28 01:02:03,190: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:02:03.191644105Z [2024-03-28 01:02:03,191: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:02:03.191755202Z [2024-03-28 01:02:03,191: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:02:03.191811673Z [2024-03-28 01:02:03,191: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:02:03.192221228Z [2024-03-28 01:02:03,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:02:03.192243719Z [2024-03-28 01:02:03,192: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:02:03.324076468Z [2024-03-28 01:02:03,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:02:05.095359701Z [2024-03-28 01:02:05,094: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8607f62a-5fd7-429b-9ae1-3a19df230843] succeeded in 4.327005198999359s: None 2024-03-28T01:02:05.294362780Z [2024-03-28 01:02:05,293: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5ccd56d-1d10-4449-84ad-e60be1d5d14d] succeeded in 4.521185823999986s: None 2024-03-28T01:03:00.542986782Z [2024-03-28 01:03:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96e265d9-d6e0-4291-bc99-5897c2ace4bc] received 2024-03-28T01:03:00.544630011Z [2024-03-28 01:03:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d97ea524-d7c2-4d6d-853a-e3895388faab] received 2024-03-28T01:03:00.550939563Z [2024-03-28 01:03:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b27f83b-0d4c-476f-9c38-3f1f4cdb4a5e] received 2024-03-28T01:03:00.551335726Z [2024-03-28 01:03:00,551: INFO/ForkPoolWorker-15] [96e265d9-d6e0-4291-bc99-5897c2ace4bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:03:00.552338779Z [2024-03-28 01:03:00,552: INFO/ForkPoolWorker-16] [d97ea524-d7c2-4d6d-853a-e3895388faab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:03:00.563624106Z [2024-03-28 01:03:00,563: INFO/ForkPoolWorker-1] [0b27f83b-0d4c-476f-9c38-3f1f4cdb4a5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:03:00.862566770Z [2024-03-28 01:03:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:03:00.873250477Z [2024-03-28 01:03:00,869: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:03:00.947284575Z [2024-03-28 01:03:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:03:01.143159829Z [2024-03-28 01:03:01,140: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:03:01.151244755Z [2024-03-28 01:03:01,149: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:03:01.180898697Z [2024-03-28 01:03:01,180: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:03:01.182350280Z [2024-03-28 01:03:01,181: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:03:01.182606271Z [2024-03-28 01:03:01,182: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:03:01.182625111Z [2024-03-28 01:03:01,182: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:03:01.183027379Z [2024-03-28 01:03:01,182: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:03:01.301253478Z [2024-03-28 01:03:01,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:03:01.923085936Z [2024-03-28 01:03:01,922: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b27f83b-0d4c-476f-9c38-3f1f4cdb4a5e] succeeded in 1.3700328459999582s: None 2024-03-28T01:03:02.074593522Z [2024-03-28 01:03:02,074: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:03:02.078268997Z [2024-03-28 01:03:02,077: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:03:02.102630291Z [2024-03-28 01:03:02,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:03:02.103975639Z [2024-03-28 01:03:02,103: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:03:02.104048466Z [2024-03-28 01:03:02,103: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:03:02.104212747Z [2024-03-28 01:03:02,104: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:03:02.104334043Z [2024-03-28 01:03:02,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:03:02.104683206Z [2024-03-28 01:03:02,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:03:02.104746904Z [2024-03-28 01:03:02,104: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:03:02.200222092Z [2024-03-28 01:03:02,199: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:03:02.334256001Z [2024-03-28 01:03:02,333: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:03:02.338125819Z [2024-03-28 01:03:02,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:03:02.359413431Z [2024-03-28 01:03:02,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:03:02.360797609Z [2024-03-28 01:03:02,360: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:03:02.360884750Z [2024-03-28 01:03:02,360: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:03:02.361143612Z [2024-03-28 01:03:02,360: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:03:02.361231925Z [2024-03-28 01:03:02,361: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:03:02.362200855Z [2024-03-28 01:03:02,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:03:02.362393585Z [2024-03-28 01:03:02,362: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:03:02.471329411Z [2024-03-28 01:03:02,470: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:03:03.649449033Z [2024-03-28 01:03:03,648: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d97ea524-d7c2-4d6d-853a-e3895388faab] succeeded in 3.1032315649999873s: None 2024-03-28T01:03:04.389766683Z [2024-03-28 01:03:04,389: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96e265d9-d6e0-4291-bc99-5897c2ace4bc] succeeded in 3.8435529999997016s: None 2024-03-28T01:04:00.412152363Z [2024-03-28 01:04:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3d0dc46-7ad5-4a4a-b294-090ac461ee7e] received 2024-03-28T01:04:00.414632692Z [2024-03-28 01:04:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c6f5e64-ed73-40aa-a8e4-32b1e8f19d00] received 2024-03-28T01:04:00.421787317Z [2024-03-28 01:04:00,421: INFO/ForkPoolWorker-16] [0c6f5e64-ed73-40aa-a8e4-32b1e8f19d00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:04:00.422097234Z [2024-03-28 01:04:00,421: INFO/ForkPoolWorker-15] [a3d0dc46-7ad5-4a4a-b294-090ac461ee7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:04:00.422680022Z [2024-03-28 01:04:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3464086-8371-4ab9-9acf-ed343be6b16d] received 2024-03-28T01:04:00.430466780Z [2024-03-28 01:04:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3962fc1-9106-4b01-a1f2-e1ae82eff81d] received 2024-03-28T01:04:00.432878642Z [2024-03-28 01:04:00,432: INFO/ForkPoolWorker-1] [c3464086-8371-4ab9-9acf-ed343be6b16d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:04:00.445785734Z [2024-03-28 01:04:00,445: INFO/ForkPoolWorker-2] [d3962fc1-9106-4b01-a1f2-e1ae82eff81d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:04:00.775223894Z [2024-03-28 01:04:00,771: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:04:00.785878626Z [2024-03-28 01:04:00,782: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:04:00.870177798Z [2024-03-28 01:04:00,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:04:00.893599875Z [2024-03-28 01:04:00,890: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:04:00.980739597Z [2024-03-28 01:04:00,980: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:04:00.988361710Z [2024-03-28 01:04:00,987: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:04:01.031976970Z [2024-03-28 01:04:01,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:04:01.033271764Z [2024-03-28 01:04:01,033: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:04:01.033607921Z [2024-03-28 01:04:01,033: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:04:01.033798492Z [2024-03-28 01:04:01,033: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:04:01.034122008Z [2024-03-28 01:04:01,033: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:04:01.148170030Z [2024-03-28 01:04:01,147: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:04:01.250550528Z [2024-03-28 01:04:01,250: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:04:01.975297725Z [2024-03-28 01:04:01,973: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c6f5e64-ed73-40aa-a8e4-32b1e8f19d00] succeeded in 1.5580217799997627s: None 2024-03-28T01:04:02.102802710Z [2024-03-28 01:04:02,100: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3464086-8371-4ab9-9acf-ed343be6b16d] succeeded in 1.6747031060003792s: None 2024-03-28T01:04:02.441159952Z [2024-03-28 01:04:02,440: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:04:02.446668511Z [2024-03-28 01:04:02,446: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:04:02.469242555Z [2024-03-28 01:04:02,468: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:04:02.471081479Z [2024-03-28 01:04:02,470: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:04:02.471100208Z [2024-03-28 01:04:02,470: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:04:02.471151808Z [2024-03-28 01:04:02,470: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:04:02.471163573Z [2024-03-28 01:04:02,471: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:04:02.471476830Z [2024-03-28 01:04:02,471: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:04:02.471486131Z [2024-03-28 01:04:02,471: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:04:02.574460269Z [2024-03-28 01:04:02,574: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:04:02.615840870Z [2024-03-28 01:04:02,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:04:02.619786349Z [2024-03-28 01:04:02,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:04:02.639981133Z [2024-03-28 01:04:02,639: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:04:02.641559679Z [2024-03-28 01:04:02,641: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:04:02.641723105Z [2024-03-28 01:04:02,641: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:04:02.641930437Z [2024-03-28 01:04:02,641: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:04:02.642070956Z [2024-03-28 01:04:02,641: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:04:02.642456840Z [2024-03-28 01:04:02,642: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:04:02.642584273Z [2024-03-28 01:04:02,642: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:04:02.779272481Z [2024-03-28 01:04:02,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:04:04.295698549Z [2024-03-28 01:04:04,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3d0dc46-7ad5-4a4a-b294-090ac461ee7e] succeeded in 3.879545533000055s: None 2024-03-28T01:04:04.558377676Z [2024-03-28 01:04:04,557: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3962fc1-9106-4b01-a1f2-e1ae82eff81d] succeeded in 4.12634479099961s: None 2024-03-28T01:05:00.807578435Z [2024-03-28 01:05:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3d18487-282e-4b19-bfab-bdc4819274bb] received 2024-03-28T01:05:00.814251410Z [2024-03-28 01:05:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dc983cb-cc9d-4390-85b1-167a53b7bfd4] received 2024-03-28T01:05:00.816142823Z [2024-03-28 01:05:00,815: INFO/ForkPoolWorker-15] [e3d18487-282e-4b19-bfab-bdc4819274bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:05:00.823757006Z [2024-03-28 01:05:00,823: INFO/ForkPoolWorker-16] [1dc983cb-cc9d-4390-85b1-167a53b7bfd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:05:00.832578890Z [2024-03-28 01:05:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c15271ea-6fc4-45e1-9764-7b569e998157] received 2024-03-28T01:05:00.834401591Z [2024-03-28 01:05:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7e0677e-a7cb-4af4-8b28-08875c18ee5f] received 2024-03-28T01:05:00.845458113Z [2024-03-28 01:05:00,845: INFO/ForkPoolWorker-1] [c15271ea-6fc4-45e1-9764-7b569e998157] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:05:00.850105343Z [2024-03-28 01:05:00,849: INFO/ForkPoolWorker-2] [d7e0677e-a7cb-4af4-8b28-08875c18ee5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:05:01.268797267Z [2024-03-28 01:05:01,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:05:01.573065106Z [2024-03-28 01:05:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:05:01.625156552Z [2024-03-28 01:05:01,621: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:05:01.820785029Z [2024-03-28 01:05:01,785: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:05:02.276475399Z [2024-03-28 01:05:02,275: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:05:02.281406035Z [2024-03-28 01:05:02,280: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:02.321251253Z [2024-03-28 01:05:02,320: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:05:02.328417663Z [2024-03-28 01:05:02,328: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:05:02.328681520Z [2024-03-28 01:05:02,328: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:05:02.328894448Z [2024-03-28 01:05:02,328: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:05:02.329264576Z [2024-03-28 01:05:02,329: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:05:02.526527949Z [2024-03-28 01:05:02,526: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:03.567985762Z [2024-03-28 01:05:03,567: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d7e0677e-a7cb-4af4-8b28-08875c18ee5f] succeeded in 2.7277099000002636s: None 2024-03-28T01:05:03.786112951Z [2024-03-28 01:05:03,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:05:03.790391461Z [2024-03-28 01:05:03,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:03.838257589Z [2024-03-28 01:05:03,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:05:03.840817419Z [2024-03-28 01:05:03,840: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:03.841058322Z [2024-03-28 01:05:03,840: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:03.841620844Z [2024-03-28 01:05:03,841: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:03.841872055Z [2024-03-28 01:05:03,841: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:05:03.842692183Z [2024-03-28 01:05:03,842: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:05:03.843187936Z [2024-03-28 01:05:03,842: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:03.855268044Z [2024-03-28 01:05:03,854: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:05:03.862131234Z [2024-03-28 01:05:03,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:03.899261767Z [2024-03-28 01:05:03,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:05:03.906091239Z [2024-03-28 01:05:03,905: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:03.906185057Z [2024-03-28 01:05:03,905: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:03.906495151Z [2024-03-28 01:05:03,906: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:03.906676658Z [2024-03-28 01:05:03,906: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:05:03.907112303Z [2024-03-28 01:05:03,906: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:05:03.907248747Z [2024-03-28 01:05:03,907: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:03.983827649Z [2024-03-28 01:05:03,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:04.163893108Z [2024-03-28 01:05:04,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:04.417442682Z [2024-03-28 01:05:04,417: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:05:04.427086574Z [2024-03-28 01:05:04,426: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:04.456559305Z [2024-03-28 01:05:04,456: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:05:04.458507291Z [2024-03-28 01:05:04,458: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:04.458599427Z [2024-03-28 01:05:04,458: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:04.458934191Z [2024-03-28 01:05:04,458: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:04.464678506Z [2024-03-28 01:05:04,458: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:05:04.466080842Z [2024-03-28 01:05:04,465: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:05:04.466462979Z [2024-03-28 01:05:04,466: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:04.559055309Z [2024-03-28 01:05:04,558: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:04.945370840Z [2024-03-28 01:05:04,944: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3d18487-282e-4b19-bfab-bdc4819274bb] succeeded in 4.135578825000266s: None 2024-03-28T01:05:05.338081221Z [2024-03-28 01:05:05,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70dcf677-b8a0-4564-bcda-a741b3e28f9e] received 2024-03-28T01:05:05.346168068Z [2024-03-28 01:05:05,345: INFO/ForkPoolWorker-15] [70dcf677-b8a0-4564-bcda-a741b3e28f9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:05:05.624908033Z [2024-03-28 01:05:05,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:05:05.764658866Z [2024-03-28 01:05:05,764: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1dc983cb-cc9d-4390-85b1-167a53b7bfd4] succeeded in 4.948723186000279s: None 2024-03-28T01:05:06.842273237Z [2024-03-28 01:05:06,841: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:05:06.846004379Z [2024-03-28 01:05:06,845: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:06.866761826Z [2024-03-28 01:05:06,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:05:06.868816213Z [2024-03-28 01:05:06,868: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:06.869006105Z [2024-03-28 01:05:06,868: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:06.869383689Z [2024-03-28 01:05:06,869: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:06.869635600Z [2024-03-28 01:05:06,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:05:06.870264290Z [2024-03-28 01:05:06,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:05:06.870524399Z [2024-03-28 01:05:06,870: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:06.955131026Z [2024-03-28 01:05:06,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:07.274564194Z [2024-03-28 01:05:07,274: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c15271ea-6fc4-45e1-9764-7b569e998157] succeeded in 6.435925536000468s: None 2024-03-28T01:05:07.689993132Z [2024-03-28 01:05:07,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70dcf677-b8a0-4564-bcda-a741b3e28f9e] succeeded in 2.349700101999588s: None 2024-03-28T01:05:07.908422485Z [2024-03-28 01:05:07,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[611e6b38-2431-47ac-82b0-101703955220] received 2024-03-28T01:05:07.918246811Z [2024-03-28 01:05:07,917: INFO/ForkPoolWorker-15] [611e6b38-2431-47ac-82b0-101703955220] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:05:08.280425417Z [2024-03-28 01:05:08,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:05:09.580859768Z [2024-03-28 01:05:09,580: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:05:09.585110095Z [2024-03-28 01:05:09,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:09.625619343Z [2024-03-28 01:05:09,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:05:09.629589929Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:09.629610865Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:09.629615034Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:09.629627661Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:05:09.629631443Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:05:09.629635472Z [2024-03-28 01:05:09,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:09.845911886Z [2024-03-28 01:05:09,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:10.476753669Z [2024-03-28 01:05:10,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[611e6b38-2431-47ac-82b0-101703955220] succeeded in 2.564731661999758s: None 2024-03-28T01:05:10.911152488Z [2024-03-28 01:05:10,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caf6f8e4-c5f2-4fbb-adde-2e52bc954543] received 2024-03-28T01:05:10.920217697Z [2024-03-28 01:05:10,919: INFO/ForkPoolWorker-15] [caf6f8e4-c5f2-4fbb-adde-2e52bc954543] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:05:11.286129418Z [2024-03-28 01:05:11,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:05:12.501102829Z [2024-03-28 01:05:12,500: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:05:12.504150858Z [2024-03-28 01:05:12,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:05:12.519550550Z [2024-03-28 01:05:12,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:05:12.520581698Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:05:12.520605232Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:05:12.520717305Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:05:12.520729449Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:05:12.520969668Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:05:12.520979554Z [2024-03-28 01:05:12,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:05:12.597469792Z [2024-03-28 01:05:12,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:05:13.245642695Z [2024-03-28 01:05:13,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[caf6f8e4-c5f2-4fbb-adde-2e52bc954543] succeeded in 2.329203719999896s: None 2024-03-28T01:06:01.189932958Z [2024-03-28 01:06:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3016f660-21cc-4592-9ef3-8cd6fd0bb015] received 2024-03-28T01:06:01.197528826Z [2024-03-28 01:06:01,197: INFO/ForkPoolWorker-15] [3016f660-21cc-4592-9ef3-8cd6fd0bb015] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:06:01.205212726Z [2024-03-28 01:06:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eeeaa6f3-fcf3-40b3-b671-51e9b453f115] received 2024-03-28T01:06:01.226208759Z [2024-03-28 01:06:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[700d757d-e6b0-4993-b533-1efad2aa389a] received 2024-03-28T01:06:01.238118279Z [2024-03-28 01:06:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed1f284a-b13c-4861-b038-84190da9b272] received 2024-03-28T01:06:01.293875632Z [2024-03-28 01:06:01,293: INFO/ForkPoolWorker-1] [700d757d-e6b0-4993-b533-1efad2aa389a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:06:01.297166879Z [2024-03-28 01:06:01,295: INFO/ForkPoolWorker-2] [ed1f284a-b13c-4861-b038-84190da9b272] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:06:01.305119273Z [2024-03-28 01:06:01,304: INFO/ForkPoolWorker-16] [eeeaa6f3-fcf3-40b3-b671-51e9b453f115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:06:01.733609174Z [2024-03-28 01:06:01,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:06:01.766147702Z [2024-03-28 01:06:01,762: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:06:01.856807651Z [2024-03-28 01:06:01,850: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:06:01.930699556Z [2024-03-28 01:06:01,927: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:06:02.065250110Z [2024-03-28 01:06:02,064: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:06:02.129826766Z [2024-03-28 01:06:02,129: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:06:02.134129468Z [2024-03-28 01:06:02,133: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:06:02.168897237Z [2024-03-28 01:06:02,168: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:06:02.173447859Z [2024-03-28 01:06:02,173: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:06:02.174045035Z [2024-03-28 01:06:02,173: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:06:02.174231039Z [2024-03-28 01:06:02,174: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:06:02.175239648Z [2024-03-28 01:06:02,174: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:06:02.326802495Z [2024-03-28 01:06:02,326: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:06:02.777395745Z [2024-03-28 01:06:02,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3016f660-21cc-4592-9ef3-8cd6fd0bb015] succeeded in 1.5858519869998418s: None 2024-03-28T01:06:03.133326229Z [2024-03-28 01:06:03,132: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed1f284a-b13c-4861-b038-84190da9b272] succeeded in 1.8685710879999533s: None 2024-03-28T01:06:03.453889360Z [2024-03-28 01:06:03,453: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:06:03.460955889Z [2024-03-28 01:06:03,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:06:03.487788708Z [2024-03-28 01:06:03,487: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:06:03.492085255Z [2024-03-28 01:06:03,491: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:06:03.520988041Z [2024-03-28 01:06:03,520: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:06:03.523154041Z [2024-03-28 01:06:03,522: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:06:03.523265617Z [2024-03-28 01:06:03,523: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:06:03.523920546Z [2024-03-28 01:06:03,523: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:06:03.525548133Z [2024-03-28 01:06:03,524: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:06:03.525557468Z [2024-03-28 01:06:03,524: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:06:03.525561303Z [2024-03-28 01:06:03,524: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:06:03.525565283Z [2024-03-28 01:06:03,525: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:06:03.525568383Z [2024-03-28 01:06:03,525: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:06:03.525571455Z [2024-03-28 01:06:03,525: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:06:03.526580335Z [2024-03-28 01:06:03,523: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:06:03.526728904Z [2024-03-28 01:06:03,526: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:06:03.527079380Z [2024-03-28 01:06:03,526: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:06:03.527123364Z [2024-03-28 01:06:03,527: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:06:03.653676959Z [2024-03-28 01:06:03,652: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:06:03.728263419Z [2024-03-28 01:06:03,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:06:05.240329124Z [2024-03-28 01:06:05,239: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[700d757d-e6b0-4993-b533-1efad2aa389a] succeeded in 3.972829518999788s: None 2024-03-28T01:06:05.909521915Z [2024-03-28 01:06:05,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eeeaa6f3-fcf3-40b3-b671-51e9b453f115] succeeded in 4.698565879000853s: None 2024-03-28T01:07:00.414528727Z [2024-03-28 01:07:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a76ab1e8-7e8c-4367-932e-f17b40eaee64] received 2024-03-28T01:07:00.422539421Z [2024-03-28 01:07:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499b2470-0749-4812-a81d-87be4a52233b] received 2024-03-28T01:07:00.430162212Z [2024-03-28 01:07:00,429: INFO/ForkPoolWorker-15] [a76ab1e8-7e8c-4367-932e-f17b40eaee64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:07:00.435312539Z [2024-03-28 01:07:00,435: INFO/ForkPoolWorker-16] [499b2470-0749-4812-a81d-87be4a52233b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:07:00.442431379Z [2024-03-28 01:07:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b549b278-419d-46c3-8df9-3673bc16167a] received 2024-03-28T01:07:00.451467902Z [2024-03-28 01:07:00,450: INFO/ForkPoolWorker-1] [b549b278-419d-46c3-8df9-3673bc16167a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:07:00.736133380Z [2024-03-28 01:07:00,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:07:00.749594096Z [2024-03-28 01:07:00,745: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:07:00.764153671Z [2024-03-28 01:07:00,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:07:00.944062004Z [2024-03-28 01:07:00,943: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:07:00.948809163Z [2024-03-28 01:07:00,948: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:07:00.972636748Z [2024-03-28 01:07:00,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:07:00.973787820Z [2024-03-28 01:07:00,973: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:07:00.974057277Z [2024-03-28 01:07:00,973: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:07:00.974272482Z [2024-03-28 01:07:00,974: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:07:00.974668881Z [2024-03-28 01:07:00,974: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:07:01.073690750Z [2024-03-28 01:07:01,073: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:07:01.712533505Z [2024-03-28 01:07:01,712: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b549b278-419d-46c3-8df9-3673bc16167a] succeeded in 1.2676103970006807s: None 2024-03-28T01:07:02.005601695Z [2024-03-28 01:07:02,005: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:07:02.009543420Z [2024-03-28 01:07:02,009: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:07:02.029318422Z [2024-03-28 01:07:02,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:07:02.030932217Z [2024-03-28 01:07:02,030: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:07:02.030955665Z [2024-03-28 01:07:02,030: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:07:02.031073945Z [2024-03-28 01:07:02,030: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:07:02.031090826Z [2024-03-28 01:07:02,030: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:07:02.031373634Z [2024-03-28 01:07:02,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:07:02.031387242Z [2024-03-28 01:07:02,031: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:07:02.063189992Z [2024-03-28 01:07:02,062: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:07:02.067130870Z [2024-03-28 01:07:02,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:07:02.090515917Z [2024-03-28 01:07:02,090: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:07:02.091873655Z [2024-03-28 01:07:02,091: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:07:02.091964758Z [2024-03-28 01:07:02,091: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:07:02.092031845Z [2024-03-28 01:07:02,091: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:07:02.092209045Z [2024-03-28 01:07:02,092: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:07:02.092391797Z [2024-03-28 01:07:02,092: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:07:02.092412617Z [2024-03-28 01:07:02,092: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:07:02.121986998Z [2024-03-28 01:07:02,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:07:02.183082984Z [2024-03-28 01:07:02,182: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:07:03.735019510Z [2024-03-28 01:07:03,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a76ab1e8-7e8c-4367-932e-f17b40eaee64] succeeded in 3.3164405389998137s: None 2024-03-28T01:07:04.155632398Z [2024-03-28 01:07:04,155: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[499b2470-0749-4812-a81d-87be4a52233b] succeeded in 3.731508576000124s: None 2024-03-28T01:08:00.832623653Z [2024-03-28 01:08:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fad677ac-d955-40c8-9917-c5096e9d18bf] received 2024-03-28T01:08:00.837720868Z [2024-03-28 01:08:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7d99fc0-04a3-4097-baef-da94ba7c7f8d] received 2024-03-28T01:08:00.839584032Z [2024-03-28 01:08:00,839: INFO/ForkPoolWorker-15] [fad677ac-d955-40c8-9917-c5096e9d18bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:08:00.842393233Z [2024-03-28 01:08:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e239ae9-740c-4f46-976d-71a180060772] received 2024-03-28T01:08:00.847951212Z [2024-03-28 01:08:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24aab1ea-9736-46cf-9a89-46694c90049b] received 2024-03-28T01:08:00.850968217Z [2024-03-28 01:08:00,850: INFO/ForkPoolWorker-16] [c7d99fc0-04a3-4097-baef-da94ba7c7f8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:08:00.856950540Z [2024-03-28 01:08:00,855: INFO/ForkPoolWorker-1] [2e239ae9-740c-4f46-976d-71a180060772] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:08:00.859237001Z [2024-03-28 01:08:00,858: INFO/ForkPoolWorker-2] [24aab1ea-9736-46cf-9a89-46694c90049b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:08:01.247641939Z [2024-03-28 01:08:01,238: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:08:01.373093031Z [2024-03-28 01:08:01,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:08:01.408496681Z [2024-03-28 01:08:01,402: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:08:01.594911598Z [2024-03-28 01:08:01,594: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:08:01.599673891Z [2024-03-28 01:08:01,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:08:01.639020407Z [2024-03-28 01:08:01,638: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:08:01.640982131Z [2024-03-28 01:08:01,640: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:08:01.641255060Z [2024-03-28 01:08:01,640: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:08:01.641434891Z [2024-03-28 01:08:01,641: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:08:01.641852487Z [2024-03-28 01:08:01,641: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:08:01.710771995Z [2024-03-28 01:08:01,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:08:01.914107416Z [2024-03-28 01:08:01,906: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:08:02.775166275Z [2024-03-28 01:08:02,774: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:08:03.162860833Z [2024-03-28 01:08:03,162: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7d99fc0-04a3-4097-baef-da94ba7c7f8d] succeeded in 2.3220730240000194s: None 2024-03-28T01:08:03.286900833Z [2024-03-28 01:08:03,286: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:08:03.297626663Z [2024-03-28 01:08:03,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:08:03.434809833Z [2024-03-28 01:08:03,434: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:08:03.438727140Z [2024-03-28 01:08:03,438: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:08:03.438748173Z [2024-03-28 01:08:03,438: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:08:03.438845149Z [2024-03-28 01:08:03,438: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:08:03.438887265Z [2024-03-28 01:08:03,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:08:03.439123647Z [2024-03-28 01:08:03,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:08:03.439174087Z [2024-03-28 01:08:03,439: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:08:03.543698118Z [2024-03-28 01:08:03,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:08:03.633606210Z [2024-03-28 01:08:03,631: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:08:03.637602335Z [2024-03-28 01:08:03,634: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e239ae9-740c-4f46-976d-71a180060772] succeeded in 2.7904073559993776s: None 2024-03-28T01:08:03.637622707Z [2024-03-28 01:08:03,635: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:08:03.687736671Z [2024-03-28 01:08:03,687: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:08:03.690446758Z [2024-03-28 01:08:03,690: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:08:03.690541468Z [2024-03-28 01:08:03,690: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:08:03.690711872Z [2024-03-28 01:08:03,690: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:08:03.690791965Z [2024-03-28 01:08:03,690: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:08:03.691078223Z [2024-03-28 01:08:03,690: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:08:03.691373161Z [2024-03-28 01:08:03,691: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:08:03.786770433Z [2024-03-28 01:08:03,786: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:08:05.670874141Z [2024-03-28 01:08:05,670: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24aab1ea-9736-46cf-9a89-46694c90049b] succeeded in 4.820841238999492s: None 2024-03-28T01:08:05.931831736Z [2024-03-28 01:08:05,931: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fad677ac-d955-40c8-9917-c5096e9d18bf] succeeded in 5.09741933999976s: None 2024-03-28T01:09:00.470239819Z [2024-03-28 01:09:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2922d266-68ff-4d21-b61e-6a93609f8750] received 2024-03-28T01:09:00.478051252Z [2024-03-28 01:09:00,477: INFO/ForkPoolWorker-15] [2922d266-68ff-4d21-b61e-6a93609f8750] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:09:00.483667497Z [2024-03-28 01:09:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10de23c5-44ed-4fd5-9709-04328deb4540] received 2024-03-28T01:09:00.487887415Z [2024-03-28 01:09:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[343d4b37-b40c-44c8-a046-049b23d90ed3] received 2024-03-28T01:09:00.494230167Z [2024-03-28 01:09:00,493: INFO/ForkPoolWorker-16] [10de23c5-44ed-4fd5-9709-04328deb4540] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:09:00.512591612Z [2024-03-28 01:09:00,512: INFO/ForkPoolWorker-1] [343d4b37-b40c-44c8-a046-049b23d90ed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:09:00.896859600Z [2024-03-28 01:09:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:09:01.111878896Z [2024-03-28 01:09:01,108: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:09:01.242858922Z [2024-03-28 01:09:01,238: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:09:01.348998157Z [2024-03-28 01:09:01,348: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:09:01.353726497Z [2024-03-28 01:09:01,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:09:01.408739973Z [2024-03-28 01:09:01,408: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:09:01.409918621Z [2024-03-28 01:09:01,409: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:09:01.419483501Z [2024-03-28 01:09:01,419: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:09:01.427670988Z [2024-03-28 01:09:01,427: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:09:01.431160370Z [2024-03-28 01:09:01,429: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:09:01.751590737Z [2024-03-28 01:09:01,751: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:09:03.228399309Z [2024-03-28 01:09:03,227: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10de23c5-44ed-4fd5-9709-04328deb4540] succeeded in 2.743159220999587s: None 2024-03-28T01:09:03.725020608Z [2024-03-28 01:09:03,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:09:03.782499643Z [2024-03-28 01:09:03,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:09:03.907747261Z [2024-03-28 01:09:03,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:09:03.917064465Z [2024-03-28 01:09:03,915: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:09:03.917090892Z [2024-03-28 01:09:03,916: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:09:03.917098447Z [2024-03-28 01:09:03,916: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:09:03.917102507Z [2024-03-28 01:09:03,916: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:09:03.918155202Z [2024-03-28 01:09:03,917: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:09:03.918234237Z [2024-03-28 01:09:03,917: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:09:03.950576634Z [2024-03-28 01:09:03,950: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:09:03.959363762Z [2024-03-28 01:09:03,958: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:09:04.008883952Z [2024-03-28 01:09:04,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:09:04.010874886Z [2024-03-28 01:09:04,010: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:09:04.010894869Z [2024-03-28 01:09:04,010: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:09:04.011056436Z [2024-03-28 01:09:04,010: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:09:04.011171670Z [2024-03-28 01:09:04,011: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:09:04.018947513Z [2024-03-28 01:09:04,018: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:09:04.019439033Z [2024-03-28 01:09:04,019: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:09:04.042891038Z [2024-03-28 01:09:04,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:09:04.099812267Z [2024-03-28 01:09:04,099: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:09:06.549644571Z [2024-03-28 01:09:06,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2922d266-68ff-4d21-b61e-6a93609f8750] succeeded in 6.077779736000593s: None 2024-03-28T01:09:07.295892098Z [2024-03-28 01:09:07,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[343d4b37-b40c-44c8-a046-049b23d90ed3] succeeded in 6.806185574000665s: None 2024-03-28T01:10:00.718557938Z [2024-03-28 01:10:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abf35be8-b2c3-49c1-9c2d-d3926f4d5eaa] received 2024-03-28T01:10:00.721115150Z [2024-03-28 01:10:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d183f25f-939a-41a6-8f84-51301b186854] received 2024-03-28T01:10:00.725259898Z [2024-03-28 01:10:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[883a5c59-00f4-416b-bdf0-ac2a78934b8f] received 2024-03-28T01:10:00.727419719Z [2024-03-28 01:10:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e2778bd-5344-4080-ba4f-71b7d8ea2731] received 2024-03-28T01:10:00.733932238Z [2024-03-28 01:10:00,733: INFO/ForkPoolWorker-15] [abf35be8-b2c3-49c1-9c2d-d3926f4d5eaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:10:00.734751177Z [2024-03-28 01:10:00,734: INFO/ForkPoolWorker-16] [d183f25f-939a-41a6-8f84-51301b186854] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:10:00.736681228Z [2024-03-28 01:10:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2eee4221-6414-4d2d-ad3b-205dc461c974] received 2024-03-28T01:10:00.754863458Z [2024-03-28 01:10:00,754: INFO/ForkPoolWorker-2] [5e2778bd-5344-4080-ba4f-71b7d8ea2731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:10:00.758575115Z [2024-03-28 01:10:00,758: INFO/ForkPoolWorker-1] [883a5c59-00f4-416b-bdf0-ac2a78934b8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:10:00.770878338Z [2024-03-28 01:10:00,768: INFO/ForkPoolWorker-3] [2eee4221-6414-4d2d-ad3b-205dc461c974] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:10:01.096197016Z [2024-03-28 01:10:01,093: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:10:01.223546932Z [2024-03-28 01:10:01,218: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:10:01.227881614Z [2024-03-28 01:10:01,224: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:10:01.376020816Z [2024-03-28 01:10:01,372: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:10:01.430804323Z [2024-03-28 01:10:01,430: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T01:10:01.435330757Z [2024-03-28 01:10:01,434: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:01.458783626Z [2024-03-28 01:10:01,458: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:01.462743746Z [2024-03-28 01:10:01,462: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:10:01.465021930Z [2024-03-28 01:10:01,464: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:10:01.465603435Z [2024-03-28 01:10:01,464: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:10:01.465773198Z [2024-03-28 01:10:01,465: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T01:10:01.470429977Z [2024-03-28 01:10:01,470: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:10:01.521039421Z [2024-03-28 01:10:01,517: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:10:01.638953009Z [2024-03-28 01:10:01,638: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:02.252378718Z [2024-03-28 01:10:02,251: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d183f25f-939a-41a6-8f84-51301b186854] succeeded in 1.5293797030008136s: None 2024-03-28T01:10:02.510255965Z [2024-03-28 01:10:02,509: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2eee4221-6414-4d2d-ad3b-205dc461c974] succeeded in 1.7683683669993115s: None 2024-03-28T01:10:03.088450413Z [2024-03-28 01:10:03,087: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:10:03.095558138Z [2024-03-28 01:10:03,094: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:03.121600586Z [2024-03-28 01:10:03,121: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:10:03.123548692Z [2024-03-28 01:10:03,123: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:03.124968141Z [2024-03-28 01:10:03,123: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:03.125363371Z [2024-03-28 01:10:03,124: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:03.125759652Z [2024-03-28 01:10:03,125: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:10:03.126857609Z [2024-03-28 01:10:03,126: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:10:03.127050650Z [2024-03-28 01:10:03,126: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:03.146397324Z [2024-03-28 01:10:03,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:10:03.150626993Z [2024-03-28 01:10:03,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:03.183758236Z [2024-03-28 01:10:03,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:10:03.189030872Z [2024-03-28 01:10:03,188: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:03.189114646Z [2024-03-28 01:10:03,188: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:03.189450751Z [2024-03-28 01:10:03,189: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:03.189643659Z [2024-03-28 01:10:03,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:10:03.190062183Z [2024-03-28 01:10:03,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:10:03.190156092Z [2024-03-28 01:10:03,190: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:03.231755705Z [2024-03-28 01:10:03,231: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:03.307506422Z [2024-03-28 01:10:03,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:03.370815771Z [2024-03-28 01:10:03,370: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:10:03.376443934Z [2024-03-28 01:10:03,375: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:03.418587956Z [2024-03-28 01:10:03,418: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:10:03.420924146Z [2024-03-28 01:10:03,420: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:03.421026785Z [2024-03-28 01:10:03,420: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:03.421222634Z [2024-03-28 01:10:03,421: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:03.421299815Z [2024-03-28 01:10:03,421: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:10:03.421644579Z [2024-03-28 01:10:03,421: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:10:03.421791164Z [2024-03-28 01:10:03,421: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:03.514855364Z [2024-03-28 01:10:03,514: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:04.126471180Z [2024-03-28 01:10:04,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abf35be8-b2c3-49c1-9c2d-d3926f4d5eaa] succeeded in 3.4045829500000764s: None 2024-03-28T01:10:04.201027090Z [2024-03-28 01:10:04,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e65d52e0-35f8-42a9-99b7-fd2800fd5673] received 2024-03-28T01:10:04.208973401Z [2024-03-28 01:10:04,208: INFO/ForkPoolWorker-15] [e65d52e0-35f8-42a9-99b7-fd2800fd5673] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:10:04.559621421Z [2024-03-28 01:10:04,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:10:05.148486419Z [2024-03-28 01:10:05,147: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e2778bd-5344-4080-ba4f-71b7d8ea2731] succeeded in 4.4114151609992405s: None 2024-03-28T01:10:05.340412483Z [2024-03-28 01:10:05,339: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[883a5c59-00f4-416b-bdf0-ac2a78934b8f] succeeded in 4.60925149600007s: None 2024-03-28T01:10:05.780609369Z [2024-03-28 01:10:05,780: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:10:05.784345687Z [2024-03-28 01:10:05,783: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:05.803062761Z [2024-03-28 01:10:05,802: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:10:05.804411600Z [2024-03-28 01:10:05,804: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:05.804534314Z [2024-03-28 01:10:05,804: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:05.804728355Z [2024-03-28 01:10:05,804: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:05.804851530Z [2024-03-28 01:10:05,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:10:05.805283613Z [2024-03-28 01:10:05,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:10:05.805360064Z [2024-03-28 01:10:05,805: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:05.881163723Z [2024-03-28 01:10:05,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:06.613434392Z [2024-03-28 01:10:06,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e65d52e0-35f8-42a9-99b7-fd2800fd5673] succeeded in 2.4094795849996444s: None 2024-03-28T01:10:06.620372398Z [2024-03-28 01:10:06,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4071cf24-00a1-423d-9aa6-b34081a517e1] received 2024-03-28T01:10:06.634558465Z [2024-03-28 01:10:06,634: INFO/ForkPoolWorker-15] [4071cf24-00a1-423d-9aa6-b34081a517e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:10:06.978843285Z [2024-03-28 01:10:06,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:10:08.273079056Z [2024-03-28 01:10:08,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:10:08.276694968Z [2024-03-28 01:10:08,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:08.300137886Z [2024-03-28 01:10:08,299: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:10:08.301405966Z [2024-03-28 01:10:08,301: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:08.301419535Z [2024-03-28 01:10:08,301: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:08.301584497Z [2024-03-28 01:10:08,301: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:08.301598012Z [2024-03-28 01:10:08,301: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:10:08.303351639Z [2024-03-28 01:10:08,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:10:08.303417677Z [2024-03-28 01:10:08,303: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:08.416967134Z [2024-03-28 01:10:08,416: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:09.210618358Z [2024-03-28 01:10:09,210: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4071cf24-00a1-423d-9aa6-b34081a517e1] succeeded in 2.5880552829994485s: None 2024-03-28T01:10:09.257795476Z [2024-03-28 01:10:09,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08add8b4-9322-4eaf-b037-4b4600c35e75] received 2024-03-28T01:10:09.286236483Z [2024-03-28 01:10:09,285: INFO/ForkPoolWorker-15] [08add8b4-9322-4eaf-b037-4b4600c35e75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:10:09.640430312Z [2024-03-28 01:10:09,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:10:11.124621805Z [2024-03-28 01:10:11,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:10:11.128893567Z [2024-03-28 01:10:11,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:10:11.191530893Z [2024-03-28 01:10:11,191: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:10:11.192997889Z [2024-03-28 01:10:11,192: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:10:11.193158671Z [2024-03-28 01:10:11,192: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:10:11.193420882Z [2024-03-28 01:10:11,193: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:10:11.193681288Z [2024-03-28 01:10:11,193: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:10:11.194077055Z [2024-03-28 01:10:11,193: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:10:11.194271195Z [2024-03-28 01:10:11,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:10:11.294135692Z [2024-03-28 01:10:11,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:10:12.090027910Z [2024-03-28 01:10:12,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08add8b4-9322-4eaf-b037-4b4600c35e75] succeeded in 2.8253619979996074s: None 2024-03-28T01:11:01.144259704Z [2024-03-28 01:11:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4034716b-3274-473e-b2bf-897d97197e8e] received 2024-03-28T01:11:01.150262787Z [2024-03-28 01:11:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69274e34-a3e9-4f02-be1f-42c862468eff] received 2024-03-28T01:11:01.163961503Z [2024-03-28 01:11:01,163: INFO/ForkPoolWorker-16] [69274e34-a3e9-4f02-be1f-42c862468eff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:11:01.170833612Z [2024-03-28 01:11:01,170: INFO/ForkPoolWorker-15] [4034716b-3274-473e-b2bf-897d97197e8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:11:01.171560778Z [2024-03-28 01:11:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25e8eca8-4c61-48c4-afff-ca2580e66dc7] received 2024-03-28T01:11:01.180685824Z [2024-03-28 01:11:01,180: INFO/ForkPoolWorker-1] [25e8eca8-4c61-48c4-afff-ca2580e66dc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:11:01.539563528Z [2024-03-28 01:11:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:11:01.551400279Z [2024-03-28 01:11:01,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:11:01.568546392Z [2024-03-28 01:11:01,565: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:11:01.760080260Z [2024-03-28 01:11:01,759: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:11:01.764824801Z [2024-03-28 01:11:01,764: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:11:01.788440321Z [2024-03-28 01:11:01,788: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:11:01.790211477Z [2024-03-28 01:11:01,789: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:11:01.790473519Z [2024-03-28 01:11:01,790: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:11:01.790904984Z [2024-03-28 01:11:01,790: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:11:01.791428972Z [2024-03-28 01:11:01,791: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:11:01.912977602Z [2024-03-28 01:11:01,912: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:11:02.567235162Z [2024-03-28 01:11:02,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25e8eca8-4c61-48c4-afff-ca2580e66dc7] succeeded in 1.3933104660000026s: None 2024-03-28T01:11:02.938360295Z [2024-03-28 01:11:02,937: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:11:02.942375751Z [2024-03-28 01:11:02,941: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:11:02.962468349Z [2024-03-28 01:11:02,962: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:11:02.963808024Z [2024-03-28 01:11:02,963: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:11:02.963853306Z [2024-03-28 01:11:02,963: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:11:02.963975856Z [2024-03-28 01:11:02,963: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:11:02.964036088Z [2024-03-28 01:11:02,963: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:11:02.964389611Z [2024-03-28 01:11:02,964: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:11:02.964508091Z [2024-03-28 01:11:02,964: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:11:03.033327027Z [2024-03-28 01:11:03,032: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:11:03.037045988Z [2024-03-28 01:11:03,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:11:03.052340121Z [2024-03-28 01:11:03,052: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:11:03.062402898Z [2024-03-28 01:11:03,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:11:03.065014154Z [2024-03-28 01:11:03,064: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:11:03.065178852Z [2024-03-28 01:11:03,065: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:11:03.065393011Z [2024-03-28 01:11:03,065: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:11:03.065645078Z [2024-03-28 01:11:03,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:11:03.066121875Z [2024-03-28 01:11:03,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:11:03.066242411Z [2024-03-28 01:11:03,066: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:11:03.158862881Z [2024-03-28 01:11:03,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:11:05.560607820Z [2024-03-28 01:11:05,560: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69274e34-a3e9-4f02-be1f-42c862468eff] succeeded in 4.405838296999718s: None 2024-03-28T01:11:06.629078791Z [2024-03-28 01:11:06,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4034716b-3274-473e-b2bf-897d97197e8e] succeeded in 5.475177125999835s: None 2024-03-28T01:12:01.077611068Z [2024-03-28 01:12:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92fee41b-381e-481b-b0da-4504dde652a0] received 2024-03-28T01:12:01.082917606Z [2024-03-28 01:12:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33fb937f-4a40-4e2e-82d3-d7cd3a87d880] received 2024-03-28T01:12:01.087524111Z [2024-03-28 01:12:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb732c88-a5be-457f-9c16-f1b20293ebc4] received 2024-03-28T01:12:01.092147762Z [2024-03-28 01:12:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be9fc3e7-2269-4167-a058-c4bc283866d4] received 2024-03-28T01:12:01.098459698Z [2024-03-28 01:12:01,097: INFO/ForkPoolWorker-15] [92fee41b-381e-481b-b0da-4504dde652a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:12:01.100352824Z [2024-03-28 01:12:01,100: INFO/ForkPoolWorker-2] [be9fc3e7-2269-4167-a058-c4bc283866d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:12:01.100782848Z [2024-03-28 01:12:01,100: INFO/ForkPoolWorker-16] [33fb937f-4a40-4e2e-82d3-d7cd3a87d880] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:12:01.101113284Z [2024-03-28 01:12:01,100: INFO/ForkPoolWorker-1] [eb732c88-a5be-457f-9c16-f1b20293ebc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:12:01.720876546Z [2024-03-28 01:12:01,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:12:01.766211522Z [2024-03-28 01:12:01,760: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:12:01.812849342Z [2024-03-28 01:12:01,808: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:12:01.980990010Z [2024-03-28 01:12:01,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:12:02.015072689Z [2024-03-28 01:12:02,014: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:12:02.019599386Z [2024-03-28 01:12:02,019: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:12:02.059234753Z [2024-03-28 01:12:02,058: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:12:02.065018594Z [2024-03-28 01:12:02,064: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:12:02.065287723Z [2024-03-28 01:12:02,064: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:12:02.066417130Z [2024-03-28 01:12:02,065: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:12:02.066821806Z [2024-03-28 01:12:02,066: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:12:02.114781963Z [2024-03-28 01:12:02,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:12:02.227512879Z [2024-03-28 01:12:02,227: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:12:02.829595174Z [2024-03-28 01:12:02,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92fee41b-381e-481b-b0da-4504dde652a0] succeeded in 1.7471312049992775s: None 2024-03-28T01:12:03.027486323Z [2024-03-28 01:12:03,027: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be9fc3e7-2269-4167-a058-c4bc283866d4] succeeded in 1.9325701320003645s: None 2024-03-28T01:12:03.347604546Z [2024-03-28 01:12:03,346: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:12:03.351520233Z [2024-03-28 01:12:03,351: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:12:03.428354425Z [2024-03-28 01:12:03,428: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:12:03.430895282Z [2024-03-28 01:12:03,430: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:12:03.431056632Z [2024-03-28 01:12:03,430: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:12:03.431256850Z [2024-03-28 01:12:03,431: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:12:03.431380259Z [2024-03-28 01:12:03,431: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:12:03.431709433Z [2024-03-28 01:12:03,431: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:12:03.432278128Z [2024-03-28 01:12:03,432: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:12:03.520644230Z [2024-03-28 01:12:03,520: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:12:03.575508246Z [2024-03-28 01:12:03,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:12:03.579185601Z [2024-03-28 01:12:03,578: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:12:03.622148932Z [2024-03-28 01:12:03,621: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:12:03.630630902Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:12:03.630659937Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:12:03.631252598Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:12:03.631266721Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:12:03.631271309Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:12:03.631274747Z [2024-03-28 01:12:03,630: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:12:03.763266664Z [2024-03-28 01:12:03,762: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:12:05.958251246Z [2024-03-28 01:12:05,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb732c88-a5be-457f-9c16-f1b20293ebc4] succeeded in 4.868613124999683s: None 2024-03-28T01:12:06.405011139Z [2024-03-28 01:12:06,404: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33fb937f-4a40-4e2e-82d3-d7cd3a87d880] succeeded in 5.319428030999916s: None 2024-03-28T01:13:00.948102847Z [2024-03-28 01:13:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ede6bc7-dcea-4d8e-9ecd-1230c88f2d41] received 2024-03-28T01:13:00.958957222Z [2024-03-28 01:13:00,958: INFO/ForkPoolWorker-15] [4ede6bc7-dcea-4d8e-9ecd-1230c88f2d41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:13:00.972773157Z [2024-03-28 01:13:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bff0b34-b38a-41a2-877f-3e920cf172ef] received 2024-03-28T01:13:00.979823234Z [2024-03-28 01:13:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db0e6396-0092-48f4-b200-518d8f327a27] received 2024-03-28T01:13:00.994640344Z [2024-03-28 01:13:00,994: INFO/ForkPoolWorker-16] [4bff0b34-b38a-41a2-877f-3e920cf172ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:13:00.996069064Z [2024-03-28 01:13:00,995: INFO/ForkPoolWorker-1] [db0e6396-0092-48f4-b200-518d8f327a27] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:13:01.288909749Z [2024-03-28 01:13:01,282: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:13:01.404390671Z [2024-03-28 01:13:01,399: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:13:01.442854727Z [2024-03-28 01:13:01,438: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:13:01.589590475Z [2024-03-28 01:13:01,587: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:13:01.592289828Z [2024-03-28 01:13:01,591: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:13:01.620933504Z [2024-03-28 01:13:01,619: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:13:01.620951442Z [2024-03-28 01:13:01,620: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:13:01.620975004Z [2024-03-28 01:13:01,620: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:13:01.620980314Z [2024-03-28 01:13:01,620: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:13:01.620983866Z [2024-03-28 01:13:01,620: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:13:01.721614863Z [2024-03-28 01:13:01,719: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:13:02.597714300Z [2024-03-28 01:13:02,595: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db0e6396-0092-48f4-b200-518d8f327a27] succeeded in 1.6150583880007616s: None 2024-03-28T01:13:03.101634344Z [2024-03-28 01:13:03,100: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:13:03.105768344Z [2024-03-28 01:13:03,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:13:03.145597511Z [2024-03-28 01:13:03,142: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:13:03.161721647Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:13:03.161734315Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:13:03.161741656Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:13:03.161747874Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:13:03.161752706Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:13:03.161757655Z [2024-03-28 01:13:03,150: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:13:03.173140788Z [2024-03-28 01:13:03,172: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:13:03.180817043Z [2024-03-28 01:13:03,176: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:13:03.233134883Z [2024-03-28 01:13:03,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:13:03.243806753Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:13:03.243820885Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:13:03.243826188Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:13:03.243830429Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:13:03.243833943Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:13:03.243837319Z [2024-03-28 01:13:03,240: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:13:03.361320512Z [2024-03-28 01:13:03,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:13:03.377606732Z [2024-03-28 01:13:03,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:13:05.413249911Z [2024-03-28 01:13:05,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ede6bc7-dcea-4d8e-9ecd-1230c88f2d41] succeeded in 4.461481022999578s: None 2024-03-28T01:13:05.690086593Z [2024-03-28 01:13:05,689: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4bff0b34-b38a-41a2-877f-3e920cf172ef] succeeded in 4.71081713500007s: None 2024-03-28T01:14:00.628857633Z [2024-03-28 01:14:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3bceb87-6a55-487c-8213-2810b7df6cb2] received 2024-03-28T01:14:00.632465558Z [2024-03-28 01:14:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b27ba6d7-bba3-42ac-a0a5-9a736198150e] received 2024-03-28T01:14:00.635771408Z [2024-03-28 01:14:00,635: INFO/ForkPoolWorker-15] [f3bceb87-6a55-487c-8213-2810b7df6cb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:14:00.639032726Z [2024-03-28 01:14:00,638: INFO/ForkPoolWorker-16] [b27ba6d7-bba3-42ac-a0a5-9a736198150e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:14:00.643919760Z [2024-03-28 01:14:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d4c5c08-056f-469e-867e-7f9758690cd5] received 2024-03-28T01:14:00.650051938Z [2024-03-28 01:14:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25fcb564-c35f-47de-b196-0ef2575f8c8a] received 2024-03-28T01:14:00.652315466Z [2024-03-28 01:14:00,652: INFO/ForkPoolWorker-1] [0d4c5c08-056f-469e-867e-7f9758690cd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:14:00.656272307Z [2024-03-28 01:14:00,656: INFO/ForkPoolWorker-2] [25fcb564-c35f-47de-b196-0ef2575f8c8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:14:00.980255853Z [2024-03-28 01:14:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:14:01.084975803Z [2024-03-28 01:14:01,075: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:14:01.263326278Z [2024-03-28 01:14:01,263: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:14:01.352263577Z [2024-03-28 01:14:01,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:14:01.374734078Z [2024-03-28 01:14:01,366: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:14:01.598295528Z [2024-03-28 01:14:01,597: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:14:01.603258952Z [2024-03-28 01:14:01,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:14:01.689779970Z [2024-03-28 01:14:01,688: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:14:01.696716691Z [2024-03-28 01:14:01,695: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:14:01.696730730Z [2024-03-28 01:14:01,695: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:14:01.696734361Z [2024-03-28 01:14:01,695: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:14:01.696738568Z [2024-03-28 01:14:01,695: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:14:01.846774044Z [2024-03-28 01:14:01,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:14:01.986935838Z [2024-03-28 01:14:01,986: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d4c5c08-056f-469e-867e-7f9758690cd5] succeeded in 1.340670501999739s: None 2024-03-28T01:14:02.733262980Z [2024-03-28 01:14:02,732: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b27ba6d7-bba3-42ac-a0a5-9a736198150e] succeeded in 2.0988977369997883s: None 2024-03-28T01:14:02.805170845Z [2024-03-28 01:14:02,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:14:02.808932155Z [2024-03-28 01:14:02,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:14:02.836759700Z [2024-03-28 01:14:02,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:14:02.842707017Z [2024-03-28 01:14:02,842: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:14:02.842854714Z [2024-03-28 01:14:02,842: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:14:02.843042850Z [2024-03-28 01:14:02,842: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:14:02.843138633Z [2024-03-28 01:14:02,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:14:02.843486866Z [2024-03-28 01:14:02,843: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:14:02.843580604Z [2024-03-28 01:14:02,843: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:14:02.900026108Z [2024-03-28 01:14:02,899: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:14:02.904314719Z [2024-03-28 01:14:02,903: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:14:02.928656636Z [2024-03-28 01:14:02,928: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:14:02.943033427Z [2024-03-28 01:14:02,942: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:14:02.944437267Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:14:02.944461584Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:14:02.944565063Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:14:02.944607026Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:14:02.944850662Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:14:02.944863447Z [2024-03-28 01:14:02,944: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:14:03.045990885Z [2024-03-28 01:14:03,045: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:14:04.592141998Z [2024-03-28 01:14:04,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3bceb87-6a55-487c-8213-2810b7df6cb2] succeeded in 3.9617619620003097s: None 2024-03-28T01:14:05.111617399Z [2024-03-28 01:14:05,111: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25fcb564-c35f-47de-b196-0ef2575f8c8a] succeeded in 4.460051967999789s: None 2024-03-28T01:15:00.953892315Z [2024-03-28 01:15:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d107b310-c632-41b6-a632-8b1bbc183299] received 2024-03-28T01:15:00.955896051Z [2024-03-28 01:15:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01cc4b51-34b1-4a9b-a8e2-4d134cb2fce5] received 2024-03-28T01:15:00.958516488Z [2024-03-28 01:15:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9391a262-d74c-4e79-877a-4e038bc8a619] received 2024-03-28T01:15:00.959920324Z [2024-03-28 01:15:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b68efd18-b178-40a6-b2ef-73bef1702105] received 2024-03-28T01:15:00.963294896Z [2024-03-28 01:15:00,963: INFO/ForkPoolWorker-16] [01cc4b51-34b1-4a9b-a8e2-4d134cb2fce5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:15:00.969845576Z [2024-03-28 01:15:00,969: INFO/ForkPoolWorker-2] [b68efd18-b178-40a6-b2ef-73bef1702105] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:15:00.970322454Z [2024-03-28 01:15:00,970: INFO/ForkPoolWorker-15] [d107b310-c632-41b6-a632-8b1bbc183299] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:15:00.970949863Z [2024-03-28 01:15:00,970: INFO/ForkPoolWorker-1] [9391a262-d74c-4e79-877a-4e038bc8a619] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:15:01.287026099Z [2024-03-28 01:15:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:15:01.349047615Z [2024-03-28 01:15:01,345: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:15:01.365042696Z [2024-03-28 01:15:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:15:01.408354058Z [2024-03-28 01:15:01,397: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:15:01.529643695Z [2024-03-28 01:15:01,529: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:15:01.533701931Z [2024-03-28 01:15:01,533: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:01.579225402Z [2024-03-28 01:15:01,578: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:15:01.581458225Z [2024-03-28 01:15:01,581: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:15:01.581844854Z [2024-03-28 01:15:01,581: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:15:01.582103388Z [2024-03-28 01:15:01,581: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:15:01.582492940Z [2024-03-28 01:15:01,582: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:15:01.708294533Z [2024-03-28 01:15:01,708: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:02.404356576Z [2024-03-28 01:15:02,403: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b68efd18-b178-40a6-b2ef-73bef1702105] succeeded in 1.4424940349999815s: None 2024-03-28T01:15:02.920064867Z [2024-03-28 01:15:02,919: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:15:02.923906669Z [2024-03-28 01:15:02,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:02.974787227Z [2024-03-28 01:15:02,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:15:02.978217528Z [2024-03-28 01:15:02,977: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:02.978294497Z [2024-03-28 01:15:02,978: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:02.978510438Z [2024-03-28 01:15:02,978: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:02.978626845Z [2024-03-28 01:15:02,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:15:02.979351321Z [2024-03-28 01:15:02,979: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:15:02.979438238Z [2024-03-28 01:15:02,979: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:02.985613810Z [2024-03-28 01:15:02,985: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:15:02.989725145Z [2024-03-28 01:15:02,989: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:03.021861963Z [2024-03-28 01:15:03,021: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:15:03.023914330Z [2024-03-28 01:15:03,023: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:03.024191265Z [2024-03-28 01:15:03,023: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:03.024485498Z [2024-03-28 01:15:03,024: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:03.024713612Z [2024-03-28 01:15:03,024: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:15:03.025733167Z [2024-03-28 01:15:03,025: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:15:03.027073510Z [2024-03-28 01:15:03,026: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:03.112430618Z [2024-03-28 01:15:03,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:03.134253983Z [2024-03-28 01:15:03,133: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:15:03.138026836Z [2024-03-28 01:15:03,137: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:03.147199762Z [2024-03-28 01:15:03,146: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:03.168929803Z [2024-03-28 01:15:03,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:15:03.170421988Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:03.170442222Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:03.170572354Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:03.170581871Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:15:03.170842831Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:15:03.170911899Z [2024-03-28 01:15:03,170: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:03.307340462Z [2024-03-28 01:15:03,307: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:04.124714777Z [2024-03-28 01:15:04,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d107b310-c632-41b6-a632-8b1bbc183299] succeeded in 3.1675875929995527s: None 2024-03-28T01:15:04.891777393Z [2024-03-28 01:15:04,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d5fdeea-a64c-425b-886a-14df9cae59a9] received 2024-03-28T01:15:04.918224988Z [2024-03-28 01:15:04,917: INFO/ForkPoolWorker-15] [8d5fdeea-a64c-425b-886a-14df9cae59a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:15:05.336411742Z [2024-03-28 01:15:05,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:15:05.907626377Z [2024-03-28 01:15:05,906: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01cc4b51-34b1-4a9b-a8e2-4d134cb2fce5] succeeded in 4.950273591000041s: None 2024-03-28T01:15:06.130714088Z [2024-03-28 01:15:06,130: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9391a262-d74c-4e79-877a-4e038bc8a619] succeeded in 5.169961448999857s: None 2024-03-28T01:15:06.612657631Z [2024-03-28 01:15:06,612: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:15:06.616086096Z [2024-03-28 01:15:06,615: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:06.639108120Z [2024-03-28 01:15:06,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:15:06.643257524Z [2024-03-28 01:15:06,642: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:06.643284173Z [2024-03-28 01:15:06,643: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:06.643377219Z [2024-03-28 01:15:06,643: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:06.643392207Z [2024-03-28 01:15:06,643: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:15:06.643697834Z [2024-03-28 01:15:06,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:15:06.643704742Z [2024-03-28 01:15:06,643: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:06.737065303Z [2024-03-28 01:15:06,736: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:07.582846625Z [2024-03-28 01:15:07,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d5fdeea-a64c-425b-886a-14df9cae59a9] succeeded in 2.684251647000565s: None 2024-03-28T01:15:08.612043147Z [2024-03-28 01:15:08,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c585cd98-9705-46e1-8c93-80243750d89c] received 2024-03-28T01:15:08.639627290Z [2024-03-28 01:15:08,638: INFO/ForkPoolWorker-15] [c585cd98-9705-46e1-8c93-80243750d89c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:15:08.957719800Z [2024-03-28 01:15:08,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:15:10.303690265Z [2024-03-28 01:15:10,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:15:10.307688771Z [2024-03-28 01:15:10,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:10.340567426Z [2024-03-28 01:15:10,340: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:15:10.342082106Z [2024-03-28 01:15:10,341: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:10.342340365Z [2024-03-28 01:15:10,342: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:10.342583197Z [2024-03-28 01:15:10,342: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:10.342761237Z [2024-03-28 01:15:10,342: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:15:10.343114531Z [2024-03-28 01:15:10,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:15:10.343652294Z [2024-03-28 01:15:10,343: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:10.436800595Z [2024-03-28 01:15:10,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:11.163056178Z [2024-03-28 01:15:11,159: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c585cd98-9705-46e1-8c93-80243750d89c] succeeded in 2.5380735320004533s: None 2024-03-28T01:15:12.128354697Z [2024-03-28 01:15:12,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49080bd5-8808-4bfb-9888-5cad52f4a605] received 2024-03-28T01:15:12.139066157Z [2024-03-28 01:15:12,138: INFO/ForkPoolWorker-15] [49080bd5-8808-4bfb-9888-5cad52f4a605] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:15:12.418895445Z [2024-03-28 01:15:12,415: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:15:13.645391186Z [2024-03-28 01:15:13,645: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:15:13.648983061Z [2024-03-28 01:15:13,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:15:13.678990350Z [2024-03-28 01:15:13,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:15:13.680262457Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:15:13.680289213Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:15:13.680425454Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:15:13.680480751Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:15:13.680781059Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:15:13.680940996Z [2024-03-28 01:15:13,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:15:13.763293379Z [2024-03-28 01:15:13,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:15:14.304612411Z [2024-03-28 01:15:14,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49080bd5-8808-4bfb-9888-5cad52f4a605] succeeded in 2.171602698999777s: None 2024-03-28T01:16:01.122677488Z [2024-03-28 01:16:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ec24cb3-7c0b-4371-be66-5ce5caee9768] received 2024-03-28T01:16:01.126154799Z [2024-03-28 01:16:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1c1b57d-e324-4f0d-a3e8-07139461fcae] received 2024-03-28T01:16:01.130230400Z [2024-03-28 01:16:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8750e377-aabb-4458-aa5e-e4ace48dc6de] received 2024-03-28T01:16:01.133164822Z [2024-03-28 01:16:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c11ff7e-ee6e-4b6a-93a8-63b321a39a94] received 2024-03-28T01:16:01.138151048Z [2024-03-28 01:16:01,137: INFO/ForkPoolWorker-15] [0ec24cb3-7c0b-4371-be66-5ce5caee9768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:16:01.140966314Z [2024-03-28 01:16:01,140: INFO/ForkPoolWorker-16] [c1c1b57d-e324-4f0d-a3e8-07139461fcae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:16:01.143513629Z [2024-03-28 01:16:01,143: INFO/ForkPoolWorker-2] [7c11ff7e-ee6e-4b6a-93a8-63b321a39a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:16:01.146737540Z [2024-03-28 01:16:01,146: INFO/ForkPoolWorker-1] [8750e377-aabb-4458-aa5e-e4ace48dc6de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:16:01.559987999Z [2024-03-28 01:16:01,556: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:16:01.681237831Z [2024-03-28 01:16:01,673: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:16:01.766652893Z [2024-03-28 01:16:01,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:16:01.832898502Z [2024-03-28 01:16:01,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:16:01.903593837Z [2024-03-28 01:16:01,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:16:01.908658793Z [2024-03-28 01:16:01,908: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:16:01.913292014Z [2024-03-28 01:16:01,912: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:16:01.941879367Z [2024-03-28 01:16:01,941: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:16:01.943858238Z [2024-03-28 01:16:01,943: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:16:01.943922335Z [2024-03-28 01:16:01,943: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:16:01.943928127Z [2024-03-28 01:16:01,943: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:16:01.944249449Z [2024-03-28 01:16:01,944: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:16:02.081365999Z [2024-03-28 01:16:02,081: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:16:02.674334268Z [2024-03-28 01:16:02,673: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1c1b57d-e324-4f0d-a3e8-07139461fcae] succeeded in 1.5439607369999067s: None 2024-03-28T01:16:02.930605321Z [2024-03-28 01:16:02,930: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c11ff7e-ee6e-4b6a-93a8-63b321a39a94] succeeded in 1.7952441490006095s: None 2024-03-28T01:16:03.352247809Z [2024-03-28 01:16:03,351: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:16:03.355957382Z [2024-03-28 01:16:03,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:16:03.388949093Z [2024-03-28 01:16:03,388: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:16:03.391432415Z [2024-03-28 01:16:03,391: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:16:03.391738470Z [2024-03-28 01:16:03,391: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:16:03.391979298Z [2024-03-28 01:16:03,391: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:16:03.392119332Z [2024-03-28 01:16:03,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:16:03.392631393Z [2024-03-28 01:16:03,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:16:03.392801511Z [2024-03-28 01:16:03,392: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:16:03.441050557Z [2024-03-28 01:16:03,440: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:16:03.444583988Z [2024-03-28 01:16:03,444: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:16:03.473807044Z [2024-03-28 01:16:03,473: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:16:03.475573932Z [2024-03-28 01:16:03,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:16:03.481443213Z [2024-03-28 01:16:03,480: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:16:03.481465031Z [2024-03-28 01:16:03,480: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:16:03.481469616Z [2024-03-28 01:16:03,480: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:16:03.481510870Z [2024-03-28 01:16:03,480: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:16:03.481516201Z [2024-03-28 01:16:03,481: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:16:03.483169371Z [2024-03-28 01:16:03,481: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:16:03.602387561Z [2024-03-28 01:16:03,602: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:16:05.163033822Z [2024-03-28 01:16:05,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ec24cb3-7c0b-4371-be66-5ce5caee9768] succeeded in 4.037667165999665s: None 2024-03-28T01:16:05.774246749Z [2024-03-28 01:16:05,773: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8750e377-aabb-4458-aa5e-e4ace48dc6de] succeeded in 4.641849511000146s: None 2024-03-28T01:17:00.199680126Z [2024-03-28 01:17:00,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d149d0d-b340-4a05-88df-e84836334653] received 2024-03-28T01:17:00.202312766Z [2024-03-28 01:17:00,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5750244-a51b-4e37-9524-0cfefe525920] received 2024-03-28T01:17:00.205587898Z [2024-03-28 01:17:00,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[368765c6-44ef-48db-8846-3402f8210221] received 2024-03-28T01:17:00.213370897Z [2024-03-28 01:17:00,212: INFO/ForkPoolWorker-15] [0d149d0d-b340-4a05-88df-e84836334653] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:17:00.215790903Z [2024-03-28 01:17:00,215: INFO/ForkPoolWorker-16] [b5750244-a51b-4e37-9524-0cfefe525920] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:17:00.216539130Z [2024-03-28 01:17:00,216: INFO/ForkPoolWorker-1] [368765c6-44ef-48db-8846-3402f8210221] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:17:00.499128771Z [2024-03-28 01:17:00,495: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:17:00.501107658Z [2024-03-28 01:17:00,497: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:17:00.608993135Z [2024-03-28 01:17:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:17:00.657855585Z [2024-03-28 01:17:00,657: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:17:00.661959912Z [2024-03-28 01:17:00,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:17:00.694547268Z [2024-03-28 01:17:00,694: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:17:00.696781384Z [2024-03-28 01:17:00,696: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:17:00.697190846Z [2024-03-28 01:17:00,696: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:17:00.697530975Z [2024-03-28 01:17:00,697: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:17:00.698211865Z [2024-03-28 01:17:00,697: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:17:00.795616333Z [2024-03-28 01:17:00,795: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:17:01.472573721Z [2024-03-28 01:17:01,472: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5750244-a51b-4e37-9524-0cfefe525920] succeeded in 1.2688162820004436s: None 2024-03-28T01:17:01.837839299Z [2024-03-28 01:17:01,837: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:17:01.841802612Z [2024-03-28 01:17:01,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:17:01.852422096Z [2024-03-28 01:17:01,852: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:17:01.856147162Z [2024-03-28 01:17:01,855: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:17:01.861098776Z [2024-03-28 01:17:01,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:17:01.862629587Z [2024-03-28 01:17:01,862: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:17:01.862784395Z [2024-03-28 01:17:01,862: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:17:01.863061876Z [2024-03-28 01:17:01,862: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:17:01.863088955Z [2024-03-28 01:17:01,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:17:01.863456348Z [2024-03-28 01:17:01,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:17:01.863532888Z [2024-03-28 01:17:01,863: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:17:01.877044022Z [2024-03-28 01:17:01,876: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:17:01.879033789Z [2024-03-28 01:17:01,878: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:17:01.879051914Z [2024-03-28 01:17:01,878: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:17:01.879220032Z [2024-03-28 01:17:01,878: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:17:01.879263731Z [2024-03-28 01:17:01,879: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:17:01.879584593Z [2024-03-28 01:17:01,879: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:17:01.879730130Z [2024-03-28 01:17:01,879: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:17:01.979617213Z [2024-03-28 01:17:01,979: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:17:01.982574257Z [2024-03-28 01:17:01,982: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:17:03.499976933Z [2024-03-28 01:17:03,499: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[368765c6-44ef-48db-8846-3402f8210221] succeeded in 3.2926531090006392s: None 2024-03-28T01:17:03.892405941Z [2024-03-28 01:17:03,891: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d149d0d-b340-4a05-88df-e84836334653] succeeded in 3.687143901000127s: None 2024-03-28T01:18:00.824133196Z [2024-03-28 01:18:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bcca64b-e0f3-439d-8d60-c38c97f695f0] received 2024-03-28T01:18:00.826197377Z [2024-03-28 01:18:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d55935f6-0869-41de-a56b-219078f68796] received 2024-03-28T01:18:00.829060097Z [2024-03-28 01:18:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d77b55d-b192-4dd5-8933-caac72025e19] received 2024-03-28T01:18:00.831492477Z [2024-03-28 01:18:00,831: INFO/ForkPoolWorker-15] [1bcca64b-e0f3-439d-8d60-c38c97f695f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:18:00.833637968Z [2024-03-28 01:18:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1b98190-5d1c-475c-873a-a38481e7a903] received 2024-03-28T01:18:00.836578176Z [2024-03-28 01:18:00,836: INFO/ForkPoolWorker-16] [d55935f6-0869-41de-a56b-219078f68796] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:18:00.842808435Z [2024-03-28 01:18:00,842: INFO/ForkPoolWorker-1] [1d77b55d-b192-4dd5-8933-caac72025e19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:18:00.857631643Z [2024-03-28 01:18:00,857: INFO/ForkPoolWorker-2] [a1b98190-5d1c-475c-873a-a38481e7a903] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:18:01.137435493Z [2024-03-28 01:18:01,134: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:18:01.176534156Z [2024-03-28 01:18:01,173: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:18:01.220971156Z [2024-03-28 01:18:01,216: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:18:01.431258719Z [2024-03-28 01:18:01,420: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:18:01.444488611Z [2024-03-28 01:18:01,444: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:18:01.448534676Z [2024-03-28 01:18:01,448: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:18:01.484623555Z [2024-03-28 01:18:01,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:18:01.490531182Z [2024-03-28 01:18:01,490: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:18:01.498320588Z [2024-03-28 01:18:01,497: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:18:01.498527696Z [2024-03-28 01:18:01,498: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:18:01.498779669Z [2024-03-28 01:18:01,498: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:18:01.499197115Z [2024-03-28 01:18:01,498: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:18:01.666994859Z [2024-03-28 01:18:01,666: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:18:02.220006921Z [2024-03-28 01:18:02,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bcca64b-e0f3-439d-8d60-c38c97f695f0] succeeded in 1.3941382849998263s: None 2024-03-28T01:18:02.422256571Z [2024-03-28 01:18:02,421: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a1b98190-5d1c-475c-873a-a38481e7a903] succeeded in 1.5815974899996945s: None 2024-03-28T01:18:02.574574934Z [2024-03-28 01:18:02,574: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:18:02.578614799Z [2024-03-28 01:18:02,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:18:02.608155306Z [2024-03-28 01:18:02,607: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:18:02.609996097Z [2024-03-28 01:18:02,609: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:18:02.610251563Z [2024-03-28 01:18:02,610: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:18:02.610591557Z [2024-03-28 01:18:02,610: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:18:02.610812984Z [2024-03-28 01:18:02,610: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:18:02.611181063Z [2024-03-28 01:18:02,611: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:18:02.611347747Z [2024-03-28 01:18:02,611: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:18:02.735749219Z [2024-03-28 01:18:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:18:02.889370125Z [2024-03-28 01:18:02,888: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:18:02.893227031Z [2024-03-28 01:18:02,892: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:18:02.917523770Z [2024-03-28 01:18:02,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:18:02.919511905Z [2024-03-28 01:18:02,919: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:18:02.919818853Z [2024-03-28 01:18:02,919: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:18:02.920244029Z [2024-03-28 01:18:02,919: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:18:02.920450780Z [2024-03-28 01:18:02,920: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:18:02.920954823Z [2024-03-28 01:18:02,920: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:18:02.921164094Z [2024-03-28 01:18:02,921: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:18:03.020329103Z [2024-03-28 01:18:03,020: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:18:04.431810017Z [2024-03-28 01:18:04,431: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d55935f6-0869-41de-a56b-219078f68796] succeeded in 3.603246671999841s: None 2024-03-28T01:18:05.044518318Z [2024-03-28 01:18:05,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d77b55d-b192-4dd5-8933-caac72025e19] succeeded in 4.212310648999846s: None 2024-03-28T01:19:00.555766233Z [2024-03-28 01:19:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a368f83-2618-4089-9312-116521296870] received 2024-03-28T01:19:00.558605505Z [2024-03-28 01:19:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ff5ee02-9720-4efa-9b04-bd8b9ebe248f] received 2024-03-28T01:19:00.562900759Z [2024-03-28 01:19:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cca8576b-8eba-46b5-942d-54dd9290cfba] received 2024-03-28T01:19:00.564659266Z [2024-03-28 01:19:00,564: INFO/ForkPoolWorker-15] [4a368f83-2618-4089-9312-116521296870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:19:00.566196151Z [2024-03-28 01:19:00,565: INFO/ForkPoolWorker-16] [2ff5ee02-9720-4efa-9b04-bd8b9ebe248f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:19:00.576524686Z [2024-03-28 01:19:00,576: INFO/ForkPoolWorker-1] [cca8576b-8eba-46b5-942d-54dd9290cfba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:19:00.885069679Z [2024-03-28 01:19:00,879: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:19:01.044883876Z [2024-03-28 01:19:01,041: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:19:01.047179419Z [2024-03-28 01:19:01,042: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:19:01.224715036Z [2024-03-28 01:19:01,224: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:19:01.229263387Z [2024-03-28 01:19:01,228: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:19:01.264309684Z [2024-03-28 01:19:01,263: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:19:01.266582063Z [2024-03-28 01:19:01,266: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:19:01.266838761Z [2024-03-28 01:19:01,266: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:19:01.266871313Z [2024-03-28 01:19:01,266: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:19:01.267260103Z [2024-03-28 01:19:01,266: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:19:01.399925374Z [2024-03-28 01:19:01,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:19:02.119527628Z [2024-03-28 01:19:02,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cca8576b-8eba-46b5-942d-54dd9290cfba] succeeded in 1.5501336379993518s: None 2024-03-28T01:19:02.274574388Z [2024-03-28 01:19:02,274: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:19:02.278693440Z [2024-03-28 01:19:02,278: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:19:02.300754261Z [2024-03-28 01:19:02,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:19:02.302332076Z [2024-03-28 01:19:02,302: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:19:02.302461095Z [2024-03-28 01:19:02,302: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:19:02.302812115Z [2024-03-28 01:19:02,302: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:19:02.302931521Z [2024-03-28 01:19:02,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:19:02.303339328Z [2024-03-28 01:19:02,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:19:02.303498623Z [2024-03-28 01:19:02,303: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:19:02.317221425Z [2024-03-28 01:19:02,316: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:19:02.321072588Z [2024-03-28 01:19:02,320: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:19:02.346934225Z [2024-03-28 01:19:02,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:19:02.349978891Z [2024-03-28 01:19:02,349: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:19:02.350026677Z [2024-03-28 01:19:02,349: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:19:02.350177065Z [2024-03-28 01:19:02,349: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:19:02.350303277Z [2024-03-28 01:19:02,350: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:19:02.350674623Z [2024-03-28 01:19:02,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:19:02.350788506Z [2024-03-28 01:19:02,350: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:19:02.415114078Z [2024-03-28 01:19:02,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:19:02.451524389Z [2024-03-28 01:19:02,451: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:19:03.983461298Z [2024-03-28 01:19:03,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ff5ee02-9720-4efa-9b04-bd8b9ebe248f] succeeded in 3.423000647999288s: None 2024-03-28T01:19:04.255632816Z [2024-03-28 01:19:04,255: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a368f83-2618-4089-9312-116521296870] succeeded in 3.6980944799997815s: None 2024-03-28T01:20:00.888295690Z [2024-03-28 01:20:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23febb59-f6bc-4228-bf46-36171f739ed7] received 2024-03-28T01:20:00.891380432Z [2024-03-28 01:20:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[560a55d5-36ea-4a37-be03-954b3d06a998] received 2024-03-28T01:20:00.892972708Z [2024-03-28 01:20:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3787da1-f80f-44df-91bc-a9aa7f02714a] received 2024-03-28T01:20:00.896366487Z [2024-03-28 01:20:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4441ae35-96c1-43fc-86fe-08b612a1ae9e] received 2024-03-28T01:20:00.899100745Z [2024-03-28 01:20:00,898: INFO/ForkPoolWorker-15] [23febb59-f6bc-4228-bf46-36171f739ed7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:20:00.903337065Z [2024-03-28 01:20:00,902: INFO/ForkPoolWorker-16] [560a55d5-36ea-4a37-be03-954b3d06a998] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:20:00.903837332Z [2024-03-28 01:20:00,903: INFO/ForkPoolWorker-1] [b3787da1-f80f-44df-91bc-a9aa7f02714a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:20:00.909430873Z [2024-03-28 01:20:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8551185c-43a4-44b9-a969-1120c09fd2ce] received 2024-03-28T01:20:00.915265797Z [2024-03-28 01:20:00,914: INFO/ForkPoolWorker-2] [4441ae35-96c1-43fc-86fe-08b612a1ae9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:20:00.923376180Z [2024-03-28 01:20:00,922: INFO/ForkPoolWorker-3] [8551185c-43a4-44b9-a969-1120c09fd2ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:20:01.290688868Z [2024-03-28 01:20:01,286: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:20:01.296974376Z [2024-03-28 01:20:01,293: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:20:01.382069645Z [2024-03-28 01:20:01,377: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:20:01.559070114Z [2024-03-28 01:20:01,558: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T01:20:01.565930302Z [2024-03-28 01:20:01,565: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:01.604482265Z [2024-03-28 01:20:01,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:20:01.608550626Z [2024-03-28 01:20:01,607: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:20:01.619534711Z [2024-03-28 01:20:01,618: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:20:01.623968357Z [2024-03-28 01:20:01,623: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:20:01.624270551Z [2024-03-28 01:20:01,624: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T01:20:01.624835970Z [2024-03-28 01:20:01,624: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:20:01.647860322Z [2024-03-28 01:20:01,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:20:01.936709820Z [2024-03-28 01:20:01,936: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:02.149406663Z [2024-03-28 01:20:02,149: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:02.837266950Z [2024-03-28 01:20:02,836: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8551185c-43a4-44b9-a969-1120c09fd2ce] succeeded in 1.925023009999677s: None 2024-03-28T01:20:03.056369977Z [2024-03-28 01:20:03,055: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4441ae35-96c1-43fc-86fe-08b612a1ae9e] succeeded in 2.1561006729998553s: None 2024-03-28T01:20:03.288741083Z [2024-03-28 01:20:03,288: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:20:03.292568979Z [2024-03-28 01:20:03,291: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:03.317168921Z [2024-03-28 01:20:03,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:20:03.318554059Z [2024-03-28 01:20:03,318: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:03.318581598Z [2024-03-28 01:20:03,318: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:03.318712380Z [2024-03-28 01:20:03,318: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:03.318896685Z [2024-03-28 01:20:03,318: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:20:03.319341551Z [2024-03-28 01:20:03,319: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:20:03.319364510Z [2024-03-28 01:20:03,319: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:03.413700283Z [2024-03-28 01:20:03,410: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:20:03.421307051Z [2024-03-28 01:20:03,414: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:03.438176043Z [2024-03-28 01:20:03,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:20:03.451647531Z [2024-03-28 01:20:03,451: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:03.471119935Z [2024-03-28 01:20:03,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:20:03.475828892Z [2024-03-28 01:20:03,475: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:03.475960886Z [2024-03-28 01:20:03,475: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:03.476189616Z [2024-03-28 01:20:03,475: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:03.476270038Z [2024-03-28 01:20:03,476: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:20:03.476674644Z [2024-03-28 01:20:03,476: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:20:03.476827952Z [2024-03-28 01:20:03,476: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:03.481892198Z [2024-03-28 01:20:03,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:20:03.483320526Z [2024-03-28 01:20:03,483: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:03.483490351Z [2024-03-28 01:20:03,483: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:03.483742034Z [2024-03-28 01:20:03,483: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:03.483876577Z [2024-03-28 01:20:03,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:20:03.484197345Z [2024-03-28 01:20:03,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:20:03.484844508Z [2024-03-28 01:20:03,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:03.559569303Z [2024-03-28 01:20:03,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:03.605381317Z [2024-03-28 01:20:03,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:03.622818288Z [2024-03-28 01:20:03,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:04.408549626Z [2024-03-28 01:20:04,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[755e6b2e-3e80-4af5-8c51-259b1b084a32] received 2024-03-28T01:20:04.417931046Z [2024-03-28 01:20:04,417: INFO/ForkPoolWorker-2] [755e6b2e-3e80-4af5-8c51-259b1b084a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:20:04.427077664Z [2024-03-28 01:20:04,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23febb59-f6bc-4228-bf46-36171f739ed7] succeeded in 3.5329130899999655s: None 2024-03-28T01:20:04.698436238Z [2024-03-28 01:20:04,695: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:20:05.231531670Z [2024-03-28 01:20:05,231: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[560a55d5-36ea-4a37-be03-954b3d06a998] succeeded in 4.337101781999991s: None 2024-03-28T01:20:05.861084347Z [2024-03-28 01:20:05,860: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:20:05.864337270Z [2024-03-28 01:20:05,863: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:05.887387585Z [2024-03-28 01:20:05,887: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:20:05.888871928Z [2024-03-28 01:20:05,888: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:05.888895397Z [2024-03-28 01:20:05,888: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:05.889051260Z [2024-03-28 01:20:05,888: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:05.889100185Z [2024-03-28 01:20:05,888: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:20:05.889668909Z [2024-03-28 01:20:05,889: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:20:05.889694326Z [2024-03-28 01:20:05,889: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:05.975744431Z [2024-03-28 01:20:05,975: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:06.256338601Z [2024-03-28 01:20:06,255: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3787da1-f80f-44df-91bc-a9aa7f02714a] succeeded in 5.359900555999957s: None 2024-03-28T01:20:06.559518011Z [2024-03-28 01:20:06,559: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[755e6b2e-3e80-4af5-8c51-259b1b084a32] succeeded in 2.1489336690001437s: None 2024-03-28T01:20:06.813151808Z [2024-03-28 01:20:06,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[572a4b30-3d2d-4f33-83d0-6fab748af816] received 2024-03-28T01:20:06.826327758Z [2024-03-28 01:20:06,826: INFO/ForkPoolWorker-15] [572a4b30-3d2d-4f33-83d0-6fab748af816] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:20:07.129607019Z [2024-03-28 01:20:07,122: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:20:08.627816405Z [2024-03-28 01:20:08,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:20:08.631459780Z [2024-03-28 01:20:08,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:08.648049847Z [2024-03-28 01:20:08,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:20:08.650076597Z [2024-03-28 01:20:08,649: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:08.650397293Z [2024-03-28 01:20:08,650: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:08.650721492Z [2024-03-28 01:20:08,650: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:08.651057999Z [2024-03-28 01:20:08,650: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:20:08.651724062Z [2024-03-28 01:20:08,651: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:20:08.651950000Z [2024-03-28 01:20:08,651: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:08.752076730Z [2024-03-28 01:20:08,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:09.332221987Z [2024-03-28 01:20:09,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[572a4b30-3d2d-4f33-83d0-6fab748af816] succeeded in 2.5161346830000184s: None 2024-03-28T01:20:10.283521347Z [2024-03-28 01:20:10,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4b987a4-5f7a-493d-a869-5655d62ed949] received 2024-03-28T01:20:10.302498926Z [2024-03-28 01:20:10,302: INFO/ForkPoolWorker-15] [f4b987a4-5f7a-493d-a869-5655d62ed949] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:20:10.649792494Z [2024-03-28 01:20:10,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:20:12.049224201Z [2024-03-28 01:20:12,048: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:20:12.052807233Z [2024-03-28 01:20:12,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:20:12.071538486Z [2024-03-28 01:20:12,071: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:20:12.072786860Z [2024-03-28 01:20:12,072: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:20:12.072803241Z [2024-03-28 01:20:12,072: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:20:12.072943942Z [2024-03-28 01:20:12,072: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:20:12.072952603Z [2024-03-28 01:20:12,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:20:12.073160691Z [2024-03-28 01:20:12,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:20:12.073175488Z [2024-03-28 01:20:12,073: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:20:12.148761778Z [2024-03-28 01:20:12,148: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:20:12.702212870Z [2024-03-28 01:20:12,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4b987a4-5f7a-493d-a869-5655d62ed949] succeeded in 2.413877285000126s: None 2024-03-28T01:21:01.061590830Z [2024-03-28 01:21:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce404470-a055-40e2-844d-ff2af93fc423] received 2024-03-28T01:21:01.063182546Z [2024-03-28 01:21:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92fcce3a-44bf-4720-8ebd-d58f68682d37] received 2024-03-28T01:21:01.069401699Z [2024-03-28 01:21:01,069: INFO/ForkPoolWorker-16] [92fcce3a-44bf-4720-8ebd-d58f68682d37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:21:01.069907332Z [2024-03-28 01:21:01,069: INFO/ForkPoolWorker-15] [ce404470-a055-40e2-844d-ff2af93fc423] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:21:01.073779979Z [2024-03-28 01:21:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7582742-adb8-438c-9214-fcddb6db61cf] received 2024-03-28T01:21:01.079935586Z [2024-03-28 01:21:01,079: INFO/ForkPoolWorker-1] [e7582742-adb8-438c-9214-fcddb6db61cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:21:01.382968100Z [2024-03-28 01:21:01,379: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:21:01.419880861Z [2024-03-28 01:21:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:21:01.422906232Z [2024-03-28 01:21:01,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:21:01.552740447Z [2024-03-28 01:21:01,552: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:21:01.556883251Z [2024-03-28 01:21:01,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:21:01.582569783Z [2024-03-28 01:21:01,582: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:21:01.586577573Z [2024-03-28 01:21:01,586: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:21:01.586793064Z [2024-03-28 01:21:01,586: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:21:01.586945909Z [2024-03-28 01:21:01,586: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:21:01.587285765Z [2024-03-28 01:21:01,587: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:21:01.677654934Z [2024-03-28 01:21:01,677: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:21:02.376125862Z [2024-03-28 01:21:02,375: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7582742-adb8-438c-9214-fcddb6db61cf] succeeded in 1.3008656430001793s: None 2024-03-28T01:21:02.664178161Z [2024-03-28 01:21:02,663: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:21:02.667902554Z [2024-03-28 01:21:02,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:21:02.702246963Z [2024-03-28 01:21:02,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:21:02.705464877Z [2024-03-28 01:21:02,704: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:21:02.705988588Z [2024-03-28 01:21:02,705: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:21:02.706298853Z [2024-03-28 01:21:02,706: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:21:02.706547336Z [2024-03-28 01:21:02,706: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:21:02.707023879Z [2024-03-28 01:21:02,706: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:21:02.707252899Z [2024-03-28 01:21:02,707: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:21:02.757396445Z [2024-03-28 01:21:02,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:21:02.761162701Z [2024-03-28 01:21:02,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:21:02.782274484Z [2024-03-28 01:21:02,782: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:21:02.783662892Z [2024-03-28 01:21:02,783: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:21:02.783791241Z [2024-03-28 01:21:02,783: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:21:02.783975675Z [2024-03-28 01:21:02,783: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:21:02.784039726Z [2024-03-28 01:21:02,783: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:21:02.784311438Z [2024-03-28 01:21:02,784: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:21:02.784418803Z [2024-03-28 01:21:02,784: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:21:02.813085992Z [2024-03-28 01:21:02,812: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:21:02.878690806Z [2024-03-28 01:21:02,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:21:04.360706985Z [2024-03-28 01:21:04,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce404470-a055-40e2-844d-ff2af93fc423] succeeded in 3.296563074000005s: None 2024-03-28T01:21:04.628791770Z [2024-03-28 01:21:04,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[92fcce3a-44bf-4720-8ebd-d58f68682d37] succeeded in 3.5643661650001377s: None 2024-03-28T01:22:00.199899397Z [2024-03-28 01:22:00,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5132f734-c435-4f22-bf59-93641c91ee5d] received 2024-03-28T01:22:00.201538255Z [2024-03-28 01:22:00,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d9733aa-dd04-4c4a-8492-4a23839e612c] received 2024-03-28T01:22:00.204542536Z [2024-03-28 01:22:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c60a045b-77e4-41ba-96ed-731ff9db1f48] received 2024-03-28T01:22:00.208898426Z [2024-03-28 01:22:00,208: INFO/ForkPoolWorker-15] [5132f734-c435-4f22-bf59-93641c91ee5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:22:00.211931772Z [2024-03-28 01:22:00,211: INFO/ForkPoolWorker-1] [c60a045b-77e4-41ba-96ed-731ff9db1f48] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:22:00.211949463Z [2024-03-28 01:22:00,211: INFO/ForkPoolWorker-16] [2d9733aa-dd04-4c4a-8492-4a23839e612c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:22:00.212164833Z [2024-03-28 01:22:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad971323-b24a-4785-bc73-b29a2f51ec7d] received 2024-03-28T01:22:00.223568947Z [2024-03-28 01:22:00,223: INFO/ForkPoolWorker-2] [ad971323-b24a-4785-bc73-b29a2f51ec7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:22:00.502297483Z [2024-03-28 01:22:00,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:22:00.568338143Z [2024-03-28 01:22:00,564: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:22:00.576516985Z [2024-03-28 01:22:00,573: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:22:00.634455603Z [2024-03-28 01:22:00,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:22:00.769032153Z [2024-03-28 01:22:00,768: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:22:00.773345080Z [2024-03-28 01:22:00,772: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:22:00.815173367Z [2024-03-28 01:22:00,814: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:22:00.818428641Z [2024-03-28 01:22:00,818: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:22:00.818669308Z [2024-03-28 01:22:00,818: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:22:00.818848789Z [2024-03-28 01:22:00,818: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:22:00.819147809Z [2024-03-28 01:22:00,819: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:22:00.909303598Z [2024-03-28 01:22:00,909: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:22:00.974413508Z [2024-03-28 01:22:00,969: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:22:01.842913510Z [2024-03-28 01:22:01,842: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c60a045b-77e4-41ba-96ed-731ff9db1f48] succeeded in 1.636672902999635s: None 2024-03-28T01:22:01.960478087Z [2024-03-28 01:22:01,959: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ad971323-b24a-4785-bc73-b29a2f51ec7d] succeeded in 1.746712830999968s: None 2024-03-28T01:22:02.294272417Z [2024-03-28 01:22:02,293: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:22:02.298162900Z [2024-03-28 01:22:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:22:02.326897177Z [2024-03-28 01:22:02,326: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:22:02.329030788Z [2024-03-28 01:22:02,328: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:22:02.329254711Z [2024-03-28 01:22:02,328: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:22:02.329544104Z [2024-03-28 01:22:02,329: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:22:02.329778201Z [2024-03-28 01:22:02,329: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:22:02.330142767Z [2024-03-28 01:22:02,329: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:22:02.330347324Z [2024-03-28 01:22:02,330: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:22:02.412848016Z [2024-03-28 01:22:02,412: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:22:02.417065911Z [2024-03-28 01:22:02,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:22:02.439386361Z [2024-03-28 01:22:02,439: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:22:02.454348941Z [2024-03-28 01:22:02,454: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:22:02.458025801Z [2024-03-28 01:22:02,457: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:22:02.458344984Z [2024-03-28 01:22:02,457: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:22:02.458521009Z [2024-03-28 01:22:02,458: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:22:02.458649434Z [2024-03-28 01:22:02,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:22:02.459349407Z [2024-03-28 01:22:02,459: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:22:02.459445141Z [2024-03-28 01:22:02,459: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:22:02.565519267Z [2024-03-28 01:22:02,565: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:22:04.183179198Z [2024-03-28 01:22:04,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5132f734-c435-4f22-bf59-93641c91ee5d] succeeded in 3.981891824999366s: None 2024-03-28T01:22:04.267559482Z [2024-03-28 01:22:04,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d9733aa-dd04-4c4a-8492-4a23839e612c] succeeded in 4.0626954190001925s: None 2024-03-28T01:23:00.436204456Z [2024-03-28 01:23:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f189823-7e1f-460e-b6e6-588287ddf77b] received 2024-03-28T01:23:00.439001228Z [2024-03-28 01:23:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c68b108-390e-42e3-b9f4-6407b2539030] received 2024-03-28T01:23:00.447293976Z [2024-03-28 01:23:00,446: INFO/ForkPoolWorker-16] [6c68b108-390e-42e3-b9f4-6407b2539030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:23:00.448191537Z [2024-03-28 01:23:00,447: INFO/ForkPoolWorker-15] [1f189823-7e1f-460e-b6e6-588287ddf77b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:23:00.451808148Z [2024-03-28 01:23:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c75a032d-b727-4121-a06b-1639c11af7a0] received 2024-03-28T01:23:00.460044958Z [2024-03-28 01:23:00,459: INFO/ForkPoolWorker-1] [c75a032d-b727-4121-a06b-1639c11af7a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:23:00.744194618Z [2024-03-28 01:23:00,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:23:00.765890443Z [2024-03-28 01:23:00,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:23:00.778448646Z [2024-03-28 01:23:00,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:23:00.945285627Z [2024-03-28 01:23:00,944: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:23:00.949277338Z [2024-03-28 01:23:00,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:23:00.967788290Z [2024-03-28 01:23:00,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:23:00.969223894Z [2024-03-28 01:23:00,968: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:23:00.969537085Z [2024-03-28 01:23:00,969: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:23:00.969820391Z [2024-03-28 01:23:00,969: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:23:00.970354267Z [2024-03-28 01:23:00,970: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:23:01.091129834Z [2024-03-28 01:23:01,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:23:01.803721571Z [2024-03-28 01:23:01,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f189823-7e1f-460e-b6e6-588287ddf77b] succeeded in 1.362096181999732s: None 2024-03-28T01:23:02.038112082Z [2024-03-28 01:23:02,037: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:23:02.044159442Z [2024-03-28 01:23:02,043: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:23:02.067390240Z [2024-03-28 01:23:02,067: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:23:02.069661898Z [2024-03-28 01:23:02,069: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:23:02.069821086Z [2024-03-28 01:23:02,069: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:23:02.070002667Z [2024-03-28 01:23:02,069: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:23:02.070079631Z [2024-03-28 01:23:02,069: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:23:02.070486022Z [2024-03-28 01:23:02,070: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:23:02.070545521Z [2024-03-28 01:23:02,070: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:23:02.194994236Z [2024-03-28 01:23:02,194: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:23:02.300958580Z [2024-03-28 01:23:02,300: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:23:02.304752436Z [2024-03-28 01:23:02,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:23:02.341680701Z [2024-03-28 01:23:02,341: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:23:02.345199514Z [2024-03-28 01:23:02,344: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:23:02.345418017Z [2024-03-28 01:23:02,345: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:23:02.345848214Z [2024-03-28 01:23:02,345: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:23:02.346570287Z [2024-03-28 01:23:02,345: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:23:02.346719110Z [2024-03-28 01:23:02,346: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:23:02.346960922Z [2024-03-28 01:23:02,346: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:23:02.459210685Z [2024-03-28 01:23:02,458: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:23:03.785083239Z [2024-03-28 01:23:03,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c68b108-390e-42e3-b9f4-6407b2539030] succeeded in 3.344102832000317s: None 2024-03-28T01:23:04.375790483Z [2024-03-28 01:23:04,375: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c75a032d-b727-4121-a06b-1639c11af7a0] succeeded in 3.922590418999789s: None 2024-03-28T01:24:01.265711418Z [2024-03-28 01:24:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fce49133-c452-4fc9-a04d-688f87b785c7] received 2024-03-28T01:24:01.269184171Z [2024-03-28 01:24:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea2f9277-a212-4274-99df-60a4e84538af] received 2024-03-28T01:24:01.274451066Z [2024-03-28 01:24:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abb74e3a-1665-48da-b170-0e2b882775e1] received 2024-03-28T01:24:01.276798698Z [2024-03-28 01:24:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db727648-57d9-4764-8568-6c19bcefa33d] received 2024-03-28T01:24:01.278069340Z [2024-03-28 01:24:01,277: INFO/ForkPoolWorker-16] [ea2f9277-a212-4274-99df-60a4e84538af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:24:01.282246919Z [2024-03-28 01:24:01,282: INFO/ForkPoolWorker-1] [abb74e3a-1665-48da-b170-0e2b882775e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:24:01.303620507Z [2024-03-28 01:24:01,303: INFO/ForkPoolWorker-2] [db727648-57d9-4764-8568-6c19bcefa33d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:24:01.308165830Z [2024-03-28 01:24:01,307: INFO/ForkPoolWorker-15] [fce49133-c452-4fc9-a04d-688f87b785c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:24:01.615541895Z [2024-03-28 01:24:01,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:24:01.664304628Z [2024-03-28 01:24:01,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:24:01.666374496Z [2024-03-28 01:24:01,662: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:24:01.864808681Z [2024-03-28 01:24:01,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:24:01.893403605Z [2024-03-28 01:24:01,892: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:24:01.898529063Z [2024-03-28 01:24:01,898: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:24:01.940422557Z [2024-03-28 01:24:01,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:24:01.945293058Z [2024-03-28 01:24:01,945: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:24:01.949909144Z [2024-03-28 01:24:01,945: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:24:01.950350621Z [2024-03-28 01:24:01,950: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:24:01.950654201Z [2024-03-28 01:24:01,950: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:24:02.002065870Z [2024-03-28 01:24:02,001: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:24:02.155822562Z [2024-03-28 01:24:02,155: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:24:02.826808703Z [2024-03-28 01:24:02,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abb74e3a-1665-48da-b170-0e2b882775e1] succeeded in 1.5506071709996831s: None 2024-03-28T01:24:02.949733930Z [2024-03-28 01:24:02,949: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[db727648-57d9-4764-8568-6c19bcefa33d] succeeded in 1.6706943519993729s: None 2024-03-28T01:24:03.167348570Z [2024-03-28 01:24:03,166: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:24:03.172128995Z [2024-03-28 01:24:03,171: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:24:03.200002270Z [2024-03-28 01:24:03,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:24:03.201815214Z [2024-03-28 01:24:03,201: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:24:03.201844458Z [2024-03-28 01:24:03,201: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:24:03.202011807Z [2024-03-28 01:24:03,201: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:24:03.202054494Z [2024-03-28 01:24:03,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:24:03.202345983Z [2024-03-28 01:24:03,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:24:03.202383517Z [2024-03-28 01:24:03,202: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:24:03.308692766Z [2024-03-28 01:24:03,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:24:03.577898124Z [2024-03-28 01:24:03,577: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:24:03.581703251Z [2024-03-28 01:24:03,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:24:03.612336356Z [2024-03-28 01:24:03,612: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:24:03.614555952Z [2024-03-28 01:24:03,614: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:24:03.614779707Z [2024-03-28 01:24:03,614: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:24:03.615051238Z [2024-03-28 01:24:03,614: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:24:03.615227541Z [2024-03-28 01:24:03,615: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:24:03.615667755Z [2024-03-28 01:24:03,615: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:24:03.616255687Z [2024-03-28 01:24:03,616: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:24:03.744279147Z [2024-03-28 01:24:03,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:24:04.849036768Z [2024-03-28 01:24:04,848: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fce49133-c452-4fc9-a04d-688f87b785c7] succeeded in 3.578237865999654s: None 2024-03-28T01:24:05.486143115Z [2024-03-28 01:24:05,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea2f9277-a212-4274-99df-60a4e84538af] succeeded in 4.21354971799974s: None 2024-03-28T01:25:00.761803818Z [2024-03-28 01:25:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7a539c0-0c52-4dcc-8979-89031ea7a28b] received 2024-03-28T01:25:00.766376787Z [2024-03-28 01:25:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[435fe203-da6f-4a23-b0fd-98589d3cff99] received 2024-03-28T01:25:00.769046903Z [2024-03-28 01:25:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aa9dd6a-c502-4425-be12-b724cff81bcf] received 2024-03-28T01:25:00.773963044Z [2024-03-28 01:25:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c4a4727-7d1e-41ee-876a-8b533cd0b9c8] received 2024-03-28T01:25:00.783932532Z [2024-03-28 01:25:00,783: INFO/ForkPoolWorker-16] [435fe203-da6f-4a23-b0fd-98589d3cff99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:25:00.784612789Z [2024-03-28 01:25:00,784: INFO/ForkPoolWorker-15] [c7a539c0-0c52-4dcc-8979-89031ea7a28b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:25:00.786720703Z [2024-03-28 01:25:00,786: INFO/ForkPoolWorker-1] [2aa9dd6a-c502-4425-be12-b724cff81bcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:25:00.797121017Z [2024-03-28 01:25:00,796: INFO/ForkPoolWorker-2] [2c4a4727-7d1e-41ee-876a-8b533cd0b9c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:25:01.249081181Z [2024-03-28 01:25:01,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:25:01.250371160Z [2024-03-28 01:25:01,246: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:25:01.328167658Z [2024-03-28 01:25:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:25:01.365298306Z [2024-03-28 01:25:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:25:01.552359972Z [2024-03-28 01:25:01,551: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:25:01.558123603Z [2024-03-28 01:25:01,557: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:01.601948529Z [2024-03-28 01:25:01,601: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:25:01.606375609Z [2024-03-28 01:25:01,606: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:25:01.606516914Z [2024-03-28 01:25:01,606: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:25:01.606579703Z [2024-03-28 01:25:01,606: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:25:01.606893760Z [2024-03-28 01:25:01,606: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:25:01.880091562Z [2024-03-28 01:25:01,879: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:02.998712230Z [2024-03-28 01:25:02,998: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2c4a4727-7d1e-41ee-876a-8b533cd0b9c8] succeeded in 2.2115657129998s: None 2024-03-28T01:25:03.764846972Z [2024-03-28 01:25:03,764: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:25:03.768878065Z [2024-03-28 01:25:03,768: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:03.800008744Z [2024-03-28 01:25:03,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:25:03.802521492Z [2024-03-28 01:25:03,802: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:03.802649732Z [2024-03-28 01:25:03,802: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:03.802874519Z [2024-03-28 01:25:03,802: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:03.802925275Z [2024-03-28 01:25:03,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:25:03.803274892Z [2024-03-28 01:25:03,803: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:25:03.803328216Z [2024-03-28 01:25:03,803: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:03.828767541Z [2024-03-28 01:25:03,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:25:03.832451178Z [2024-03-28 01:25:03,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:03.860064189Z [2024-03-28 01:25:03,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:25:03.862325893Z [2024-03-28 01:25:03,861: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:03.862357022Z [2024-03-28 01:25:03,862: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:03.862513267Z [2024-03-28 01:25:03,862: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:03.862546517Z [2024-03-28 01:25:03,862: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:25:03.862976094Z [2024-03-28 01:25:03,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:25:03.862991471Z [2024-03-28 01:25:03,862: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:03.955213201Z [2024-03-28 01:25:03,954: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:03.979098845Z [2024-03-28 01:25:03,978: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:25:03.982918309Z [2024-03-28 01:25:03,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:04.017558931Z [2024-03-28 01:25:04,017: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:25:04.019773570Z [2024-03-28 01:25:04,019: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:04.019979900Z [2024-03-28 01:25:04,019: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:04.020299045Z [2024-03-28 01:25:04,019: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:04.020452974Z [2024-03-28 01:25:04,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:25:04.020944630Z [2024-03-28 01:25:04,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:25:04.021213422Z [2024-03-28 01:25:04,020: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:04.021754498Z [2024-03-28 01:25:04,020: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:04.186484205Z [2024-03-28 01:25:04,186: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:04.762947094Z [2024-03-28 01:25:04,762: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[435fe203-da6f-4a23-b0fd-98589d3cff99] succeeded in 3.993365242999971s: None 2024-03-28T01:25:05.765409811Z [2024-03-28 01:25:05,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f297a25b-3372-445b-a438-a45dd5d93ad7] received 2024-03-28T01:25:05.776688578Z [2024-03-28 01:25:05,776: INFO/ForkPoolWorker-16] [f297a25b-3372-445b-a438-a45dd5d93ad7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:25:05.849764994Z [2024-03-28 01:25:05,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7a539c0-0c52-4dcc-8979-89031ea7a28b] succeeded in 5.08106774999942s: None 2024-03-28T01:25:06.060470640Z [2024-03-28 01:25:06,059: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2aa9dd6a-c502-4425-be12-b724cff81bcf] succeeded in 5.282856298000297s: None 2024-03-28T01:25:06.086804951Z [2024-03-28 01:25:06,083: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:25:07.323719713Z [2024-03-28 01:25:07,323: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:25:07.327117988Z [2024-03-28 01:25:07,326: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:07.348119996Z [2024-03-28 01:25:07,347: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:25:07.350105418Z [2024-03-28 01:25:07,349: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:07.350187213Z [2024-03-28 01:25:07,349: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:07.350396381Z [2024-03-28 01:25:07,350: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:07.350451208Z [2024-03-28 01:25:07,350: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:25:07.350957931Z [2024-03-28 01:25:07,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:25:07.351040545Z [2024-03-28 01:25:07,350: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:07.434681721Z [2024-03-28 01:25:07,434: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:08.239214249Z [2024-03-28 01:25:08,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f297a25b-3372-445b-a438-a45dd5d93ad7] succeeded in 2.467668211000273s: None 2024-03-28T01:25:08.652640526Z [2024-03-28 01:25:08,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8843962-d1fa-43b4-82e3-238aa1f72f8e] received 2024-03-28T01:25:08.661578451Z [2024-03-28 01:25:08,661: INFO/ForkPoolWorker-15] [c8843962-d1fa-43b4-82e3-238aa1f72f8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:25:09.144689821Z [2024-03-28 01:25:09,141: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:25:10.574242352Z [2024-03-28 01:25:10,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:25:10.578271538Z [2024-03-28 01:25:10,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:10.607028396Z [2024-03-28 01:25:10,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:25:10.608641040Z [2024-03-28 01:25:10,608: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:10.608779061Z [2024-03-28 01:25:10,608: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:10.608939127Z [2024-03-28 01:25:10,608: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:10.609070354Z [2024-03-28 01:25:10,608: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:25:10.609353293Z [2024-03-28 01:25:10,609: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:25:10.609494301Z [2024-03-28 01:25:10,609: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:10.778564367Z [2024-03-28 01:25:10,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:11.586794273Z [2024-03-28 01:25:11,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8843962-d1fa-43b4-82e3-238aa1f72f8e] succeeded in 2.931925020999188s: None 2024-03-28T01:25:12.668272244Z [2024-03-28 01:25:12,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b8b2b87-805e-4d9c-9ab7-acf1850e6de1] received 2024-03-28T01:25:12.676880019Z [2024-03-28 01:25:12,676: INFO/ForkPoolWorker-15] [3b8b2b87-805e-4d9c-9ab7-acf1850e6de1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:25:12.991521141Z [2024-03-28 01:25:12,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:25:14.258925610Z [2024-03-28 01:25:14,258: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:25:14.262616381Z [2024-03-28 01:25:14,262: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:25:14.282362679Z [2024-03-28 01:25:14,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:25:14.284116901Z [2024-03-28 01:25:14,283: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:25:14.284354489Z [2024-03-28 01:25:14,283: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:25:14.284673473Z [2024-03-28 01:25:14,284: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:25:14.284782116Z [2024-03-28 01:25:14,284: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:25:14.285750459Z [2024-03-28 01:25:14,285: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:25:14.286087324Z [2024-03-28 01:25:14,285: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:25:14.375154543Z [2024-03-28 01:25:14,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:25:14.949559782Z [2024-03-28 01:25:14,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b8b2b87-805e-4d9c-9ab7-acf1850e6de1] succeeded in 2.277486922999742s: None 2024-03-28T01:26:01.238274063Z [2024-03-28 01:26:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17d9d536-511a-436f-bb7c-f6b708adbe73] received 2024-03-28T01:26:01.245201913Z [2024-03-28 01:26:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a519bace-cddb-4a04-9e8f-dc9057306d88] received 2024-03-28T01:26:01.250418655Z [2024-03-28 01:26:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18211cdc-f492-4337-b979-fa9bd4e3b3f2] received 2024-03-28T01:26:01.251464752Z [2024-03-28 01:26:01,251: INFO/ForkPoolWorker-15] [17d9d536-511a-436f-bb7c-f6b708adbe73] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:26:01.253875500Z [2024-03-28 01:26:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7649670c-3fa7-4630-89cb-e0cc7a902d22] received 2024-03-28T01:26:01.265779510Z [2024-03-28 01:26:01,265: INFO/ForkPoolWorker-2] [7649670c-3fa7-4630-89cb-e0cc7a902d22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:26:01.270134530Z [2024-03-28 01:26:01,269: INFO/ForkPoolWorker-16] [a519bace-cddb-4a04-9e8f-dc9057306d88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:26:01.270377332Z [2024-03-28 01:26:01,269: INFO/ForkPoolWorker-1] [18211cdc-f492-4337-b979-fa9bd4e3b3f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:26:01.814717220Z [2024-03-28 01:26:01,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:26:01.826092563Z [2024-03-28 01:26:01,822: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:26:01.833952867Z [2024-03-28 01:26:01,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:26:02.026066404Z [2024-03-28 01:26:02,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:26:02.091000103Z [2024-03-28 01:26:02,090: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:26:02.099780705Z [2024-03-28 01:26:02,099: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:26:02.163563090Z [2024-03-28 01:26:02,163: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:26:02.170778154Z [2024-03-28 01:26:02,170: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:26:02.170851511Z [2024-03-28 01:26:02,170: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:26:02.170915649Z [2024-03-28 01:26:02,170: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:26:02.171237746Z [2024-03-28 01:26:02,171: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:26:02.310892203Z [2024-03-28 01:26:02,310: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:26:02.356492433Z [2024-03-28 01:26:02,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:26:03.209217261Z [2024-03-28 01:26:03,208: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7649670c-3fa7-4630-89cb-e0cc7a902d22] succeeded in 1.9529540409994297s: None 2024-03-28T01:26:03.455736481Z [2024-03-28 01:26:03,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17d9d536-511a-436f-bb7c-f6b708adbe73] succeeded in 2.2143295700007s: None 2024-03-28T01:26:03.782575910Z [2024-03-28 01:26:03,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:26:03.787221118Z [2024-03-28 01:26:03,786: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:26:03.826738076Z [2024-03-28 01:26:03,826: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:26:03.831155038Z [2024-03-28 01:26:03,830: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:26:03.831192771Z [2024-03-28 01:26:03,830: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:26:03.831574345Z [2024-03-28 01:26:03,831: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:26:03.831588640Z [2024-03-28 01:26:03,831: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:26:03.832683300Z [2024-03-28 01:26:03,831: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:26:03.832692441Z [2024-03-28 01:26:03,831: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:26:03.940359371Z [2024-03-28 01:26:03,940: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:26:04.250682994Z [2024-03-28 01:26:04,250: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:26:04.254261845Z [2024-03-28 01:26:04,253: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:26:04.286215028Z [2024-03-28 01:26:04,285: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:26:04.288124937Z [2024-03-28 01:26:04,287: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:26:04.288144404Z [2024-03-28 01:26:04,287: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:26:04.288244457Z [2024-03-28 01:26:04,288: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:26:04.288252988Z [2024-03-28 01:26:04,288: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:26:04.288639738Z [2024-03-28 01:26:04,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:26:04.288714514Z [2024-03-28 01:26:04,288: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:26:04.385260129Z [2024-03-28 01:26:04,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:26:05.891118382Z [2024-03-28 01:26:05,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a519bace-cddb-4a04-9e8f-dc9057306d88] succeeded in 4.643777211999804s: None 2024-03-28T01:26:06.588315640Z [2024-03-28 01:26:06,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18211cdc-f492-4337-b979-fa9bd4e3b3f2] succeeded in 5.335514716999569s: None 2024-03-28T01:27:00.435949355Z [2024-03-28 01:27:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a30605b-ef4f-4c85-aacb-a8bc59438f72] received 2024-03-28T01:27:00.438393771Z [2024-03-28 01:27:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a63e2653-c88f-4b97-9c32-61550df251fd] received 2024-03-28T01:27:00.443277436Z [2024-03-28 01:27:00,442: INFO/ForkPoolWorker-15] [4a30605b-ef4f-4c85-aacb-a8bc59438f72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:27:00.446581889Z [2024-03-28 01:27:00,446: INFO/ForkPoolWorker-16] [a63e2653-c88f-4b97-9c32-61550df251fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:27:00.449734157Z [2024-03-28 01:27:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3778bb5a-c850-4cf4-8652-b759b633cd03] received 2024-03-28T01:27:00.459856260Z [2024-03-28 01:27:00,459: INFO/ForkPoolWorker-1] [3778bb5a-c850-4cf4-8652-b759b633cd03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:27:00.737551857Z [2024-03-28 01:27:00,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:27:00.768089646Z [2024-03-28 01:27:00,765: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:27:00.824470621Z [2024-03-28 01:27:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:27:01.007712567Z [2024-03-28 01:27:01,007: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:27:01.015608210Z [2024-03-28 01:27:01,014: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:27:01.038788538Z [2024-03-28 01:27:01,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:27:01.039837675Z [2024-03-28 01:27:01,039: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:27:01.039910663Z [2024-03-28 01:27:01,039: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:27:01.040050038Z [2024-03-28 01:27:01,039: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:27:01.040303461Z [2024-03-28 01:27:01,040: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:27:01.137243291Z [2024-03-28 01:27:01,136: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:27:01.838895951Z [2024-03-28 01:27:01,838: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3778bb5a-c850-4cf4-8652-b759b633cd03] succeeded in 1.3867271480003183s: None 2024-03-28T01:27:01.993617380Z [2024-03-28 01:27:01,993: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:27:01.998272245Z [2024-03-28 01:27:01,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:27:02.024810199Z [2024-03-28 01:27:02,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:27:02.029238294Z [2024-03-28 01:27:02,028: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:27:02.029267069Z [2024-03-28 01:27:02,029: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:27:02.029411715Z [2024-03-28 01:27:02,029: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:27:02.029667253Z [2024-03-28 01:27:02,029: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:27:02.030616364Z [2024-03-28 01:27:02,030: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:27:02.030746999Z [2024-03-28 01:27:02,030: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:27:02.152413393Z [2024-03-28 01:27:02,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:27:02.270568323Z [2024-03-28 01:27:02,270: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:27:02.274704671Z [2024-03-28 01:27:02,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:27:02.295354762Z [2024-03-28 01:27:02,295: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:27:02.296629944Z [2024-03-28 01:27:02,296: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:27:02.296665232Z [2024-03-28 01:27:02,296: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:27:02.296737631Z [2024-03-28 01:27:02,296: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:27:02.296786370Z [2024-03-28 01:27:02,296: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:27:02.297101764Z [2024-03-28 01:27:02,296: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:27:02.297121329Z [2024-03-28 01:27:02,297: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:27:02.413561823Z [2024-03-28 01:27:02,413: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:27:04.061036792Z [2024-03-28 01:27:04,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a63e2653-c88f-4b97-9c32-61550df251fd] succeeded in 3.6203999829995155s: None 2024-03-28T01:27:04.335571691Z [2024-03-28 01:27:04,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a30605b-ef4f-4c85-aacb-a8bc59438f72] succeeded in 3.897661624999273s: None 2024-03-28T01:28:00.363284908Z [2024-03-28 01:28:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8381302a-f62b-41d7-a9ae-d0c81bb3907c] received 2024-03-28T01:28:00.367341192Z [2024-03-28 01:28:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c954232-f7d7-4df4-b60a-35f33f9698f7] received 2024-03-28T01:28:00.373415391Z [2024-03-28 01:28:00,373: INFO/ForkPoolWorker-16] [4c954232-f7d7-4df4-b60a-35f33f9698f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:28:00.373968299Z [2024-03-28 01:28:00,373: INFO/ForkPoolWorker-15] [8381302a-f62b-41d7-a9ae-d0c81bb3907c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:28:00.375388479Z [2024-03-28 01:28:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcd2626b-37be-4311-8134-b0421de3bbda] received 2024-03-28T01:28:00.380028233Z [2024-03-28 01:28:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1af355d-2ace-4aa5-a004-c1a9adcc0ea7] received 2024-03-28T01:28:00.384819147Z [2024-03-28 01:28:00,384: INFO/ForkPoolWorker-1] [dcd2626b-37be-4311-8134-b0421de3bbda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:28:00.391494301Z [2024-03-28 01:28:00,391: INFO/ForkPoolWorker-2] [a1af355d-2ace-4aa5-a004-c1a9adcc0ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:28:00.698606435Z [2024-03-28 01:28:00,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:28:00.699948201Z [2024-03-28 01:28:00,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:28:00.736992527Z [2024-03-28 01:28:00,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:28:00.977220366Z [2024-03-28 01:28:00,971: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:28:00.979880232Z [2024-03-28 01:28:00,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:28:01.270222213Z [2024-03-28 01:28:01,269: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:28:01.277357810Z [2024-03-28 01:28:01,276: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:28:01.306182033Z [2024-03-28 01:28:01,305: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:28:01.310763271Z [2024-03-28 01:28:01,310: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:28:01.311117840Z [2024-03-28 01:28:01,310: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:28:01.311235354Z [2024-03-28 01:28:01,311: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:28:01.311630575Z [2024-03-28 01:28:01,311: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:28:01.440074773Z [2024-03-28 01:28:01,439: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:28:01.727389664Z [2024-03-28 01:28:01,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8381302a-f62b-41d7-a9ae-d0c81bb3907c] succeeded in 1.3585086300008697s: None 2024-03-28T01:28:02.251212552Z [2024-03-28 01:28:02,250: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a1af355d-2ace-4aa5-a004-c1a9adcc0ea7] succeeded in 1.8681651940005395s: None 2024-03-28T01:28:02.422077380Z [2024-03-28 01:28:02,421: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:28:02.425906628Z [2024-03-28 01:28:02,425: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:28:02.453839084Z [2024-03-28 01:28:02,453: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:28:02.455867878Z [2024-03-28 01:28:02,455: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:28:02.456077076Z [2024-03-28 01:28:02,455: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:28:02.456427070Z [2024-03-28 01:28:02,456: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:28:02.456696169Z [2024-03-28 01:28:02,456: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:28:02.457259280Z [2024-03-28 01:28:02,456: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:28:02.457588952Z [2024-03-28 01:28:02,457: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:28:02.463413323Z [2024-03-28 01:28:02,463: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:28:02.467173128Z [2024-03-28 01:28:02,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:28:02.490962140Z [2024-03-28 01:28:02,490: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:28:02.492474119Z [2024-03-28 01:28:02,492: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:28:02.492599906Z [2024-03-28 01:28:02,492: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:28:02.492818206Z [2024-03-28 01:28:02,492: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:28:02.492981696Z [2024-03-28 01:28:02,492: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:28:02.493527134Z [2024-03-28 01:28:02,493: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:28:02.493794203Z [2024-03-28 01:28:02,493: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:28:02.573285560Z [2024-03-28 01:28:02,572: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:28:02.593056921Z [2024-03-28 01:28:02,592: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:28:04.247920393Z [2024-03-28 01:28:04,247: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c954232-f7d7-4df4-b60a-35f33f9698f7] succeeded in 3.8784504559998823s: None 2024-03-28T01:28:04.426738182Z [2024-03-28 01:28:04,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dcd2626b-37be-4311-8134-b0421de3bbda] succeeded in 4.049653807999675s: None 2024-03-28T01:29:00.254943729Z [2024-03-28 01:29:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c44b54c-bec1-40c3-91e9-501b0140c11d] received 2024-03-28T01:29:00.260417694Z [2024-03-28 01:29:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83355cdf-ba95-49e4-b470-8061ec63eecd] received 2024-03-28T01:29:00.265378910Z [2024-03-28 01:29:00,264: INFO/ForkPoolWorker-15] [0c44b54c-bec1-40c3-91e9-501b0140c11d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:29:00.267768935Z [2024-03-28 01:29:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f70ef948-f250-4eab-a390-00c47660f6ed] received 2024-03-28T01:29:00.273710734Z [2024-03-28 01:29:00,273: INFO/ForkPoolWorker-16] [83355cdf-ba95-49e4-b470-8061ec63eecd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:29:00.275415754Z [2024-03-28 01:29:00,275: INFO/ForkPoolWorker-1] [f70ef948-f250-4eab-a390-00c47660f6ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:29:00.609828842Z [2024-03-28 01:29:00,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:29:00.712914463Z [2024-03-28 01:29:00,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:29:00.740173769Z [2024-03-28 01:29:00,737: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:29:00.878195495Z [2024-03-28 01:29:00,877: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:29:00.882284274Z [2024-03-28 01:29:00,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:29:00.912525372Z [2024-03-28 01:29:00,912: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:29:00.914372565Z [2024-03-28 01:29:00,914: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:29:00.914477823Z [2024-03-28 01:29:00,914: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:29:00.914512757Z [2024-03-28 01:29:00,914: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:29:00.915157702Z [2024-03-28 01:29:00,914: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:29:01.018140476Z [2024-03-28 01:29:01,017: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:29:01.782593592Z [2024-03-28 01:29:01,782: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83355cdf-ba95-49e4-b470-8061ec63eecd] succeeded in 1.5199028889992405s: None 2024-03-28T01:29:01.980543063Z [2024-03-28 01:29:01,980: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:29:01.984340094Z [2024-03-28 01:29:01,983: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:29:02.019259120Z [2024-03-28 01:29:02,018: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:29:02.021364881Z [2024-03-28 01:29:02,020: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:29:02.021774305Z [2024-03-28 01:29:02,021: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:29:02.022119052Z [2024-03-28 01:29:02,021: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:29:02.022364708Z [2024-03-28 01:29:02,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:29:02.023026438Z [2024-03-28 01:29:02,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:29:02.023389664Z [2024-03-28 01:29:02,023: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:29:02.093652665Z [2024-03-28 01:29:02,093: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:29:02.097543951Z [2024-03-28 01:29:02,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:29:02.122215453Z [2024-03-28 01:29:02,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:29:02.124074359Z [2024-03-28 01:29:02,123: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:29:02.124101998Z [2024-03-28 01:29:02,123: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:29:02.124314364Z [2024-03-28 01:29:02,124: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:29:02.124438553Z [2024-03-28 01:29:02,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:29:02.124856710Z [2024-03-28 01:29:02,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:29:02.124995620Z [2024-03-28 01:29:02,124: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:29:02.135102170Z [2024-03-28 01:29:02,134: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:29:02.258780864Z [2024-03-28 01:29:02,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:29:03.928369676Z [2024-03-28 01:29:03,927: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f70ef948-f250-4eab-a390-00c47660f6ed] succeeded in 3.659148228000049s: None 2024-03-28T01:29:04.422751381Z [2024-03-28 01:29:04,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c44b54c-bec1-40c3-91e9-501b0140c11d] succeeded in 4.165494781000234s: None 2024-03-28T01:30:00.734870780Z [2024-03-28 01:30:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2922d8d0-ea49-46d3-8cda-64e47a5c5607] received 2024-03-28T01:30:00.736674593Z [2024-03-28 01:30:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0f9c2a1-f97c-4d74-8700-954ffa54c0f2] received 2024-03-28T01:30:00.738799253Z [2024-03-28 01:30:00,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9212d1-93f3-4775-bf94-86250a608680] received 2024-03-28T01:30:00.744269821Z [2024-03-28 01:30:00,743: INFO/ForkPoolWorker-16] [c0f9c2a1-f97c-4d74-8700-954ffa54c0f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:30:00.745171310Z [2024-03-28 01:30:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5b7cfa4-b8f7-4d9b-a7e7-1f41dc78b601] received 2024-03-28T01:30:00.746405297Z [2024-03-28 01:30:00,746: INFO/ForkPoolWorker-1] [5d9212d1-93f3-4775-bf94-86250a608680] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:30:00.755270314Z [2024-03-28 01:30:00,754: INFO/ForkPoolWorker-15] [2922d8d0-ea49-46d3-8cda-64e47a5c5607] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:30:00.755730250Z [2024-03-28 01:30:00,755: INFO/ForkPoolWorker-2] [b5b7cfa4-b8f7-4d9b-a7e7-1f41dc78b601] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:30:00.822602919Z [2024-03-28 01:30:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ebbf907-d725-4abb-a80d-da818b9bd115] received 2024-03-28T01:30:00.858529236Z [2024-03-28 01:30:00,858: INFO/ForkPoolWorker-3] [1ebbf907-d725-4abb-a80d-da818b9bd115] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:30:01.164529491Z [2024-03-28 01:30:01,160: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:30:01.265520633Z [2024-03-28 01:30:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:30:01.349834318Z [2024-03-28 01:30:01,346: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:30:01.525958242Z [2024-03-28 01:30:01,521: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:30:01.605851149Z [2024-03-28 01:30:01,601: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:30:01.960129363Z [2024-03-28 01:30:01,959: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:02.036453821Z [2024-03-28 01:30:02,035: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T01:30:02.041799289Z [2024-03-28 01:30:02,041: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:02.096265484Z [2024-03-28 01:30:02,096: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:30:02.102468268Z [2024-03-28 01:30:02,101: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:30:02.102640880Z [2024-03-28 01:30:02,102: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:30:02.102839045Z [2024-03-28 01:30:02,102: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T01:30:02.103950185Z [2024-03-28 01:30:02,103: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:30:02.255915434Z [2024-03-28 01:30:02,255: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:03.320955338Z [2024-03-28 01:30:03,320: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b5b7cfa4-b8f7-4d9b-a7e7-1f41dc78b601] succeeded in 2.574054523000086s: None 2024-03-28T01:30:03.660704378Z [2024-03-28 01:30:03,660: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1ebbf907-d725-4abb-a80d-da818b9bd115] succeeded in 2.820993684000314s: None 2024-03-28T01:30:03.709635313Z [2024-03-28 01:30:03,708: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:30:03.713610268Z [2024-03-28 01:30:03,712: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:03.766483868Z [2024-03-28 01:30:03,765: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:30:03.783012873Z [2024-03-28 01:30:03,782: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:03.783235375Z [2024-03-28 01:30:03,783: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:03.783813553Z [2024-03-28 01:30:03,783: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:03.783977341Z [2024-03-28 01:30:03,783: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:30:03.784358461Z [2024-03-28 01:30:03,784: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:30:03.785055698Z [2024-03-28 01:30:03,784: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:03.964561416Z [2024-03-28 01:30:03,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:03.986926365Z [2024-03-28 01:30:03,986: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:30:03.995230023Z [2024-03-28 01:30:03,994: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:04.033570201Z [2024-03-28 01:30:04,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:30:04.035733839Z [2024-03-28 01:30:04,035: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:04.035820019Z [2024-03-28 01:30:04,035: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:04.035983481Z [2024-03-28 01:30:04,035: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:04.036080283Z [2024-03-28 01:30:04,035: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:30:04.040460549Z [2024-03-28 01:30:04,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:30:04.040513735Z [2024-03-28 01:30:04,040: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:04.160016153Z [2024-03-28 01:30:04,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:04.199571613Z [2024-03-28 01:30:04,199: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:30:04.207847273Z [2024-03-28 01:30:04,207: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:04.242091941Z [2024-03-28 01:30:04,240: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:30:04.245986938Z [2024-03-28 01:30:04,245: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:04.246302754Z [2024-03-28 01:30:04,245: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:04.246685606Z [2024-03-28 01:30:04,246: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:04.246941375Z [2024-03-28 01:30:04,246: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:30:04.247414231Z [2024-03-28 01:30:04,247: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:30:04.247626269Z [2024-03-28 01:30:04,247: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:04.398938432Z [2024-03-28 01:30:04,398: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:05.094380814Z [2024-03-28 01:30:05,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b19daa91-c41f-4b3b-ba9e-000ba4323794] received 2024-03-28T01:30:05.106836167Z [2024-03-28 01:30:05,106: INFO/ForkPoolWorker-2] [b19daa91-c41f-4b3b-ba9e-000ba4323794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:30:05.155076248Z [2024-03-28 01:30:05,154: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d9212d1-93f3-4775-bf94-86250a608680] succeeded in 4.414996460000111s: None 2024-03-28T01:30:05.453747363Z [2024-03-28 01:30:05,449: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:30:05.969201197Z [2024-03-28 01:30:05,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0f9c2a1-f97c-4d74-8700-954ffa54c0f2] succeeded in 5.230673615000342s: None 2024-03-28T01:30:06.022597585Z [2024-03-28 01:30:06,022: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2922d8d0-ea49-46d3-8cda-64e47a5c5607] succeeded in 5.2841729810006655s: None 2024-03-28T01:30:06.736858599Z [2024-03-28 01:30:06,736: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:30:06.740280678Z [2024-03-28 01:30:06,739: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:06.758648351Z [2024-03-28 01:30:06,758: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:30:06.759992300Z [2024-03-28 01:30:06,759: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:06.760071611Z [2024-03-28 01:30:06,759: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:06.760159379Z [2024-03-28 01:30:06,759: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:06.760214389Z [2024-03-28 01:30:06,760: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:30:06.760466763Z [2024-03-28 01:30:06,760: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:30:06.760480517Z [2024-03-28 01:30:06,760: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:06.871048776Z [2024-03-28 01:30:06,870: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:07.562712756Z [2024-03-28 01:30:07,562: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b19daa91-c41f-4b3b-ba9e-000ba4323794] succeeded in 2.4657768330007457s: None 2024-03-28T01:30:07.653541761Z [2024-03-28 01:30:07,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25c31d35-cb76-42c2-aefb-6c08121ccbed] received 2024-03-28T01:30:07.662200996Z [2024-03-28 01:30:07,661: INFO/ForkPoolWorker-15] [25c31d35-cb76-42c2-aefb-6c08121ccbed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:30:07.983658181Z [2024-03-28 01:30:07,980: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:30:09.357275282Z [2024-03-28 01:30:09,356: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:30:09.360989298Z [2024-03-28 01:30:09,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:09.394583245Z [2024-03-28 01:30:09,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:30:09.396617305Z [2024-03-28 01:30:09,396: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:09.396730067Z [2024-03-28 01:30:09,396: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:09.397079584Z [2024-03-28 01:30:09,396: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:09.397251072Z [2024-03-28 01:30:09,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:30:09.397705538Z [2024-03-28 01:30:09,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:30:09.398298830Z [2024-03-28 01:30:09,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:09.538307606Z [2024-03-28 01:30:09,538: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:10.202161409Z [2024-03-28 01:30:10,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25c31d35-cb76-42c2-aefb-6c08121ccbed] succeeded in 2.545525775000897s: None 2024-03-28T01:30:10.639506559Z [2024-03-28 01:30:10,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8ba6d7b-969c-4f13-9332-468756aab111] received 2024-03-28T01:30:10.650796047Z [2024-03-28 01:30:10,650: INFO/ForkPoolWorker-15] [d8ba6d7b-969c-4f13-9332-468756aab111] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:30:10.976002176Z [2024-03-28 01:30:10,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:30:12.189210632Z [2024-03-28 01:30:12,188: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:30:12.192767592Z [2024-03-28 01:30:12,192: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:30:12.213907216Z [2024-03-28 01:30:12,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:30:12.215401766Z [2024-03-28 01:30:12,215: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:30:12.215474806Z [2024-03-28 01:30:12,215: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:30:12.215687227Z [2024-03-28 01:30:12,215: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:30:12.215750704Z [2024-03-28 01:30:12,215: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:30:12.216169208Z [2024-03-28 01:30:12,215: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:30:12.216191190Z [2024-03-28 01:30:12,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:30:12.319289518Z [2024-03-28 01:30:12,318: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:30:12.858429786Z [2024-03-28 01:30:12,857: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8ba6d7b-969c-4f13-9332-468756aab111] succeeded in 2.2159901259992694s: None 2024-03-28T01:31:01.116317794Z [2024-03-28 01:31:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[887bcd70-d964-450f-ae5a-aa3cbd4eab02] received 2024-03-28T01:31:01.118298223Z [2024-03-28 01:31:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d8ac1e2-6e27-42a3-a26a-cc048043f6dc] received 2024-03-28T01:31:01.123752298Z [2024-03-28 01:31:01,123: INFO/ForkPoolWorker-15] [887bcd70-d964-450f-ae5a-aa3cbd4eab02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:31:01.127885621Z [2024-03-28 01:31:01,126: INFO/ForkPoolWorker-16] [6d8ac1e2-6e27-42a3-a26a-cc048043f6dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:31:01.143522846Z [2024-03-28 01:31:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30ce907d-523c-4bde-b04c-800aca96c90b] received 2024-03-28T01:31:01.153701348Z [2024-03-28 01:31:01,152: INFO/ForkPoolWorker-1] [30ce907d-523c-4bde-b04c-800aca96c90b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:31:01.442602108Z [2024-03-28 01:31:01,439: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:31:01.488646082Z [2024-03-28 01:31:01,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:31:01.533048858Z [2024-03-28 01:31:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:31:01.736755893Z [2024-03-28 01:31:01,736: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:31:01.744194244Z [2024-03-28 01:31:01,743: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:31:01.776395815Z [2024-03-28 01:31:01,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:31:01.778433746Z [2024-03-28 01:31:01,778: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:31:01.778835646Z [2024-03-28 01:31:01,778: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:31:01.779110266Z [2024-03-28 01:31:01,778: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:31:01.779729680Z [2024-03-28 01:31:01,779: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:31:01.933959294Z [2024-03-28 01:31:01,933: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:31:02.611006969Z [2024-03-28 01:31:02,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30ce907d-523c-4bde-b04c-800aca96c90b] succeeded in 1.4644812570004433s: None 2024-03-28T01:31:02.715734841Z [2024-03-28 01:31:02,715: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:31:02.721085250Z [2024-03-28 01:31:02,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:31:02.754210234Z [2024-03-28 01:31:02,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:31:02.756280366Z [2024-03-28 01:31:02,755: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:31:02.756471282Z [2024-03-28 01:31:02,756: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:31:02.756851131Z [2024-03-28 01:31:02,756: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:31:02.756909173Z [2024-03-28 01:31:02,756: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:31:02.757312394Z [2024-03-28 01:31:02,757: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:31:02.758263981Z [2024-03-28 01:31:02,757: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:31:02.805000216Z [2024-03-28 01:31:02,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:31:02.810639318Z [2024-03-28 01:31:02,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:31:02.832782948Z [2024-03-28 01:31:02,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:31:02.835074163Z [2024-03-28 01:31:02,834: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:31:02.835298546Z [2024-03-28 01:31:02,835: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:31:02.835543594Z [2024-03-28 01:31:02,835: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:31:02.835732040Z [2024-03-28 01:31:02,835: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:31:02.836086719Z [2024-03-28 01:31:02,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:31:02.836270988Z [2024-03-28 01:31:02,836: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:31:02.858027486Z [2024-03-28 01:31:02,857: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:31:02.972663728Z [2024-03-28 01:31:02,972: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:31:04.552737565Z [2024-03-28 01:31:04,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d8ac1e2-6e27-42a3-a26a-cc048043f6dc] succeeded in 3.4309769480005343s: None 2024-03-28T01:31:05.576759095Z [2024-03-28 01:31:05,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[887bcd70-d964-450f-ae5a-aa3cbd4eab02] succeeded in 4.458594138999615s: None 2024-03-28T01:32:00.378424584Z [2024-03-28 01:32:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7236d0b8-6bce-497f-a5d3-076891e7a03e] received 2024-03-28T01:32:00.379813811Z [2024-03-28 01:32:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7cdcb9f-82c0-4868-b123-34fbea9ebcc0] received 2024-03-28T01:32:00.387500668Z [2024-03-28 01:32:00,387: INFO/ForkPoolWorker-16] [c7cdcb9f-82c0-4868-b123-34fbea9ebcc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:32:00.388755995Z [2024-03-28 01:32:00,388: INFO/ForkPoolWorker-15] [7236d0b8-6bce-497f-a5d3-076891e7a03e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:32:00.401211986Z [2024-03-28 01:32:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73514214-3326-4695-8201-5ab763d57f29] received 2024-03-28T01:32:00.403512970Z [2024-03-28 01:32:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eeacc42-aeb3-41c5-88d8-d3836e946dc8] received 2024-03-28T01:32:00.410573303Z [2024-03-28 01:32:00,410: INFO/ForkPoolWorker-1] [73514214-3326-4695-8201-5ab763d57f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:32:00.412518816Z [2024-03-28 01:32:00,412: INFO/ForkPoolWorker-2] [4eeacc42-aeb3-41c5-88d8-d3836e946dc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:32:00.705047317Z [2024-03-28 01:32:00,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:32:00.712445547Z [2024-03-28 01:32:00,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:32:00.739107661Z [2024-03-28 01:32:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:32:00.794565672Z [2024-03-28 01:32:00,790: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:32:00.865055483Z [2024-03-28 01:32:00,864: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:32:00.868849938Z [2024-03-28 01:32:00,868: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:32:00.897291507Z [2024-03-28 01:32:00,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:32:00.898968022Z [2024-03-28 01:32:00,898: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:32:00.899206341Z [2024-03-28 01:32:00,898: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:32:00.899375368Z [2024-03-28 01:32:00,899: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:32:00.899631817Z [2024-03-28 01:32:00,899: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:32:00.976023590Z [2024-03-28 01:32:00,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:32:00.981491025Z [2024-03-28 01:32:00,981: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:32:01.742016321Z [2024-03-28 01:32:01,741: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4eeacc42-aeb3-41c5-88d8-d3836e946dc8] succeeded in 1.33707018000041s: None 2024-03-28T01:32:01.782812285Z [2024-03-28 01:32:01,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7236d0b8-6bce-497f-a5d3-076891e7a03e] succeeded in 1.400316240000393s: None 2024-03-28T01:32:02.257705286Z [2024-03-28 01:32:02,257: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:32:02.261896236Z [2024-03-28 01:32:02,261: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:32:02.286815369Z [2024-03-28 01:32:02,286: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:32:02.290964499Z [2024-03-28 01:32:02,290: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:32:02.291372235Z [2024-03-28 01:32:02,291: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:32:02.291787780Z [2024-03-28 01:32:02,291: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:32:02.291944125Z [2024-03-28 01:32:02,291: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:32:02.292294889Z [2024-03-28 01:32:02,292: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:32:02.292446676Z [2024-03-28 01:32:02,292: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:32:02.375886013Z [2024-03-28 01:32:02,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:32:02.379633052Z [2024-03-28 01:32:02,379: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:32:02.397107765Z [2024-03-28 01:32:02,396: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:32:02.404236361Z [2024-03-28 01:32:02,403: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:32:02.405884667Z [2024-03-28 01:32:02,405: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:32:02.406044247Z [2024-03-28 01:32:02,405: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:32:02.406318902Z [2024-03-28 01:32:02,406: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:32:02.406490526Z [2024-03-28 01:32:02,406: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:32:02.406860974Z [2024-03-28 01:32:02,406: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:32:02.407007487Z [2024-03-28 01:32:02,406: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:32:02.486190874Z [2024-03-28 01:32:02,485: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:32:03.943349386Z [2024-03-28 01:32:03,942: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73514214-3326-4695-8201-5ab763d57f29] succeeded in 3.538329665000674s: None 2024-03-28T01:32:04.456273479Z [2024-03-28 01:32:04,455: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7cdcb9f-82c0-4868-b123-34fbea9ebcc0] succeeded in 4.07511654100017s: None 2024-03-28T01:33:01.201329981Z [2024-03-28 01:33:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7252b896-bb90-45b1-9d6a-dccdeb519f68] received 2024-03-28T01:33:01.207026581Z [2024-03-28 01:33:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f9ad629-83a9-474b-b5f7-e0f03c0bbc00] received 2024-03-28T01:33:01.208570185Z [2024-03-28 01:33:01,208: INFO/ForkPoolWorker-15] [7252b896-bb90-45b1-9d6a-dccdeb519f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:33:01.212380830Z [2024-03-28 01:33:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20737bb6-bbe9-471b-8a2b-d18520096dd8] received 2024-03-28T01:33:01.219521621Z [2024-03-28 01:33:01,219: INFO/ForkPoolWorker-16] [7f9ad629-83a9-474b-b5f7-e0f03c0bbc00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:33:01.228347736Z [2024-03-28 01:33:01,228: INFO/ForkPoolWorker-1] [20737bb6-bbe9-471b-8a2b-d18520096dd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:33:01.520843313Z [2024-03-28 01:33:01,517: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:33:01.624215002Z [2024-03-28 01:33:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:33:01.678533485Z [2024-03-28 01:33:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:33:01.867418506Z [2024-03-28 01:33:01,866: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:33:01.872498829Z [2024-03-28 01:33:01,871: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:33:01.898648177Z [2024-03-28 01:33:01,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:33:01.899851291Z [2024-03-28 01:33:01,899: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:33:01.900071763Z [2024-03-28 01:33:01,899: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:33:01.900351009Z [2024-03-28 01:33:01,900: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:33:01.900680476Z [2024-03-28 01:33:01,900: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:33:01.994442093Z [2024-03-28 01:33:01,994: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:33:02.689088999Z [2024-03-28 01:33:02,688: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f9ad629-83a9-474b-b5f7-e0f03c0bbc00] succeeded in 1.4787453079998159s: None 2024-03-28T01:33:02.745320696Z [2024-03-28 01:33:02,744: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:33:02.749305716Z [2024-03-28 01:33:02,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:33:02.774167569Z [2024-03-28 01:33:02,773: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:33:02.775642180Z [2024-03-28 01:33:02,775: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:33:02.775755072Z [2024-03-28 01:33:02,775: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:33:02.775910926Z [2024-03-28 01:33:02,775: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:33:02.776023673Z [2024-03-28 01:33:02,775: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:33:02.776666157Z [2024-03-28 01:33:02,776: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:33:02.776804746Z [2024-03-28 01:33:02,776: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:33:02.868713112Z [2024-03-28 01:33:02,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:33:03.017437838Z [2024-03-28 01:33:03,016: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:33:03.021316257Z [2024-03-28 01:33:03,020: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:33:03.047814059Z [2024-03-28 01:33:03,047: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:33:03.049314812Z [2024-03-28 01:33:03,049: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:33:03.049975176Z [2024-03-28 01:33:03,049: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:33:03.050145909Z [2024-03-28 01:33:03,049: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:33:03.050185173Z [2024-03-28 01:33:03,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:33:03.050496821Z [2024-03-28 01:33:03,050: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:33:03.050552839Z [2024-03-28 01:33:03,050: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:33:03.137097322Z [2024-03-28 01:33:03,136: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:33:04.669399755Z [2024-03-28 01:33:04,668: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20737bb6-bbe9-471b-8a2b-d18520096dd8] succeeded in 3.453498483999283s: None 2024-03-28T01:33:04.913249017Z [2024-03-28 01:33:04,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7252b896-bb90-45b1-9d6a-dccdeb519f68] succeeded in 3.7098971779996646s: None 2024-03-28T01:34:01.066336697Z [2024-03-28 01:34:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb945383-0baa-4f4c-a6e4-96736f39673b] received 2024-03-28T01:34:01.069143638Z [2024-03-28 01:34:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d4b277c-266f-440b-92c7-a2fda54bd6e7] received 2024-03-28T01:34:01.074391050Z [2024-03-28 01:34:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[249906f7-766a-472f-814f-91a70734f3d1] received 2024-03-28T01:34:01.076446908Z [2024-03-28 01:34:01,076: INFO/ForkPoolWorker-15] [cb945383-0baa-4f4c-a6e4-96736f39673b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:34:01.077114631Z [2024-03-28 01:34:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b851b917-b4ce-47a1-9e82-c6e6ab2e1ae6] received 2024-03-28T01:34:01.088509589Z [2024-03-28 01:34:01,088: INFO/ForkPoolWorker-2] [b851b917-b4ce-47a1-9e82-c6e6ab2e1ae6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:34:01.089791740Z [2024-03-28 01:34:01,089: INFO/ForkPoolWorker-16] [5d4b277c-266f-440b-92c7-a2fda54bd6e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:34:01.095084324Z [2024-03-28 01:34:01,094: INFO/ForkPoolWorker-1] [249906f7-766a-472f-814f-91a70734f3d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:34:01.423964132Z [2024-03-28 01:34:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:34:01.483062036Z [2024-03-28 01:34:01,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:34:01.583914774Z [2024-03-28 01:34:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:34:01.629058281Z [2024-03-28 01:34:01,628: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:34:01.633366747Z [2024-03-28 01:34:01,632: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:34:01.668184112Z [2024-03-28 01:34:01,667: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:34:01.671426649Z [2024-03-28 01:34:01,671: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:34:01.671642150Z [2024-03-28 01:34:01,671: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:34:01.671693795Z [2024-03-28 01:34:01,671: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:34:01.671970656Z [2024-03-28 01:34:01,671: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:34:01.685794670Z [2024-03-28 01:34:01,676: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:34:01.807187686Z [2024-03-28 01:34:01,806: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:34:01.961018552Z [2024-03-28 01:34:01,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:34:02.842034763Z [2024-03-28 01:34:02,841: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b851b917-b4ce-47a1-9e82-c6e6ab2e1ae6] succeeded in 1.7626673579998169s: None 2024-03-28T01:34:02.908089809Z [2024-03-28 01:34:02,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb945383-0baa-4f4c-a6e4-96736f39673b] succeeded in 1.8369085530002849s: None 2024-03-28T01:34:03.517886678Z [2024-03-28 01:34:03,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:34:03.522059301Z [2024-03-28 01:34:03,521: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:34:03.545139590Z [2024-03-28 01:34:03,544: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:34:03.546780779Z [2024-03-28 01:34:03,546: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:34:03.546841259Z [2024-03-28 01:34:03,546: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:34:03.546986520Z [2024-03-28 01:34:03,546: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:34:03.547138977Z [2024-03-28 01:34:03,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:34:03.547424605Z [2024-03-28 01:34:03,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:34:03.547844819Z [2024-03-28 01:34:03,547: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:34:03.656936294Z [2024-03-28 01:34:03,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:34:03.744701450Z [2024-03-28 01:34:03,744: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:34:03.748257896Z [2024-03-28 01:34:03,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:34:03.776607105Z [2024-03-28 01:34:03,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:34:03.778282810Z [2024-03-28 01:34:03,777: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:34:03.778407007Z [2024-03-28 01:34:03,778: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:34:03.778658061Z [2024-03-28 01:34:03,778: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:34:03.778783401Z [2024-03-28 01:34:03,778: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:34:03.779181598Z [2024-03-28 01:34:03,778: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:34:03.779198330Z [2024-03-28 01:34:03,779: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:34:03.869628078Z [2024-03-28 01:34:03,869: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:34:05.261529655Z [2024-03-28 01:34:05,260: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[249906f7-766a-472f-814f-91a70734f3d1] succeeded in 4.184769603000859s: None 2024-03-28T01:34:05.657676229Z [2024-03-28 01:34:05,657: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d4b277c-266f-440b-92c7-a2fda54bd6e7] succeeded in 4.585006195999995s: None 2024-03-28T01:35:00.686739159Z [2024-03-28 01:35:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16602608-87df-4aba-95ba-1678b8f21e83] received 2024-03-28T01:35:00.689231734Z [2024-03-28 01:35:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e38e605b-6721-4d77-a39d-2c5039a3c53a] received 2024-03-28T01:35:00.696624357Z [2024-03-28 01:35:00,696: INFO/ForkPoolWorker-15] [16602608-87df-4aba-95ba-1678b8f21e83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:35:00.697095051Z [2024-03-28 01:35:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[401d845a-32bd-4f22-9c94-e46f0caceb36] received 2024-03-28T01:35:00.697884651Z [2024-03-28 01:35:00,697: INFO/ForkPoolWorker-16] [e38e605b-6721-4d77-a39d-2c5039a3c53a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:35:00.708750737Z [2024-03-28 01:35:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60306509-3a52-4319-8655-26ee2d3d29b3] received 2024-03-28T01:35:00.715596823Z [2024-03-28 01:35:00,715: INFO/ForkPoolWorker-1] [401d845a-32bd-4f22-9c94-e46f0caceb36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:35:00.718472219Z [2024-03-28 01:35:00,718: INFO/ForkPoolWorker-2] [60306509-3a52-4319-8655-26ee2d3d29b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:35:01.073182967Z [2024-03-28 01:35:01,068: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:35:01.088359432Z [2024-03-28 01:35:01,084: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:35:01.184607127Z [2024-03-28 01:35:01,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:35:01.226393066Z [2024-03-28 01:35:01,222: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:35:01.488518637Z [2024-03-28 01:35:01,487: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:35:01.493844431Z [2024-03-28 01:35:01,493: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:01.518623761Z [2024-03-28 01:35:01,518: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:35:01.520288151Z [2024-03-28 01:35:01,520: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:35:01.520320048Z [2024-03-28 01:35:01,520: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:35:01.520390962Z [2024-03-28 01:35:01,520: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:35:01.520916428Z [2024-03-28 01:35:01,520: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:35:01.651075422Z [2024-03-28 01:35:01,650: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:02.485098129Z [2024-03-28 01:35:02,484: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60306509-3a52-4319-8655-26ee2d3d29b3] succeeded in 1.7742939789995944s: None 2024-03-28T01:35:02.683194851Z [2024-03-28 01:35:02,682: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:35:02.686885284Z [2024-03-28 01:35:02,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:02.718650465Z [2024-03-28 01:35:02,718: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:35:02.720343033Z [2024-03-28 01:35:02,720: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:02.720461454Z [2024-03-28 01:35:02,720: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:02.720650084Z [2024-03-28 01:35:02,720: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:02.720757009Z [2024-03-28 01:35:02,720: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:35:02.721088891Z [2024-03-28 01:35:02,720: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:35:02.721232505Z [2024-03-28 01:35:02,721: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:02.793819500Z [2024-03-28 01:35:02,793: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:35:02.798011829Z [2024-03-28 01:35:02,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:02.818262046Z [2024-03-28 01:35:02,817: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:02.829866488Z [2024-03-28 01:35:02,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:35:02.831356774Z [2024-03-28 01:35:02,831: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:02.831393468Z [2024-03-28 01:35:02,831: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:02.831608419Z [2024-03-28 01:35:02,831: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:02.831627579Z [2024-03-28 01:35:02,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:35:02.832053223Z [2024-03-28 01:35:02,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:35:02.832146258Z [2024-03-28 01:35:02,832: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:02.860116285Z [2024-03-28 01:35:02,859: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:35:02.863896046Z [2024-03-28 01:35:02,863: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:02.893087257Z [2024-03-28 01:35:02,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:35:02.896052547Z [2024-03-28 01:35:02,895: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:02.896210272Z [2024-03-28 01:35:02,895: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:02.896494229Z [2024-03-28 01:35:02,896: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:02.896931041Z [2024-03-28 01:35:02,896: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:35:02.897366319Z [2024-03-28 01:35:02,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:35:02.897601894Z [2024-03-28 01:35:02,897: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:02.954339786Z [2024-03-28 01:35:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:03.010554581Z [2024-03-28 01:35:03,010: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:03.777558711Z [2024-03-28 01:35:03,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16602608-87df-4aba-95ba-1678b8f21e83] succeeded in 3.0891628370000035s: None 2024-03-28T01:35:04.533246822Z [2024-03-28 01:35:04,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[401d845a-32bd-4f22-9c94-e46f0caceb36] succeeded in 3.826378810999813s: None 2024-03-28T01:35:04.809802454Z [2024-03-28 01:35:04,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f5aab1c-ae54-4570-be2c-eb47211ae4ab] received 2024-03-28T01:35:04.817783901Z [2024-03-28 01:35:04,817: INFO/ForkPoolWorker-15] [9f5aab1c-ae54-4570-be2c-eb47211ae4ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:35:05.107466740Z [2024-03-28 01:35:05,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:35:05.916230021Z [2024-03-28 01:35:05,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e38e605b-6721-4d77-a39d-2c5039a3c53a] succeeded in 5.224917780000396s: None 2024-03-28T01:35:06.644384153Z [2024-03-28 01:35:06,643: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:35:06.648222366Z [2024-03-28 01:35:06,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:06.675910234Z [2024-03-28 01:35:06,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:35:06.678773268Z [2024-03-28 01:35:06,678: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:06.679053620Z [2024-03-28 01:35:06,678: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:06.679427112Z [2024-03-28 01:35:06,679: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:06.679613046Z [2024-03-28 01:35:06,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:35:06.680139001Z [2024-03-28 01:35:06,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:35:06.680299432Z [2024-03-28 01:35:06,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:06.784735020Z [2024-03-28 01:35:06,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:07.551428540Z [2024-03-28 01:35:07,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f5aab1c-ae54-4570-be2c-eb47211ae4ab] succeeded in 2.7390977339991878s: None 2024-03-28T01:35:08.381781759Z [2024-03-28 01:35:08,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d543fd60-e427-455d-9c0a-eb227538ff7a] received 2024-03-28T01:35:08.398066132Z [2024-03-28 01:35:08,397: INFO/ForkPoolWorker-15] [d543fd60-e427-455d-9c0a-eb227538ff7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:35:08.981401854Z [2024-03-28 01:35:08,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:35:10.598455221Z [2024-03-28 01:35:10,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:35:10.602045935Z [2024-03-28 01:35:10,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:10.627893706Z [2024-03-28 01:35:10,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:35:10.629052409Z [2024-03-28 01:35:10,628: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:10.629067599Z [2024-03-28 01:35:10,628: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:10.629174830Z [2024-03-28 01:35:10,628: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:10.629182300Z [2024-03-28 01:35:10,629: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:35:10.629424495Z [2024-03-28 01:35:10,629: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:35:10.629434329Z [2024-03-28 01:35:10,629: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:10.715367242Z [2024-03-28 01:35:10,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:11.369440140Z [2024-03-28 01:35:11,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d543fd60-e427-455d-9c0a-eb227538ff7a] succeeded in 2.9838996989992665s: None 2024-03-28T01:35:12.357842582Z [2024-03-28 01:35:12,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16648f01-aca6-4c29-8417-fd22b7938b53] received 2024-03-28T01:35:12.365192648Z [2024-03-28 01:35:12,364: INFO/ForkPoolWorker-15] [16648f01-aca6-4c29-8417-fd22b7938b53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:35:12.659040800Z [2024-03-28 01:35:12,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:35:13.844021077Z [2024-03-28 01:35:13,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:35:13.847711348Z [2024-03-28 01:35:13,847: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:35:13.871539777Z [2024-03-28 01:35:13,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:35:13.873041587Z [2024-03-28 01:35:13,872: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:35:13.873116481Z [2024-03-28 01:35:13,872: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:35:13.873238778Z [2024-03-28 01:35:13,873: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:35:13.873316451Z [2024-03-28 01:35:13,873: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:35:13.873750654Z [2024-03-28 01:35:13,873: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:35:13.873772332Z [2024-03-28 01:35:13,873: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:35:13.950316502Z [2024-03-28 01:35:13,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:35:14.534141071Z [2024-03-28 01:35:14,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16648f01-aca6-4c29-8417-fd22b7938b53] succeeded in 2.174072834999606s: None 2024-03-28T01:36:01.198391870Z [2024-03-28 01:36:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6939870-a0dc-4cd8-b586-f8bf4db0ee7c] received 2024-03-28T01:36:01.201552158Z [2024-03-28 01:36:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65ca4409-1e6c-4e64-b8b9-501c7b9ac2b1] received 2024-03-28T01:36:01.203761418Z [2024-03-28 01:36:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fce9d129-72ff-4671-a05c-b87f5ae85292] received 2024-03-28T01:36:01.211663333Z [2024-03-28 01:36:01,211: INFO/ForkPoolWorker-16] [65ca4409-1e6c-4e64-b8b9-501c7b9ac2b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:36:01.212515429Z [2024-03-28 01:36:01,211: INFO/ForkPoolWorker-15] [b6939870-a0dc-4cd8-b586-f8bf4db0ee7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:36:01.214070918Z [2024-03-28 01:36:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e975bb5-3318-48e7-942c-4673b50ce116] received 2024-03-28T01:36:01.224994958Z [2024-03-28 01:36:01,224: INFO/ForkPoolWorker-1] [fce9d129-72ff-4671-a05c-b87f5ae85292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:36:01.226267155Z [2024-03-28 01:36:01,225: INFO/ForkPoolWorker-2] [8e975bb5-3318-48e7-942c-4673b50ce116] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:36:01.609412183Z [2024-03-28 01:36:01,605: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:36:01.650878458Z [2024-03-28 01:36:01,644: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:36:01.805192189Z [2024-03-28 01:36:01,794: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:36:01.805613300Z [2024-03-28 01:36:01,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:36:01.964046711Z [2024-03-28 01:36:01,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:36:02.061516271Z [2024-03-28 01:36:02,060: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:36:02.069963816Z [2024-03-28 01:36:02,069: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:36:02.122613255Z [2024-03-28 01:36:02,122: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:36:02.126461216Z [2024-03-28 01:36:02,126: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:36:02.126564707Z [2024-03-28 01:36:02,126: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:36:02.126678494Z [2024-03-28 01:36:02,126: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:36:02.126929572Z [2024-03-28 01:36:02,126: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:36:02.360575169Z [2024-03-28 01:36:02,359: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:36:02.847195502Z [2024-03-28 01:36:02,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65ca4409-1e6c-4e64-b8b9-501c7b9ac2b1] succeeded in 1.6432198960001188s: None 2024-03-28T01:36:03.206168400Z [2024-03-28 01:36:03,205: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e975bb5-3318-48e7-942c-4673b50ce116] succeeded in 1.9890573659995425s: None 2024-03-28T01:36:03.234907078Z [2024-03-28 01:36:03,234: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:36:03.239284818Z [2024-03-28 01:36:03,238: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:36:03.262751195Z [2024-03-28 01:36:03,262: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:36:03.265037878Z [2024-03-28 01:36:03,264: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:36:03.265239204Z [2024-03-28 01:36:03,265: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:36:03.265536861Z [2024-03-28 01:36:03,265: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:36:03.265675857Z [2024-03-28 01:36:03,265: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:36:03.266115890Z [2024-03-28 01:36:03,265: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:36:03.267267011Z [2024-03-28 01:36:03,266: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:36:03.340916135Z [2024-03-28 01:36:03,340: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:36:03.345860749Z [2024-03-28 01:36:03,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:36:03.390045719Z [2024-03-28 01:36:03,386: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:36:03.403539466Z [2024-03-28 01:36:03,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:36:03.406269955Z [2024-03-28 01:36:03,406: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:36:03.406303654Z [2024-03-28 01:36:03,406: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:36:03.406475215Z [2024-03-28 01:36:03,406: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:36:03.406523881Z [2024-03-28 01:36:03,406: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:36:03.407211502Z [2024-03-28 01:36:03,406: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:36:03.407305763Z [2024-03-28 01:36:03,407: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:36:03.520669022Z [2024-03-28 01:36:03,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:36:05.536572481Z [2024-03-28 01:36:05,536: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6939870-a0dc-4cd8-b586-f8bf4db0ee7c] succeeded in 4.335233774000699s: None 2024-03-28T01:36:06.253999604Z [2024-03-28 01:36:06,253: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fce9d129-72ff-4671-a05c-b87f5ae85292] succeeded in 5.046581351999521s: None 2024-03-28T01:36:39.377995367Z [2024-03-28 01:36:39,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b67f358-19c2-4ea9-9c31-10940cbb388d] received 2024-03-28T01:36:39.386872240Z [2024-03-28 01:36:39,386: INFO/ForkPoolWorker-15] [1b67f358-19c2-4ea9-9c31-10940cbb388d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:36:39.668589691Z [2024-03-28 01:36:39,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:36:39.821109945Z [2024-03-28 01:36:39,820: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:36:39.824922772Z [2024-03-28 01:36:39,824: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:36:39.850289883Z [2024-03-28 01:36:39,850: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:36:39.851315656Z [2024-03-28 01:36:39,851: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:36:39.851339037Z [2024-03-28 01:36:39,851: INFO/ForkPoolWorker-15] Read SDNC dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 (epa_03) 2024-03-28T01:36:39.851490379Z [2024-03-28 01:36:39,851: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-28T01:36:39.851563261Z [2024-03-28 01:36:39,851: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:36:39.851773889Z [2024-03-28 01:36:39,851: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:36:39.858603939Z [2024-03-28 01:36:39,858: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 2024-03-28T01:36:39.931201614Z [2024-03-28 01:36:39,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:36:40.458451320Z [2024-03-28 01:36:40,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b67f358-19c2-4ea9-9c31-10940cbb388d] succeeded in 1.0785175470000468s: None 2024-03-28T01:37:00.809953936Z [2024-03-28 01:37:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7836f039-e9ef-4418-a914-20e9521e6699] received 2024-03-28T01:37:00.813940556Z [2024-03-28 01:37:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc04a1fe-c9ea-4042-8e8d-157d38bad561] received 2024-03-28T01:37:00.820451777Z [2024-03-28 01:37:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94651da3-6982-4552-9990-a1432e706eb2] received 2024-03-28T01:37:00.823619671Z [2024-03-28 01:37:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e79cb66b-9bcd-470a-94af-cea5e9fac405] received 2024-03-28T01:37:00.825157592Z [2024-03-28 01:37:00,824: INFO/ForkPoolWorker-16] [bc04a1fe-c9ea-4042-8e8d-157d38bad561] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:37:00.827677396Z [2024-03-28 01:37:00,827: INFO/ForkPoolWorker-15] [7836f039-e9ef-4418-a914-20e9521e6699] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:37:00.837048056Z [2024-03-28 01:37:00,836: INFO/ForkPoolWorker-1] [94651da3-6982-4552-9990-a1432e706eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:37:00.844784841Z [2024-03-28 01:37:00,844: INFO/ForkPoolWorker-2] [e79cb66b-9bcd-470a-94af-cea5e9fac405] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:37:01.246721175Z [2024-03-28 01:37:01,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:37:01.350136169Z [2024-03-28 01:37:01,346: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:37:01.399013266Z [2024-03-28 01:37:01,391: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:37:01.529968335Z [2024-03-28 01:37:01,529: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:37:01.531777562Z [2024-03-28 01:37:01,527: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:37:01.534453684Z [2024-03-28 01:37:01,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:37:01.563238768Z [2024-03-28 01:37:01,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:37:01.565890552Z [2024-03-28 01:37:01,565: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:37:01.566038893Z [2024-03-28 01:37:01,565: INFO/ForkPoolWorker-15] Read SDNC dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 (epa_03) 2024-03-28T01:37:01.566195673Z [2024-03-28 01:37:01,566: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-28T01:37:01.566333466Z [2024-03-28 01:37:01,566: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:37:01.566636399Z [2024-03-28 01:37:01,566: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:37:01.574313910Z [2024-03-28 01:37:01,574: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 2024-03-28T01:37:01.680451545Z [2024-03-28 01:37:01,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:37:01.689160295Z [2024-03-28 01:37:01,688: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:37:01.693833294Z [2024-03-28 01:37:01,693: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:37:01.734686372Z [2024-03-28 01:37:01,734: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:37:01.745776572Z [2024-03-28 01:37:01,745: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:37:01.746080474Z [2024-03-28 01:37:01,745: INFO/ForkPoolWorker-2] Read SDNC dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 (epa_03) 2024-03-28T01:37:01.746425625Z [2024-03-28 01:37:01,746: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-03-28T01:37:01.746566925Z [2024-03-28 01:37:01,746: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:37:01.747092447Z [2024-03-28 01:37:01,746: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:37:01.757314734Z [2024-03-28 01:37:01,756: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7 2024-03-28T01:37:01.914975702Z [2024-03-28 01:37:01,914: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:37:02.398335130Z [2024-03-28 01:37:02,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7836f039-e9ef-4418-a914-20e9521e6699] succeeded in 1.5827121150005041s: None 2024-03-28T01:37:02.596445896Z [2024-03-28 01:37:02,596: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e79cb66b-9bcd-470a-94af-cea5e9fac405] succeeded in 1.76560547400004s: None 2024-03-28T01:37:02.877295643Z [2024-03-28 01:37:02,876: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:37:02.881013110Z [2024-03-28 01:37:02,880: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:37:02.905989592Z [2024-03-28 01:37:02,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:37:02.908005024Z [2024-03-28 01:37:02,907: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:37:02.908056065Z [2024-03-28 01:37:02,907: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:37:02.908253079Z [2024-03-28 01:37:02,908: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:37:02.908730322Z [2024-03-28 01:37:02,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:37:02.909084769Z [2024-03-28 01:37:02,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:37:02.909266381Z [2024-03-28 01:37:02,909: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:37:02.985371570Z [2024-03-28 01:37:02,984: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:37:02.989049900Z [2024-03-28 01:37:02,988: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:37:02.994658299Z [2024-03-28 01:37:02,994: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:37:03.017644738Z [2024-03-28 01:37:03,017: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:37:03.018962582Z [2024-03-28 01:37:03,018: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:37:03.018978607Z [2024-03-28 01:37:03,018: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:37:03.019110974Z [2024-03-28 01:37:03,018: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:37:03.019148859Z [2024-03-28 01:37:03,019: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:37:03.019450829Z [2024-03-28 01:37:03,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:37:03.019520786Z [2024-03-28 01:37:03,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:37:03.124248673Z [2024-03-28 01:37:03,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:37:04.652357318Z [2024-03-28 01:37:04,651: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94651da3-6982-4552-9990-a1432e706eb2] succeeded in 3.8289145409999037s: None 2024-03-28T01:37:05.473389420Z [2024-03-28 01:37:05,472: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc04a1fe-c9ea-4042-8e8d-157d38bad561] succeeded in 4.6563884340002915s: None 2024-03-28T01:38:00.791061724Z [2024-03-28 01:38:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6021637b-b44f-4143-973b-f02db64700b3] received 2024-03-28T01:38:00.792734629Z [2024-03-28 01:38:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba993c9e-06da-4b0a-aadd-ca318936adab] received 2024-03-28T01:38:00.802081323Z [2024-03-28 01:38:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd0c7f1-7734-43fc-a3fa-07d1157b4d08] received 2024-03-28T01:38:00.805636227Z [2024-03-28 01:38:00,805: INFO/ForkPoolWorker-16] [ba993c9e-06da-4b0a-aadd-ca318936adab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:38:00.810757163Z [2024-03-28 01:38:00,810: INFO/ForkPoolWorker-1] [8bd0c7f1-7734-43fc-a3fa-07d1157b4d08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:38:00.810943150Z [2024-03-28 01:38:00,810: INFO/ForkPoolWorker-15] [6021637b-b44f-4143-973b-f02db64700b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:38:00.814248816Z [2024-03-28 01:38:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[581b63bb-d626-46ee-8758-44857d4f0bf7] received 2024-03-28T01:38:00.822176225Z [2024-03-28 01:38:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06262a01-1e4c-41d2-a76e-45affdc51eb7] received 2024-03-28T01:38:00.836216935Z [2024-03-28 01:38:00,835: INFO/ForkPoolWorker-3] [06262a01-1e4c-41d2-a76e-45affdc51eb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:38:00.840946813Z [2024-03-28 01:38:00,840: INFO/ForkPoolWorker-2] [581b63bb-d626-46ee-8758-44857d4f0bf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:38:01.168767840Z [2024-03-28 01:38:01,165: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:38:01.224712424Z [2024-03-28 01:38:01,220: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:01.258758795Z [2024-03-28 01:38:01,254: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:38:01.324812631Z [2024-03-28 01:38:01,321: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:01.373040810Z [2024-03-28 01:38:01,369: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:38:01.405168759Z [2024-03-28 01:38:01,404: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T01:38:01.409336708Z [2024-03-28 01:38:01,408: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:01.434575689Z [2024-03-28 01:38:01,434: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:38:01.438406813Z [2024-03-28 01:38:01,438: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:38:01.438450611Z [2024-03-28 01:38:01,438: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:38:01.439023732Z [2024-03-28 01:38:01,438: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T01:38:01.439972029Z [2024-03-28 01:38:01,439: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:38:01.450548763Z [2024-03-28 01:38:01,450: WARNING/ForkPoolWorker-3] Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:01.451194113Z [2024-03-28 01:38:01,450: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:01.452462398Z [2024-03-28 01:38:01,452: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T01:38:01.455530438Z [2024-03-28 01:38:01,455: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:01.480321609Z [2024-03-28 01:38:01,480: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:38:01.484981335Z [2024-03-28 01:38:01,484: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:38:01.485219437Z [2024-03-28 01:38:01,484: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:38:01.485403463Z [2024-03-28 01:38:01,485: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T01:38:01.485800428Z [2024-03-28 01:38:01,485: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:38:01.492127776Z [2024-03-28 01:38:01,491: ERROR/ForkPoolWorker-3] [06262a01-1e4c-41d2-a76e-45affdc51eb7] Failed to execute task Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T01:38:01.492148918Z Traceback (most recent call last): 2024-03-28T01:38:01.492166016Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T01:38:01.492170140Z args.func(args) 2024-03-28T01:38:01.492173946Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T01:38:01.492177621Z return func(*args, **kwargs) 2024-03-28T01:38:01.492180642Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T01:38:01.492183562Z return f(*args, **kwargs) 2024-03-28T01:38:01.492186948Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T01:38:01.492190015Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T01:38:01.492193059Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T01:38:01.492196417Z raise AirflowException( 2024-03-28T01:38:01.492200378Z airflow.exceptions.AirflowException: Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse. 2024-03-28T01:38:01.521280989Z [2024-03-28 01:38:01,520: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[06262a01-1e4c-41d2-a76e-45affdc51eb7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 06262a01-1e4c-41d2-a76e-45affdc51eb7') 2024-03-28T01:38:01.521303727Z Traceback (most recent call last): 2024-03-28T01:38:01.521308392Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T01:38:01.521311760Z R = retval = fun(*args, **kwargs) 2024-03-28T01:38:01.521314832Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T01:38:01.521318236Z return self.run(*args, **kwargs) 2024-03-28T01:38:01.521321834Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T01:38:01.521325483Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T01:38:01.521328492Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T01:38:01.521332813Z raise AirflowException(msg) 2024-03-28T01:38:01.521337571Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 06262a01-1e4c-41d2-a76e-45affdc51eb7 2024-03-28T01:38:01.536485662Z [2024-03-28 01:38:01,536: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:38:01.542372483Z [2024-03-28 01:38:01,541: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:01.569382981Z [2024-03-28 01:38:01,569: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:38:01.570793265Z [2024-03-28 01:38:01,570: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:38:01.570943116Z [2024-03-28 01:38:01,570: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:38:01.571079556Z [2024-03-28 01:38:01,570: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:38:01.571336733Z [2024-03-28 01:38:01,571: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:38:01.600817652Z [2024-03-28 01:38:01,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:38:01.664370453Z [2024-03-28 01:38:01,664: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:38:02.455317795Z [2024-03-28 01:38:02,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6021637b-b44f-4143-973b-f02db64700b3] succeeded in 1.6621872650002842s: None 2024-03-28T01:38:02.502688241Z [2024-03-28 01:38:02,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba993c9e-06da-4b0a-aadd-ca318936adab] succeeded in 1.703840183000466s: None 2024-03-28T01:38:02.889770579Z [2024-03-28 01:38:02,889: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:38:02.893642639Z [2024-03-28 01:38:02,892: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:02.913405587Z [2024-03-28 01:38:02,913: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:38:02.914994769Z [2024-03-28 01:38:02,914: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:38:02.915227298Z [2024-03-28 01:38:02,915: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:38:02.915480088Z [2024-03-28 01:38:02,915: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:38:02.915643413Z [2024-03-28 01:38:02,915: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:38:02.915995259Z [2024-03-28 01:38:02,915: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:38:02.916172160Z [2024-03-28 01:38:02,916: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:38:02.944421473Z [2024-03-28 01:38:02,944: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:38:02.948164198Z [2024-03-28 01:38:02,947: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:02.981807630Z [2024-03-28 01:38:02,981: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:38:02.983275922Z [2024-03-28 01:38:02,983: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:38:02.983396025Z [2024-03-28 01:38:02,983: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:38:02.983921203Z [2024-03-28 01:38:02,983: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:38:02.984488276Z [2024-03-28 01:38:02,984: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:38:02.985159753Z [2024-03-28 01:38:02,984: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:38:02.985179902Z [2024-03-28 01:38:02,985: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:38:03.021580684Z [2024-03-28 01:38:03,021: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:38:03.077133115Z [2024-03-28 01:38:03,076: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:38:04.716424294Z [2024-03-28 01:38:04,715: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[581b63bb-d626-46ee-8758-44857d4f0bf7] succeeded in 3.894426777999797s: None 2024-03-28T01:38:05.157463653Z [2024-03-28 01:38:05,156: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bd0c7f1-7734-43fc-a3fa-07d1157b4d08] succeeded in 4.351274571999966s: None 2024-03-28T01:38:13.095895948Z [2024-03-28 01:38:13,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77a2b7c3-783c-411c-a0f0-584906be9e6d] received 2024-03-28T01:38:13.103263362Z [2024-03-28 01:38:13,103: INFO/ForkPoolWorker-15] [77a2b7c3-783c-411c-a0f0-584906be9e6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:38:13.375479237Z [2024-03-28 01:38:13,372: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:13.545181293Z [2024-03-28 01:38:13,544: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:38:13.548939752Z [2024-03-28 01:38:13,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:13.575007682Z [2024-03-28 01:38:13,574: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:38:13.575924854Z [2024-03-28 01:38:13,575: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:38:13.576044055Z [2024-03-28 01:38:13,575: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:38:13.576118777Z [2024-03-28 01:38:13,576: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:38:13.576367290Z [2024-03-28 01:38:13,576: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:38:13.585167644Z [2024-03-28 01:38:13,584: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:13.585334260Z [2024-03-28 01:38:13,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:38:13.586173675Z [2024-03-28 01:38:13,586: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:38:13.588804046Z [2024-03-28 01:38:13,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:38:13.597524613Z [2024-03-28 01:38:13,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:38:13.600794826Z [2024-03-28 01:38:13,600: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:38:13.600837295Z [2024-03-28 01:38:13,600: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:38:13.600891919Z [2024-03-28 01:38:13,600: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:38:13.601056740Z [2024-03-28 01:38:13,600: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:38:13.604422274Z [2024-03-28 01:38:13,603: ERROR/ForkPoolWorker-15] [77a2b7c3-783c-411c-a0f0-584906be9e6d] Failed to execute task Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T01:38:13.604433990Z Traceback (most recent call last): 2024-03-28T01:38:13.604437632Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T01:38:13.604458191Z args.func(args) 2024-03-28T01:38:13.604461894Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T01:38:13.604465422Z return func(*args, **kwargs) 2024-03-28T01:38:13.604468589Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T01:38:13.604471547Z return f(*args, **kwargs) 2024-03-28T01:38:13.604474628Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T01:38:13.604477836Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T01:38:13.604481147Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T01:38:13.604484502Z raise AirflowException( 2024-03-28T01:38:13.604505469Z airflow.exceptions.AirflowException: Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse. 2024-03-28T01:38:13.633473680Z [2024-03-28 01:38:13,632: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77a2b7c3-783c-411c-a0f0-584906be9e6d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77a2b7c3-783c-411c-a0f0-584906be9e6d') 2024-03-28T01:38:13.633579476Z Traceback (most recent call last): 2024-03-28T01:38:13.633588028Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T01:38:13.633594634Z R = retval = fun(*args, **kwargs) 2024-03-28T01:38:13.633601047Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T01:38:13.633607503Z return self.run(*args, **kwargs) 2024-03-28T01:38:13.633616057Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T01:38:13.633622486Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T01:38:13.633627461Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T01:38:13.633633586Z raise AirflowException(msg) 2024-03-28T01:38:13.633642028Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77a2b7c3-783c-411c-a0f0-584906be9e6d 2024-03-28T01:39:00.644360348Z [2024-03-28 01:39:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30a33a69-3889-4889-999e-a2f7d5fe4b82] received 2024-03-28T01:39:00.646654625Z [2024-03-28 01:39:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3946d9b2-e9da-4b6b-94a9-71e90c41898a] received 2024-03-28T01:39:00.655601638Z [2024-03-28 01:39:00,655: INFO/ForkPoolWorker-15] [30a33a69-3889-4889-999e-a2f7d5fe4b82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:39:00.657287003Z [2024-03-28 01:39:00,657: INFO/ForkPoolWorker-16] [3946d9b2-e9da-4b6b-94a9-71e90c41898a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:39:00.667295274Z [2024-03-28 01:39:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3171a1d0-78b2-4aaa-ac42-b575e5aa02b8] received 2024-03-28T01:39:00.670106984Z [2024-03-28 01:39:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51064dbf-9c31-48bf-bd46-1f8711a5b750] received 2024-03-28T01:39:00.680447699Z [2024-03-28 01:39:00,680: INFO/ForkPoolWorker-1] [3171a1d0-78b2-4aaa-ac42-b575e5aa02b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:39:00.681054505Z [2024-03-28 01:39:00,680: INFO/ForkPoolWorker-2] [51064dbf-9c31-48bf-bd46-1f8711a5b750] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:39:01.043199799Z [2024-03-28 01:39:01,039: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:39:01.046412854Z [2024-03-28 01:39:01,041: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:39:01.117166075Z [2024-03-28 01:39:01,114: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:39:01.164097201Z [2024-03-28 01:39:01,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:39:01.204630338Z [2024-03-28 01:39:01,204: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:39:01.213012372Z [2024-03-28 01:39:01,212: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:39:01.259199836Z [2024-03-28 01:39:01,258: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:39:01.263242530Z [2024-03-28 01:39:01,262: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:39:01.263461235Z [2024-03-28 01:39:01,263: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:39:01.263616736Z [2024-03-28 01:39:01,263: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:39:01.264065504Z [2024-03-28 01:39:01,263: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:39:01.364539372Z [2024-03-28 01:39:01,364: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:39:01.368628819Z [2024-03-28 01:39:01,368: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:39:01.369389708Z [2024-03-28 01:39:01,369: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:39:01.394754953Z [2024-03-28 01:39:01,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:39:01.398392956Z [2024-03-28 01:39:01,398: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:39:01.398526406Z [2024-03-28 01:39:01,398: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:39:01.398587383Z [2024-03-28 01:39:01,398: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:39:01.398763027Z [2024-03-28 01:39:01,398: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:39:01.408800778Z [2024-03-28 01:39:01,408: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:39:01.408960530Z [2024-03-28 01:39:01,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:39:01.409761184Z [2024-03-28 01:39:01,409: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:39:01.412316538Z [2024-03-28 01:39:01,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:39:01.427844686Z [2024-03-28 01:39:01,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:39:01.428830014Z [2024-03-28 01:39:01,428: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:39:01.428919031Z [2024-03-28 01:39:01,428: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:39:01.428941254Z [2024-03-28 01:39:01,428: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:39:01.429841701Z [2024-03-28 01:39:01,429: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:39:01.433076748Z [2024-03-28 01:39:01,432: ERROR/ForkPoolWorker-15] [30a33a69-3889-4889-999e-a2f7d5fe4b82] Failed to execute task Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse.. 2024-03-28T01:39:01.433132481Z Traceback (most recent call last): 2024-03-28T01:39:01.433141839Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T01:39:01.433145586Z args.func(args) 2024-03-28T01:39:01.433149174Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T01:39:01.433187074Z return func(*args, **kwargs) 2024-03-28T01:39:01.433190628Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T01:39:01.433193674Z return f(*args, **kwargs) 2024-03-28T01:39:01.433196814Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T01:39:01.433199813Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T01:39:01.433202829Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T01:39:01.433205906Z raise AirflowException( 2024-03-28T01:39:01.433209577Z airflow.exceptions.AirflowException: Dag 'sdnc_status_dd9c9006-0e58-4f1a-b87d-0f4e54d6e9f7' could not be found; either it does not exist or it failed to parse. 2024-03-28T01:39:01.466448217Z [2024-03-28 01:39:01,465: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30a33a69-3889-4889-999e-a2f7d5fe4b82] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 30a33a69-3889-4889-999e-a2f7d5fe4b82') 2024-03-28T01:39:01.466471646Z Traceback (most recent call last): 2024-03-28T01:39:01.466475885Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T01:39:01.466478943Z R = retval = fun(*args, **kwargs) 2024-03-28T01:39:01.466482000Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T01:39:01.466518257Z return self.run(*args, **kwargs) 2024-03-28T01:39:01.466522080Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T01:39:01.466525809Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T01:39:01.466528899Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T01:39:01.466532275Z raise AirflowException(msg) 2024-03-28T01:39:01.466536462Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 30a33a69-3889-4889-999e-a2f7d5fe4b82 2024-03-28T01:39:02.009737454Z [2024-03-28 01:39:02,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3946d9b2-e9da-4b6b-94a9-71e90c41898a] succeeded in 1.3609524149997014s: None 2024-03-28T01:39:02.496972566Z [2024-03-28 01:39:02,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:39:02.503757602Z [2024-03-28 01:39:02,503: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:39:02.522365677Z [2024-03-28 01:39:02,521: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:39:02.529089623Z [2024-03-28 01:39:02,528: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:39:02.545562626Z [2024-03-28 01:39:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:39:02.548019512Z [2024-03-28 01:39:02,547: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:39:02.548086243Z [2024-03-28 01:39:02,547: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:39:02.548382757Z [2024-03-28 01:39:02,548: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:39:02.550933790Z [2024-03-28 01:39:02,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:39:02.551538952Z [2024-03-28 01:39:02,551: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:39:02.551794897Z [2024-03-28 01:39:02,551: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:39:02.558173042Z [2024-03-28 01:39:02,557: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:39:02.559918353Z [2024-03-28 01:39:02,559: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:39:02.559997081Z [2024-03-28 01:39:02,559: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:39:02.560252093Z [2024-03-28 01:39:02,559: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:39:02.560279642Z [2024-03-28 01:39:02,560: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:39:02.561041159Z [2024-03-28 01:39:02,560: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:39:02.561201630Z [2024-03-28 01:39:02,561: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:39:02.669107756Z [2024-03-28 01:39:02,668: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:39:02.675392796Z [2024-03-28 01:39:02,674: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:39:04.508008834Z [2024-03-28 01:39:04,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3171a1d0-78b2-4aaa-ac42-b575e5aa02b8] succeeded in 3.8375903590003873s: None 2024-03-28T01:39:05.146613672Z [2024-03-28 01:39:05,145: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[51064dbf-9c31-48bf-bd46-1f8711a5b750] succeeded in 4.473664058000395s: None 2024-03-28T01:40:00.453773567Z [2024-03-28 01:40:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cf8a830-f255-4195-bff1-61118854ccdc] received 2024-03-28T01:40:00.456249695Z [2024-03-28 01:40:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[299fd584-f75d-4b40-adc9-ed0d8b696d6d] received 2024-03-28T01:40:00.462260874Z [2024-03-28 01:40:00,462: INFO/ForkPoolWorker-15] [1cf8a830-f255-4195-bff1-61118854ccdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:40:00.466608294Z [2024-03-28 01:40:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[befcf2b7-fe82-4d52-b233-eeb1d5f00c5f] received 2024-03-28T01:40:00.467464087Z [2024-03-28 01:40:00,467: INFO/ForkPoolWorker-16] [299fd584-f75d-4b40-adc9-ed0d8b696d6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:40:00.478029786Z [2024-03-28 01:40:00,477: INFO/ForkPoolWorker-1] [befcf2b7-fe82-4d52-b233-eeb1d5f00c5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:40:00.482372770Z [2024-03-28 01:40:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c675877-f5da-4619-9072-92382c2f0636] received 2024-03-28T01:40:00.486083819Z [2024-03-28 01:40:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b94d9474-9680-48c8-91d6-079469c72cc6] received 2024-03-28T01:40:00.489237543Z [2024-03-28 01:40:00,489: INFO/ForkPoolWorker-2] [5c675877-f5da-4619-9072-92382c2f0636] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:40:00.492664845Z [2024-03-28 01:40:00,492: INFO/ForkPoolWorker-3] [b94d9474-9680-48c8-91d6-079469c72cc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:40:00.857574351Z [2024-03-28 01:40:00,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:40:00.866721993Z [2024-03-28 01:40:00,862: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:40:00.885803574Z [2024-03-28 01:40:00,882: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:40:01.018997980Z [2024-03-28 01:40:01,015: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:40:01.132444003Z [2024-03-28 01:40:01,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:40:01.233776900Z [2024-03-28 01:40:01,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:01.343184770Z [2024-03-28 01:40:01,342: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:40:01.347299038Z [2024-03-28 01:40:01,346: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:01.384337933Z [2024-03-28 01:40:01,383: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:40:01.386290867Z [2024-03-28 01:40:01,386: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:40:01.386506129Z [2024-03-28 01:40:01,386: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:40:01.386639722Z [2024-03-28 01:40:01,386: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:40:01.386926682Z [2024-03-28 01:40:01,386: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:40:01.548488626Z [2024-03-28 01:40:01,548: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:01.871591320Z [2024-03-28 01:40:01,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5c675877-f5da-4619-9072-92382c2f0636] succeeded in 1.387517719999778s: None 2024-03-28T01:40:02.371098853Z [2024-03-28 01:40:02,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cf8a830-f255-4195-bff1-61118854ccdc] succeeded in 1.913627696999356s: None 2024-03-28T01:40:02.706665660Z [2024-03-28 01:40:02,706: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:40:02.710345966Z [2024-03-28 01:40:02,709: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:02.743019956Z [2024-03-28 01:40:02,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:40:02.744520659Z [2024-03-28 01:40:02,744: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:02.744686709Z [2024-03-28 01:40:02,744: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:02.744849571Z [2024-03-28 01:40:02,744: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:02.744942959Z [2024-03-28 01:40:02,744: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:40:02.745228705Z [2024-03-28 01:40:02,745: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:40:02.745683770Z [2024-03-28 01:40:02,745: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:02.828995514Z [2024-03-28 01:40:02,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:02.902075242Z [2024-03-28 01:40:02,901: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T01:40:02.906723047Z [2024-03-28 01:40:02,906: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:02.927695650Z [2024-03-28 01:40:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:40:02.934416643Z [2024-03-28 01:40:02,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:02.952815315Z [2024-03-28 01:40:02,952: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:40:02.963165032Z [2024-03-28 01:40:02,962: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:02.963524933Z [2024-03-28 01:40:02,963: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:02.966249169Z [2024-03-28 01:40:02,963: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:02.966802669Z [2024-03-28 01:40:02,966: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T01:40:02.967324132Z [2024-03-28 01:40:02,967: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:40:02.967680242Z [2024-03-28 01:40:02,967: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:02.980487431Z [2024-03-28 01:40:02,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:40:02.983151170Z [2024-03-28 01:40:02,982: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:02.983991239Z [2024-03-28 01:40:02,983: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:02.984363954Z [2024-03-28 01:40:02,983: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:02.984571862Z [2024-03-28 01:40:02,984: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:40:02.985043788Z [2024-03-28 01:40:02,984: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:40:02.987385167Z [2024-03-28 01:40:02,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:03.182940033Z [2024-03-28 01:40:03,182: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:03.202172538Z [2024-03-28 01:40:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:03.933681844Z [2024-03-28 01:40:03,932: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[befcf2b7-fe82-4d52-b233-eeb1d5f00c5f] succeeded in 3.46489060300064s: None 2024-03-28T01:40:04.572280370Z [2024-03-28 01:40:04,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6a01294-b358-4421-ac12-e097308c7268] received 2024-03-28T01:40:04.586019906Z [2024-03-28 01:40:04,585: INFO/ForkPoolWorker-15] [b6a01294-b358-4421-ac12-e097308c7268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:40:04.869062749Z [2024-03-28 01:40:04,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:40:05.049937496Z [2024-03-28 01:40:05,049: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[299fd584-f75d-4b40-adc9-ed0d8b696d6d] succeeded in 4.590325832000417s: None 2024-03-28T01:40:05.693846523Z [2024-03-28 01:40:05,692: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b94d9474-9680-48c8-91d6-079469c72cc6] succeeded in 5.205707653999525s: None 2024-03-28T01:40:06.039053337Z [2024-03-28 01:40:06,038: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:40:06.042680695Z [2024-03-28 01:40:06,042: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:06.077302664Z [2024-03-28 01:40:06,077: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:40:06.078784115Z [2024-03-28 01:40:06,078: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:06.079001160Z [2024-03-28 01:40:06,078: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:06.079187445Z [2024-03-28 01:40:06,078: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:06.079285614Z [2024-03-28 01:40:06,079: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:40:06.079583986Z [2024-03-28 01:40:06,079: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:40:06.079795132Z [2024-03-28 01:40:06,079: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:06.206465852Z [2024-03-28 01:40:06,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:06.836540246Z [2024-03-28 01:40:06,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6a01294-b358-4421-ac12-e097308c7268] succeeded in 2.261328087000038s: None 2024-03-28T01:40:07.692360631Z [2024-03-28 01:40:07,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc87681-d6e1-4f53-a26e-9470a01ea494] received 2024-03-28T01:40:07.702102611Z [2024-03-28 01:40:07,701: INFO/ForkPoolWorker-15] [5dc87681-d6e1-4f53-a26e-9470a01ea494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:40:08.102801998Z [2024-03-28 01:40:08,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:40:09.458892550Z [2024-03-28 01:40:09,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:40:09.463074218Z [2024-03-28 01:40:09,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:09.493515479Z [2024-03-28 01:40:09,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:40:09.495233386Z [2024-03-28 01:40:09,494: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:09.495293050Z [2024-03-28 01:40:09,495: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:09.495471260Z [2024-03-28 01:40:09,495: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:09.495582596Z [2024-03-28 01:40:09,495: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:40:09.496047405Z [2024-03-28 01:40:09,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:40:09.496126689Z [2024-03-28 01:40:09,496: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:09.616231072Z [2024-03-28 01:40:09,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:10.242000431Z [2024-03-28 01:40:10,241: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dc87681-d6e1-4f53-a26e-9470a01ea494] succeeded in 2.5474108979997254s: None 2024-03-28T01:40:11.194816741Z [2024-03-28 01:40:11,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b39e54c-5e68-4522-91e5-b60515e6be1a] received 2024-03-28T01:40:11.203588534Z [2024-03-28 01:40:11,203: INFO/ForkPoolWorker-15] [9b39e54c-5e68-4522-91e5-b60515e6be1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:40:11.549984659Z [2024-03-28 01:40:11,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:40:12.699692138Z [2024-03-28 01:40:12,699: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:40:12.703250456Z [2024-03-28 01:40:12,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:40:12.728265868Z [2024-03-28 01:40:12,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:40:12.731227399Z [2024-03-28 01:40:12,730: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:40:12.731505977Z [2024-03-28 01:40:12,731: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:40:12.731839349Z [2024-03-28 01:40:12,731: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:40:12.732072578Z [2024-03-28 01:40:12,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:40:12.732703097Z [2024-03-28 01:40:12,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:40:12.732927465Z [2024-03-28 01:40:12,732: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:40:12.847421396Z [2024-03-28 01:40:12,847: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:40:13.490750066Z [2024-03-28 01:40:13,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b39e54c-5e68-4522-91e5-b60515e6be1a] succeeded in 2.294237047000024s: None 2024-03-28T01:41:01.169282414Z [2024-03-28 01:41:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84f72e1e-7fab-4041-8db4-022026ac2a3d] received 2024-03-28T01:41:01.171096390Z [2024-03-28 01:41:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7da8842c-4688-4ff0-8413-70b67e1a7003] received 2024-03-28T01:41:01.178383839Z [2024-03-28 01:41:01,177: INFO/ForkPoolWorker-15] [84f72e1e-7fab-4041-8db4-022026ac2a3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:41:01.180480374Z [2024-03-28 01:41:01,180: INFO/ForkPoolWorker-16] [7da8842c-4688-4ff0-8413-70b67e1a7003] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:41:01.184342430Z [2024-03-28 01:41:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d99624dd-34cb-4eee-9163-753e6ce707ab] received 2024-03-28T01:41:01.192497419Z [2024-03-28 01:41:01,192: INFO/ForkPoolWorker-1] [d99624dd-34cb-4eee-9163-753e6ce707ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:41:01.503414557Z [2024-03-28 01:41:01,500: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:41:01.571442032Z [2024-03-28 01:41:01,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:41:01.641746247Z [2024-03-28 01:41:01,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:41:01.740869315Z [2024-03-28 01:41:01,740: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:41:01.745382605Z [2024-03-28 01:41:01,744: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:41:01.768217076Z [2024-03-28 01:41:01,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:41:01.769567081Z [2024-03-28 01:41:01,769: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:41:01.769881827Z [2024-03-28 01:41:01,769: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:41:01.770018407Z [2024-03-28 01:41:01,769: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:41:01.770324014Z [2024-03-28 01:41:01,770: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:41:01.882203939Z [2024-03-28 01:41:01,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:41:02.691535051Z [2024-03-28 01:41:02,690: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7da8842c-4688-4ff0-8413-70b67e1a7003] succeeded in 1.5186188409998067s: None 2024-03-28T01:41:03.107968193Z [2024-03-28 01:41:03,107: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:41:03.112016747Z [2024-03-28 01:41:03,111: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:41:03.146689965Z [2024-03-28 01:41:03,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:41:03.150891067Z [2024-03-28 01:41:03,149: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:41:03.151039163Z [2024-03-28 01:41:03,150: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:41:03.151255019Z [2024-03-28 01:41:03,150: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:41:03.151365424Z [2024-03-28 01:41:03,151: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:41:03.151941326Z [2024-03-28 01:41:03,151: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:41:03.151998094Z [2024-03-28 01:41:03,151: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:41:03.252241800Z [2024-03-28 01:41:03,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:41:03.300657957Z [2024-03-28 01:41:03,300: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:41:03.304494349Z [2024-03-28 01:41:03,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:41:03.362631246Z [2024-03-28 01:41:03,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:41:03.366329966Z [2024-03-28 01:41:03,366: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:41:03.366512438Z [2024-03-28 01:41:03,366: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:41:03.366731357Z [2024-03-28 01:41:03,366: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:41:03.369865184Z [2024-03-28 01:41:03,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:41:03.370358431Z [2024-03-28 01:41:03,370: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:41:03.370553872Z [2024-03-28 01:41:03,370: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:41:03.494924248Z [2024-03-28 01:41:03,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:41:05.102693281Z [2024-03-28 01:41:05,102: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d99624dd-34cb-4eee-9163-753e6ce707ab] succeeded in 3.91654314599964s: None 2024-03-28T01:41:05.385106020Z [2024-03-28 01:41:05,384: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84f72e1e-7fab-4041-8db4-022026ac2a3d] succeeded in 4.21370761199978s: None 2024-03-28T01:42:00.957638264Z [2024-03-28 01:42:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[821b4f51-b002-40a4-a1d8-9695f4b2e8ce] received 2024-03-28T01:42:00.960594880Z [2024-03-28 01:42:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bcf6ace-a593-48ba-a01b-dd8f8c20c890] received 2024-03-28T01:42:00.965358603Z [2024-03-28 01:42:00,965: INFO/ForkPoolWorker-15] [821b4f51-b002-40a4-a1d8-9695f4b2e8ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:42:00.968602681Z [2024-03-28 01:42:00,968: INFO/ForkPoolWorker-16] [3bcf6ace-a593-48ba-a01b-dd8f8c20c890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:42:00.971910036Z [2024-03-28 01:42:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86990130-ca21-46bb-9403-647d855600c7] received 2024-03-28T01:42:00.982667103Z [2024-03-28 01:42:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53042da0-67e0-4d17-9578-90389bf8c3a2] received 2024-03-28T01:42:00.983426319Z [2024-03-28 01:42:00,983: INFO/ForkPoolWorker-1] [86990130-ca21-46bb-9403-647d855600c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:42:00.995076128Z [2024-03-28 01:42:00,994: INFO/ForkPoolWorker-2] [53042da0-67e0-4d17-9578-90389bf8c3a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:42:01.250096454Z [2024-03-28 01:42:01,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:42:01.350708921Z [2024-03-28 01:42:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:42:01.392518936Z [2024-03-28 01:42:01,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:42:01.460007879Z [2024-03-28 01:42:01,456: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:42:01.675117987Z [2024-03-28 01:42:01,674: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:42:01.680431035Z [2024-03-28 01:42:01,679: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:42:01.711435890Z [2024-03-28 01:42:01,711: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:42:01.712600050Z [2024-03-28 01:42:01,712: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:42:01.712685066Z [2024-03-28 01:42:01,712: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:42:01.712772709Z [2024-03-28 01:42:01,712: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:42:01.712995883Z [2024-03-28 01:42:01,712: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:42:01.846278438Z [2024-03-28 01:42:01,845: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:42:01.926419476Z [2024-03-28 01:42:01,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:42:02.671805180Z [2024-03-28 01:42:02,671: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[821b4f51-b002-40a4-a1d8-9695f4b2e8ce] succeeded in 1.7120086969998738s: None 2024-03-28T01:42:02.692173170Z [2024-03-28 01:42:02,691: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[53042da0-67e0-4d17-9578-90389bf8c3a2] succeeded in 1.7028818429998864s: None 2024-03-28T01:42:02.818598850Z [2024-03-28 01:42:02,818: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:42:02.824031612Z [2024-03-28 01:42:02,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:42:02.850908412Z [2024-03-28 01:42:02,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:42:02.852665510Z [2024-03-28 01:42:02,852: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:42:02.852762411Z [2024-03-28 01:42:02,852: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:42:02.852953160Z [2024-03-28 01:42:02,852: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:42:02.853037190Z [2024-03-28 01:42:02,852: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:42:02.853308569Z [2024-03-28 01:42:02,853: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:42:02.853437946Z [2024-03-28 01:42:02,853: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:42:02.879813289Z [2024-03-28 01:42:02,879: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:42:02.883317714Z [2024-03-28 01:42:02,882: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:42:02.912817161Z [2024-03-28 01:42:02,912: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:42:02.914285591Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:42:02.914329338Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:42:02.914376326Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:42:02.914428090Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:42:02.914680202Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:42:02.914741564Z [2024-03-28 01:42:02,914: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:42:02.935156521Z [2024-03-28 01:42:02,934: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:42:02.998531409Z [2024-03-28 01:42:02,998: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:42:04.455055036Z [2024-03-28 01:42:04,454: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86990130-ca21-46bb-9403-647d855600c7] succeeded in 3.4798836559994015s: None 2024-03-28T01:42:04.787162573Z [2024-03-28 01:42:04,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bcf6ace-a593-48ba-a01b-dd8f8c20c890] succeeded in 3.8250761410008636s: None 2024-03-28T01:43:00.997365494Z [2024-03-28 01:43:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[242a1397-7896-4f16-9282-0a29d6c76ebd] received 2024-03-28T01:43:01.011486161Z [2024-03-28 01:43:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea4f4170-c24b-455e-9ae8-46d8a3de3f44] received 2024-03-28T01:43:01.012080750Z [2024-03-28 01:43:01,011: INFO/ForkPoolWorker-15] [242a1397-7896-4f16-9282-0a29d6c76ebd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:43:01.016451921Z [2024-03-28 01:43:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cc22aa3-4c77-4289-8870-d00f8ccd1801] received 2024-03-28T01:43:01.028233382Z [2024-03-28 01:43:01,027: INFO/ForkPoolWorker-16] [ea4f4170-c24b-455e-9ae8-46d8a3de3f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:43:01.028825531Z [2024-03-28 01:43:01,028: INFO/ForkPoolWorker-1] [8cc22aa3-4c77-4289-8870-d00f8ccd1801] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:43:01.345922578Z [2024-03-28 01:43:01,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:43:01.406947676Z [2024-03-28 01:43:01,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:43:01.500094498Z [2024-03-28 01:43:01,495: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:43:01.642225156Z [2024-03-28 01:43:01,641: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:43:01.648333752Z [2024-03-28 01:43:01,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:43:01.673312620Z [2024-03-28 01:43:01,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:43:01.675579129Z [2024-03-28 01:43:01,675: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:43:01.675742763Z [2024-03-28 01:43:01,675: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:43:01.675912695Z [2024-03-28 01:43:01,675: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:43:01.676640493Z [2024-03-28 01:43:01,676: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:43:01.795731551Z [2024-03-28 01:43:01,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:43:02.582205988Z [2024-03-28 01:43:02,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[242a1397-7896-4f16-9282-0a29d6c76ebd] succeeded in 1.5829139549996398s: None 2024-03-28T01:43:03.025526407Z [2024-03-28 01:43:03,025: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:43:03.028808144Z [2024-03-28 01:43:03,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:43:03.048619707Z [2024-03-28 01:43:03,048: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:43:03.050609987Z [2024-03-28 01:43:03,050: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:43:03.050678570Z [2024-03-28 01:43:03,050: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:43:03.050865072Z [2024-03-28 01:43:03,050: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:43:03.050924674Z [2024-03-28 01:43:03,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:43:03.051232536Z [2024-03-28 01:43:03,051: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:43:03.051320561Z [2024-03-28 01:43:03,051: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:43:03.169555262Z [2024-03-28 01:43:03,169: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:43:03.175599779Z [2024-03-28 01:43:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:43:03.179337804Z [2024-03-28 01:43:03,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:43:03.210967976Z [2024-03-28 01:43:03,210: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:43:03.212354769Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:43:03.212466756Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:43:03.212650793Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:43:03.212736941Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:43:03.212967930Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:43:03.213137740Z [2024-03-28 01:43:03,212: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:43:03.357363229Z [2024-03-28 01:43:03,357: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:43:04.952154390Z [2024-03-28 01:43:04,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cc22aa3-4c77-4289-8870-d00f8ccd1801] succeeded in 3.930769598000552s: None 2024-03-28T01:43:05.882958495Z [2024-03-28 01:43:05,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea4f4170-c24b-455e-9ae8-46d8a3de3f44] succeeded in 4.862779148999834s: None 2024-03-28T01:44:00.934694405Z [2024-03-28 01:44:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfdba44a-30db-47fa-acc6-bf1c206eb987] received 2024-03-28T01:44:00.938845739Z [2024-03-28 01:44:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[470d3ac3-99ec-4e24-85f3-861aa61f38d4] received 2024-03-28T01:44:00.943013150Z [2024-03-28 01:44:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe95c5b7-8fd2-4ce9-96bf-d360a77d81f7] received 2024-03-28T01:44:00.946203954Z [2024-03-28 01:44:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb3cc251-c011-4ca1-bdd2-a58cf749bbc9] received 2024-03-28T01:44:00.951533046Z [2024-03-28 01:44:00,951: INFO/ForkPoolWorker-16] [470d3ac3-99ec-4e24-85f3-861aa61f38d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:44:00.954633121Z [2024-03-28 01:44:00,954: INFO/ForkPoolWorker-1] [fe95c5b7-8fd2-4ce9-96bf-d360a77d81f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:44:00.963382157Z [2024-03-28 01:44:00,963: INFO/ForkPoolWorker-15] [dfdba44a-30db-47fa-acc6-bf1c206eb987] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:44:00.966750312Z [2024-03-28 01:44:00,966: INFO/ForkPoolWorker-2] [eb3cc251-c011-4ca1-bdd2-a58cf749bbc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:44:01.332297485Z [2024-03-28 01:44:01,329: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:44:01.354902241Z [2024-03-28 01:44:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:44:01.365014588Z [2024-03-28 01:44:01,360: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:44:01.462670154Z [2024-03-28 01:44:01,459: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:44:01.543882915Z [2024-03-28 01:44:01,543: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:44:01.550016753Z [2024-03-28 01:44:01,549: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:44:01.592716185Z [2024-03-28 01:44:01,592: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:44:01.594321827Z [2024-03-28 01:44:01,594: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:44:01.594499464Z [2024-03-28 01:44:01,594: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:44:01.594626965Z [2024-03-28 01:44:01,594: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:44:01.594897095Z [2024-03-28 01:44:01,594: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:44:01.649303377Z [2024-03-28 01:44:01,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:44:01.733189168Z [2024-03-28 01:44:01,732: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:44:02.256270906Z [2024-03-28 01:44:02,255: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfdba44a-30db-47fa-acc6-bf1c206eb987] succeeded in 1.314867494000282s: None 2024-03-28T01:44:02.470919011Z [2024-03-28 01:44:02,470: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb3cc251-c011-4ca1-bdd2-a58cf749bbc9] succeeded in 1.519518240999787s: None 2024-03-28T01:44:02.769394534Z [2024-03-28 01:44:02,768: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:44:02.773215875Z [2024-03-28 01:44:02,772: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:44:02.791255278Z [2024-03-28 01:44:02,790: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:44:02.793131652Z [2024-03-28 01:44:02,792: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:44:02.793279614Z [2024-03-28 01:44:02,793: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:44:02.793457955Z [2024-03-28 01:44:02,793: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:44:02.793648887Z [2024-03-28 01:44:02,793: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:44:02.794021065Z [2024-03-28 01:44:02,793: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:44:02.794150740Z [2024-03-28 01:44:02,793: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:44:02.898910860Z [2024-03-28 01:44:02,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:44:03.100315298Z [2024-03-28 01:44:03,099: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:44:03.104084195Z [2024-03-28 01:44:03,103: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:44:03.129091872Z [2024-03-28 01:44:03,128: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:44:03.131098679Z [2024-03-28 01:44:03,130: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:44:03.131143706Z [2024-03-28 01:44:03,130: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:44:03.131171009Z [2024-03-28 01:44:03,131: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:44:03.131252040Z [2024-03-28 01:44:03,131: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:44:03.131614233Z [2024-03-28 01:44:03,131: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:44:03.131677162Z [2024-03-28 01:44:03,131: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:44:03.228952855Z [2024-03-28 01:44:03,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:44:04.510824820Z [2024-03-28 01:44:04,510: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe95c5b7-8fd2-4ce9-96bf-d360a77d81f7] succeeded in 3.5619809030004035s: None 2024-03-28T01:44:05.449334646Z [2024-03-28 01:44:05,448: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[470d3ac3-99ec-4e24-85f3-861aa61f38d4] succeeded in 4.506499355999949s: None 2024-03-28T01:45:00.937953287Z [2024-03-28 01:45:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27a89339-5566-43ad-8492-6162b4713178] received 2024-03-28T01:45:00.940094986Z [2024-03-28 01:45:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b332b695-f1bb-42ce-938a-37b5ec36872d] received 2024-03-28T01:45:00.950008468Z [2024-03-28 01:45:00,949: INFO/ForkPoolWorker-15] [27a89339-5566-43ad-8492-6162b4713178] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:45:00.951167695Z [2024-03-28 01:45:00,950: INFO/ForkPoolWorker-16] [b332b695-f1bb-42ce-938a-37b5ec36872d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:45:00.956173191Z [2024-03-28 01:45:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c06a602-bc0e-479d-968f-617d05b75bad] received 2024-03-28T01:45:00.971656201Z [2024-03-28 01:45:00,971: INFO/ForkPoolWorker-1] [2c06a602-bc0e-479d-968f-617d05b75bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:45:00.977284163Z [2024-03-28 01:45:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ea323b9-43b7-4282-a3d0-73896189dce5] received 2024-03-28T01:45:00.996402819Z [2024-03-28 01:45:00,996: INFO/ForkPoolWorker-2] [7ea323b9-43b7-4282-a3d0-73896189dce5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:45:01.330381599Z [2024-03-28 01:45:01,325: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:45:01.373293669Z [2024-03-28 01:45:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:45:01.510713699Z [2024-03-28 01:45:01,510: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:45:01.516016593Z [2024-03-28 01:45:01,515: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:01.562938837Z [2024-03-28 01:45:01,562: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:45:01.566505527Z [2024-03-28 01:45:01,566: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:45:01.566537322Z [2024-03-28 01:45:01,566: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:45:01.566593466Z [2024-03-28 01:45:01,566: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:45:01.566964643Z [2024-03-28 01:45:01,566: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:45:01.635363227Z [2024-03-28 01:45:01,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:45:01.686370935Z [2024-03-28 01:45:01,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:45:01.725082494Z [2024-03-28 01:45:01,724: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:02.548682500Z [2024-03-28 01:45:02,546: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ea323b9-43b7-4282-a3d0-73896189dce5] succeeded in 1.565169918999345s: None 2024-03-28T01:45:03.259693033Z [2024-03-28 01:45:03,259: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:45:03.263383675Z [2024-03-28 01:45:03,262: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:03.287820308Z [2024-03-28 01:45:03,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:45:03.289892156Z [2024-03-28 01:45:03,289: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:03.289980308Z [2024-03-28 01:45:03,289: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:03.290163569Z [2024-03-28 01:45:03,289: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:03.290281863Z [2024-03-28 01:45:03,290: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:45:03.290642162Z [2024-03-28 01:45:03,290: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:45:03.290733662Z [2024-03-28 01:45:03,290: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:03.446608148Z [2024-03-28 01:45:03,446: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:45:03.449635029Z [2024-03-28 01:45:03,449: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:45:03.450418994Z [2024-03-28 01:45:03,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:03.451492644Z [2024-03-28 01:45:03,451: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:03.453758400Z [2024-03-28 01:45:03,453: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:03.492039229Z [2024-03-28 01:45:03,491: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:45:03.495342678Z [2024-03-28 01:45:03,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:45:03.496492264Z [2024-03-28 01:45:03,496: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:03.496679019Z [2024-03-28 01:45:03,496: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:03.496848860Z [2024-03-28 01:45:03,496: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:03.496959726Z [2024-03-28 01:45:03,496: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:45:03.497468466Z [2024-03-28 01:45:03,497: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:45:03.497629413Z [2024-03-28 01:45:03,497: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:03.503968673Z [2024-03-28 01:45:03,503: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:03.504153370Z [2024-03-28 01:45:03,503: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:03.504329786Z [2024-03-28 01:45:03,504: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:03.504486628Z [2024-03-28 01:45:03,504: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:45:03.504849919Z [2024-03-28 01:45:03,504: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:45:03.505002120Z [2024-03-28 01:45:03,504: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:03.619656495Z [2024-03-28 01:45:03,619: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:03.651690039Z [2024-03-28 01:45:03,651: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:04.393008093Z [2024-03-28 01:45:04,392: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27a89339-5566-43ad-8492-6162b4713178] succeeded in 3.451258263999989s: None 2024-03-28T01:45:05.190401152Z [2024-03-28 01:45:05,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62660af1-0092-4d77-8d7a-94e61e5ec3c2] received 2024-03-28T01:45:05.199192422Z [2024-03-28 01:45:05,198: INFO/ForkPoolWorker-15] [62660af1-0092-4d77-8d7a-94e61e5ec3c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:45:05.288633481Z [2024-03-28 01:45:05,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c06a602-bc0e-479d-968f-617d05b75bad] succeeded in 4.329973150999649s: None 2024-03-28T01:45:05.558705714Z [2024-03-28 01:45:05,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:45:05.648254712Z [2024-03-28 01:45:05,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b332b695-f1bb-42ce-938a-37b5ec36872d] succeeded in 4.703564032000031s: None 2024-03-28T01:45:06.812413713Z [2024-03-28 01:45:06,812: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:45:06.816215149Z [2024-03-28 01:45:06,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:06.836374014Z [2024-03-28 01:45:06,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:45:06.838518491Z [2024-03-28 01:45:06,838: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:06.838725078Z [2024-03-28 01:45:06,838: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:06.839055408Z [2024-03-28 01:45:06,838: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:06.839289781Z [2024-03-28 01:45:06,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:45:06.839861825Z [2024-03-28 01:45:06,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:45:06.840082689Z [2024-03-28 01:45:06,839: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:06.935764460Z [2024-03-28 01:45:06,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:07.584923867Z [2024-03-28 01:45:07,584: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62660af1-0092-4d77-8d7a-94e61e5ec3c2] succeeded in 2.39116637799998s: None 2024-03-28T01:45:07.845672056Z [2024-03-28 01:45:07,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11c470f2-1311-412a-b604-9df6d72672bc] received 2024-03-28T01:45:07.850834853Z [2024-03-28 01:45:07,850: INFO/ForkPoolWorker-15] [11c470f2-1311-412a-b604-9df6d72672bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:45:08.148037862Z [2024-03-28 01:45:08,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:45:09.438757320Z [2024-03-28 01:45:09,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:45:09.444091446Z [2024-03-28 01:45:09,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:09.484362373Z [2024-03-28 01:45:09,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:45:09.493321258Z [2024-03-28 01:45:09,492: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:09.493348494Z [2024-03-28 01:45:09,493: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:09.493420672Z [2024-03-28 01:45:09,493: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:09.493460587Z [2024-03-28 01:45:09,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:45:09.504047993Z [2024-03-28 01:45:09,503: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:45:09.504115505Z [2024-03-28 01:45:09,503: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:09.602014769Z [2024-03-28 01:45:09,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:10.250177310Z [2024-03-28 01:45:10,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5144329e-65d5-46ce-be7d-4a795141f8e5] received 2024-03-28T01:45:10.266660372Z [2024-03-28 01:45:10,266: INFO/ForkPoolWorker-16] [5144329e-65d5-46ce-be7d-4a795141f8e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:45:10.340462200Z [2024-03-28 01:45:10,340: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11c470f2-1311-412a-b604-9df6d72672bc] succeeded in 2.4967746299998907s: None 2024-03-28T01:45:10.664800846Z [2024-03-28 01:45:10,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:45:12.143290647Z [2024-03-28 01:45:12,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:45:12.146599169Z [2024-03-28 01:45:12,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:45:12.164267034Z [2024-03-28 01:45:12,164: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:45:12.165502178Z [2024-03-28 01:45:12,165: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:45:12.165664822Z [2024-03-28 01:45:12,165: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:45:12.165848840Z [2024-03-28 01:45:12,165: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:45:12.166001412Z [2024-03-28 01:45:12,165: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:45:12.166290331Z [2024-03-28 01:45:12,166: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:45:12.166374070Z [2024-03-28 01:45:12,166: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:45:12.241190152Z [2024-03-28 01:45:12,240: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:45:12.859294305Z [2024-03-28 01:45:12,858: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5144329e-65d5-46ce-be7d-4a795141f8e5] succeeded in 2.604789969000194s: None 2024-03-28T01:46:00.632294793Z [2024-03-28 01:46:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4d10bcc-5c7b-47ec-892d-8ea356689388] received 2024-03-28T01:46:00.635461180Z [2024-03-28 01:46:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca35906a-4b33-4a4f-9f24-b57d1f16e095] received 2024-03-28T01:46:00.645957225Z [2024-03-28 01:46:00,645: INFO/ForkPoolWorker-15] [e4d10bcc-5c7b-47ec-892d-8ea356689388] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:46:00.652861267Z [2024-03-28 01:46:00,652: INFO/ForkPoolWorker-16] [ca35906a-4b33-4a4f-9f24-b57d1f16e095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:46:00.656711321Z [2024-03-28 01:46:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7377624f-072f-4fe1-954c-a6a5e9dc20b8] received 2024-03-28T01:46:00.659634199Z [2024-03-28 01:46:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b6369bd-d816-4451-826f-803349752a56] received 2024-03-28T01:46:00.677841770Z [2024-03-28 01:46:00,675: INFO/ForkPoolWorker-1] [7377624f-072f-4fe1-954c-a6a5e9dc20b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:46:00.677895179Z [2024-03-28 01:46:00,674: INFO/ForkPoolWorker-2] [6b6369bd-d816-4451-826f-803349752a56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:46:01.101667903Z [2024-03-28 01:46:01,098: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:46:01.189668078Z [2024-03-28 01:46:01,186: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:46:01.311653032Z [2024-03-28 01:46:01,304: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:46:01.360436993Z [2024-03-28 01:46:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:46:01.517879956Z [2024-03-28 01:46:01,517: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:46:01.560387902Z [2024-03-28 01:46:01,559: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:46:01.565060517Z [2024-03-28 01:46:01,564: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:46:01.601934997Z [2024-03-28 01:46:01,601: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:46:01.606700817Z [2024-03-28 01:46:01,606: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:46:01.609149131Z [2024-03-28 01:46:01,606: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:46:01.609771784Z [2024-03-28 01:46:01,609: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:46:01.610591174Z [2024-03-28 01:46:01,610: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:46:01.782633145Z [2024-03-28 01:46:01,782: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:46:02.364160817Z [2024-03-28 01:46:02,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4d10bcc-5c7b-47ec-892d-8ea356689388] succeeded in 1.7274127419996148s: None 2024-03-28T01:46:02.480241821Z [2024-03-28 01:46:02,479: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6b6369bd-d816-4451-826f-803349752a56] succeeded in 1.817756771999484s: None 2024-03-28T01:46:02.757874579Z [2024-03-28 01:46:02,757: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:46:02.761556071Z [2024-03-28 01:46:02,760: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:46:02.782052467Z [2024-03-28 01:46:02,781: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:46:02.783433167Z [2024-03-28 01:46:02,783: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:46:02.783449790Z [2024-03-28 01:46:02,783: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:46:02.783519386Z [2024-03-28 01:46:02,783: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:46:02.783639447Z [2024-03-28 01:46:02,783: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:46:02.784158530Z [2024-03-28 01:46:02,783: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:46:02.784181101Z [2024-03-28 01:46:02,784: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:46:02.881645110Z [2024-03-28 01:46:02,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:46:03.031864279Z [2024-03-28 01:46:03,031: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:46:03.035473374Z [2024-03-28 01:46:03,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:46:03.057468684Z [2024-03-28 01:46:03,057: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:46:03.059392154Z [2024-03-28 01:46:03,059: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:46:03.059581548Z [2024-03-28 01:46:03,059: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:46:03.059803780Z [2024-03-28 01:46:03,059: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:46:03.059854144Z [2024-03-28 01:46:03,059: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:46:03.060234614Z [2024-03-28 01:46:03,060: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:46:03.060721538Z [2024-03-28 01:46:03,060: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:46:03.144699032Z [2024-03-28 01:46:03,144: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:46:04.674327743Z [2024-03-28 01:46:04,673: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7377624f-072f-4fe1-954c-a6a5e9dc20b8] succeeded in 4.015162781000072s: None 2024-03-28T01:46:04.807781071Z [2024-03-28 01:46:04,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca35906a-4b33-4a4f-9f24-b57d1f16e095] succeeded in 4.17035338200003s: None 2024-03-28T01:47:00.366032951Z [2024-03-28 01:47:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21d82434-07b0-4205-9f86-b5199df425b1] received 2024-03-28T01:47:00.372026253Z [2024-03-28 01:47:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9ff5737-4809-4430-ba13-e130a3d8479c] received 2024-03-28T01:47:00.377004058Z [2024-03-28 01:47:00,376: INFO/ForkPoolWorker-15] [21d82434-07b0-4205-9f86-b5199df425b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:47:00.378863151Z [2024-03-28 01:47:00,378: INFO/ForkPoolWorker-16] [d9ff5737-4809-4430-ba13-e130a3d8479c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:47:00.389182706Z [2024-03-28 01:47:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59dd3973-846b-4613-8b72-555c90b5cb5b] received 2024-03-28T01:47:00.396926691Z [2024-03-28 01:47:00,396: INFO/ForkPoolWorker-1] [59dd3973-846b-4613-8b72-555c90b5cb5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:47:00.820577445Z [2024-03-28 01:47:00,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:47:00.850195343Z [2024-03-28 01:47:00,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:47:00.927749860Z [2024-03-28 01:47:00,923: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:47:01.028826245Z [2024-03-28 01:47:01,028: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:47:01.033361005Z [2024-03-28 01:47:01,032: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:47:01.060333451Z [2024-03-28 01:47:01,060: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:47:01.062078428Z [2024-03-28 01:47:01,061: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:47:01.062426650Z [2024-03-28 01:47:01,061: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:47:01.062687372Z [2024-03-28 01:47:01,062: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:47:01.063343084Z [2024-03-28 01:47:01,062: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:47:01.189749539Z [2024-03-28 01:47:01,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:47:01.815926764Z [2024-03-28 01:47:01,815: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59dd3973-846b-4613-8b72-555c90b5cb5b] succeeded in 1.4247424369996224s: None 2024-03-28T01:47:02.239622222Z [2024-03-28 01:47:02,237: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:47:02.242877917Z [2024-03-28 01:47:02,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:47:02.243932783Z [2024-03-28 01:47:02,243: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:47:02.247852411Z [2024-03-28 01:47:02,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:47:02.264165978Z [2024-03-28 01:47:02,263: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:47:02.265466541Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:47:02.265538250Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:47:02.265725536Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:47:02.265736313Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:47:02.266001831Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:47:02.266014238Z [2024-03-28 01:47:02,265: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:47:02.271998163Z [2024-03-28 01:47:02,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:47:02.273444015Z [2024-03-28 01:47:02,273: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:47:02.273636959Z [2024-03-28 01:47:02,273: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:47:02.273732632Z [2024-03-28 01:47:02,273: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:47:02.273862082Z [2024-03-28 01:47:02,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:47:02.274097067Z [2024-03-28 01:47:02,273: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:47:02.274106978Z [2024-03-28 01:47:02,274: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:47:02.353023025Z [2024-03-28 01:47:02,352: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:47:02.357193844Z [2024-03-28 01:47:02,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:47:03.855755358Z [2024-03-28 01:47:03,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21d82434-07b0-4205-9f86-b5199df425b1] succeeded in 3.4869389249997766s: None 2024-03-28T01:47:04.549917743Z [2024-03-28 01:47:04,549: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d9ff5737-4809-4430-ba13-e130a3d8479c] succeeded in 4.176195572999859s: None 2024-03-28T01:48:01.140411768Z [2024-03-28 01:48:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3ae1855-2d3e-4d53-9b62-d9317dd711cb] received 2024-03-28T01:48:01.145883621Z [2024-03-28 01:48:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c831503-3ecd-4195-a295-b572ea89e22d] received 2024-03-28T01:48:01.148203099Z [2024-03-28 01:48:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e578ffa9-0a60-4e64-95ac-e39bf1719442] received 2024-03-28T01:48:01.149921831Z [2024-03-28 01:48:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f32a174e-ca56-42cf-bbdf-5d4e9e3b7cb3] received 2024-03-28T01:48:01.157290055Z [2024-03-28 01:48:01,156: INFO/ForkPoolWorker-16] [4c831503-3ecd-4195-a295-b572ea89e22d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:48:01.158224042Z [2024-03-28 01:48:01,157: INFO/ForkPoolWorker-1] [e578ffa9-0a60-4e64-95ac-e39bf1719442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:48:01.160922814Z [2024-03-28 01:48:01,160: INFO/ForkPoolWorker-2] [f32a174e-ca56-42cf-bbdf-5d4e9e3b7cb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:48:01.168367156Z [2024-03-28 01:48:01,163: INFO/ForkPoolWorker-15] [b3ae1855-2d3e-4d53-9b62-d9317dd711cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:48:01.494822727Z [2024-03-28 01:48:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:48:01.498128132Z [2024-03-28 01:48:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:48:01.518855508Z [2024-03-28 01:48:01,512: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:48:01.551420788Z [2024-03-28 01:48:01,547: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:48:01.730940592Z [2024-03-28 01:48:01,730: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:48:01.735909561Z [2024-03-28 01:48:01,735: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:48:01.774215888Z [2024-03-28 01:48:01,773: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:48:01.776898607Z [2024-03-28 01:48:01,776: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:48:01.776966898Z [2024-03-28 01:48:01,776: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:48:01.777040873Z [2024-03-28 01:48:01,776: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:48:01.777601129Z [2024-03-28 01:48:01,777: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:48:01.879649869Z [2024-03-28 01:48:01,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:48:01.987015317Z [2024-03-28 01:48:01,986: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:48:02.731759417Z [2024-03-28 01:48:02,731: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f32a174e-ca56-42cf-bbdf-5d4e9e3b7cb3] succeeded in 1.5801984029994856s: None 2024-03-28T01:48:02.920612732Z [2024-03-28 01:48:02,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3ae1855-2d3e-4d53-9b62-d9317dd711cb] succeeded in 1.7720689890002177s: None 2024-03-28T01:48:03.136475667Z [2024-03-28 01:48:03,135: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:48:03.142882809Z [2024-03-28 01:48:03,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:48:03.171096110Z [2024-03-28 01:48:03,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:48:03.172677972Z [2024-03-28 01:48:03,172: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:48:03.172858029Z [2024-03-28 01:48:03,172: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:48:03.173077092Z [2024-03-28 01:48:03,172: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:48:03.173099727Z [2024-03-28 01:48:03,173: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:48:03.173621015Z [2024-03-28 01:48:03,173: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:48:03.173642107Z [2024-03-28 01:48:03,173: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:48:03.247122198Z [2024-03-28 01:48:03,246: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:48:03.250699447Z [2024-03-28 01:48:03,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:48:03.269261510Z [2024-03-28 01:48:03,268: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:48:03.281018814Z [2024-03-28 01:48:03,280: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:48:03.283190397Z [2024-03-28 01:48:03,282: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:48:03.283450577Z [2024-03-28 01:48:03,283: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:48:03.283774236Z [2024-03-28 01:48:03,283: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:48:03.284024384Z [2024-03-28 01:48:03,283: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:48:03.284501490Z [2024-03-28 01:48:03,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:48:03.284671366Z [2024-03-28 01:48:03,284: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:48:03.450242968Z [2024-03-28 01:48:03,447: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:48:04.870372384Z [2024-03-28 01:48:04,869: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c831503-3ecd-4195-a295-b572ea89e22d] succeeded in 3.7231363979999514s: None 2024-03-28T01:48:05.507425090Z [2024-03-28 01:48:05,506: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e578ffa9-0a60-4e64-95ac-e39bf1719442] succeeded in 4.35648308799955s: None 2024-03-28T01:49:00.920616516Z [2024-03-28 01:49:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb2aa3ed-73ff-4703-a8bf-1d85d81ada74] received 2024-03-28T01:49:00.929992940Z [2024-03-28 01:49:00,929: INFO/ForkPoolWorker-15] [bb2aa3ed-73ff-4703-a8bf-1d85d81ada74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:49:00.936836656Z [2024-03-28 01:49:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3596cf7-ccbd-4766-98f4-c9131fc8ad5a] received 2024-03-28T01:49:00.944277809Z [2024-03-28 01:49:00,943: INFO/ForkPoolWorker-16] [c3596cf7-ccbd-4766-98f4-c9131fc8ad5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:49:00.947200159Z [2024-03-28 01:49:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a94cacc-4035-455d-b3af-96388e05c134] received 2024-03-28T01:49:00.955324668Z [2024-03-28 01:49:00,954: INFO/ForkPoolWorker-1] [3a94cacc-4035-455d-b3af-96388e05c134] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:49:01.248621456Z [2024-03-28 01:49:01,245: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:49:01.363920374Z [2024-03-28 01:49:01,360: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:49:01.413051269Z [2024-03-28 01:49:01,412: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:49:01.417147302Z [2024-03-28 01:49:01,416: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:49:01.440646807Z [2024-03-28 01:49:01,436: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:49:01.442901158Z [2024-03-28 01:49:01,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:49:01.444106233Z [2024-03-28 01:49:01,443: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:49:01.444147721Z [2024-03-28 01:49:01,443: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:49:01.444153209Z [2024-03-28 01:49:01,444: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:49:01.444400605Z [2024-03-28 01:49:01,444: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:49:01.566219854Z [2024-03-28 01:49:01,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:49:02.256322581Z [2024-03-28 01:49:02,255: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a94cacc-4035-455d-b3af-96388e05c134] succeeded in 1.3071249659997193s: None 2024-03-28T01:49:02.775532029Z [2024-03-28 01:49:02,775: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:49:02.779602189Z [2024-03-28 01:49:02,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:49:02.785900562Z [2024-03-28 01:49:02,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:49:02.789747925Z [2024-03-28 01:49:02,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:49:02.807412646Z [2024-03-28 01:49:02,807: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:49:02.814039785Z [2024-03-28 01:49:02,813: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:49:02.814088730Z [2024-03-28 01:49:02,813: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:49:02.815767454Z [2024-03-28 01:49:02,813: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:49:02.815947175Z [2024-03-28 01:49:02,815: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:49:02.817122311Z [2024-03-28 01:49:02,816: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:49:02.817759540Z [2024-03-28 01:49:02,817: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:49:02.822315558Z [2024-03-28 01:49:02,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:49:02.826307761Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:49:02.826402324Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:49:02.826524574Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:49:02.826588218Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:49:02.826923339Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:49:02.829818291Z [2024-03-28 01:49:02,826: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:49:02.952185519Z [2024-03-28 01:49:02,951: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:49:02.953435304Z [2024-03-28 01:49:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:49:04.669241023Z [2024-03-28 01:49:04,668: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb2aa3ed-73ff-4703-a8bf-1d85d81ada74] succeeded in 3.7459504500002367s: None 2024-03-28T01:49:05.007880497Z [2024-03-28 01:49:05,007: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3596cf7-ccbd-4766-98f4-c9131fc8ad5a] succeeded in 4.069270617000257s: None 2024-03-28T01:50:00.642826820Z [2024-03-28 01:50:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ea37fc5-f9ae-4bfc-a56c-310c8f9086f0] received 2024-03-28T01:50:00.646058679Z [2024-03-28 01:50:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d655165-7a3f-42d5-991a-d0734c5f0351] received 2024-03-28T01:50:00.648222572Z [2024-03-28 01:50:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77a742d1-60ae-4760-8e1c-82f1f008acd4] received 2024-03-28T01:50:00.655938973Z [2024-03-28 01:50:00,655: INFO/ForkPoolWorker-1] [77a742d1-60ae-4760-8e1c-82f1f008acd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:50:00.656458913Z [2024-03-28 01:50:00,656: INFO/ForkPoolWorker-15] [0ea37fc5-f9ae-4bfc-a56c-310c8f9086f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:50:00.658921071Z [2024-03-28 01:50:00,658: INFO/ForkPoolWorker-16] [5d655165-7a3f-42d5-991a-d0734c5f0351] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:50:00.661934193Z [2024-03-28 01:50:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd684d5c-15cf-4939-b0b4-1864d40b4b6f] received 2024-03-28T01:50:00.670872300Z [2024-03-28 01:50:00,670: INFO/ForkPoolWorker-2] [fd684d5c-15cf-4939-b0b4-1864d40b4b6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:50:00.671388213Z [2024-03-28 01:50:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21781229-d6be-4b8d-96e3-82e5651e19eb] received 2024-03-28T01:50:00.696432235Z [2024-03-28 01:50:00,695: INFO/ForkPoolWorker-3] [21781229-d6be-4b8d-96e3-82e5651e19eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:50:01.107374796Z [2024-03-28 01:50:01,103: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:50:01.132430043Z [2024-03-28 01:50:01,127: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:50:01.351358429Z [2024-03-28 01:50:01,346: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:50:01.352269838Z [2024-03-28 01:50:01,334: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:50:01.419157624Z [2024-03-28 01:50:01,392: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:50:01.661603624Z [2024-03-28 01:50:01,661: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:01.829903559Z [2024-03-28 01:50:01,829: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:50:01.835692001Z [2024-03-28 01:50:01,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:01.922938370Z [2024-03-28 01:50:01,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:50:01.926876479Z [2024-03-28 01:50:01,926: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:50:01.927243060Z [2024-03-28 01:50:01,926: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:50:01.927426792Z [2024-03-28 01:50:01,927: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:50:01.927950435Z [2024-03-28 01:50:01,927: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:50:02.199525240Z [2024-03-28 01:50:02,199: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:02.953258750Z [2024-03-28 01:50:02,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77a742d1-60ae-4760-8e1c-82f1f008acd4] succeeded in 2.303164869000284s: None 2024-03-28T01:50:03.223795649Z [2024-03-28 01:50:03,223: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:50:03.228316335Z [2024-03-28 01:50:03,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:03.316536662Z [2024-03-28 01:50:03,316: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:50:03.358697616Z [2024-03-28 01:50:03,355: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:03.358711570Z [2024-03-28 01:50:03,356: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:03.358716182Z [2024-03-28 01:50:03,356: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:03.358720939Z [2024-03-28 01:50:03,356: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:50:03.358724264Z [2024-03-28 01:50:03,356: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:50:03.358727671Z [2024-03-28 01:50:03,356: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:03.497630208Z [2024-03-28 01:50:03,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ea37fc5-f9ae-4bfc-a56c-310c8f9086f0] succeeded in 2.8457572139996046s: None 2024-03-28T01:50:03.547753129Z [2024-03-28 01:50:03,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:04.237686437Z [2024-03-28 01:50:04,237: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T01:50:04.241089979Z [2024-03-28 01:50:04,240: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:50:04.241358718Z [2024-03-28 01:50:04,240: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:04.246554929Z [2024-03-28 01:50:04,245: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:04.274089869Z [2024-03-28 01:50:04,273: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T01:50:04.276027720Z [2024-03-28 01:50:04,275: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:04.276046145Z [2024-03-28 01:50:04,275: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:04.276236219Z [2024-03-28 01:50:04,275: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:04.276248798Z [2024-03-28 01:50:04,276: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T01:50:04.276527110Z [2024-03-28 01:50:04,276: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:50:04.276538067Z [2024-03-28 01:50:04,276: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:04.367351945Z [2024-03-28 01:50:04,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:50:04.369554357Z [2024-03-28 01:50:04,369: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:04.369774728Z [2024-03-28 01:50:04,369: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:04.369995416Z [2024-03-28 01:50:04,369: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:04.370008482Z [2024-03-28 01:50:04,369: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:50:04.370394475Z [2024-03-28 01:50:04,370: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:50:04.370413172Z [2024-03-28 01:50:04,370: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:04.425656609Z [2024-03-28 01:50:04,425: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:04.520868462Z [2024-03-28 01:50:04,520: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:04.545418868Z [2024-03-28 01:50:04,544: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d655165-7a3f-42d5-991a-d0734c5f0351] succeeded in 3.895968883999558s: None 2024-03-28T01:50:05.260749207Z [2024-03-28 01:50:05,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[419ab576-55c5-41c3-aef0-970f62f42b8f] received 2024-03-28T01:50:05.291522082Z [2024-03-28 01:50:05,291: INFO/ForkPoolWorker-15] [419ab576-55c5-41c3-aef0-970f62f42b8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:50:05.631267828Z [2024-03-28 01:50:05,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:50:05.957867875Z [2024-03-28 01:50:05,957: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[21781229-d6be-4b8d-96e3-82e5651e19eb] succeeded in 5.2819261490003555s: None 2024-03-28T01:50:06.587877302Z [2024-03-28 01:50:06,587: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd684d5c-15cf-4939-b0b4-1864d40b4b6f] succeeded in 5.923883909999859s: None 2024-03-28T01:50:07.015299390Z [2024-03-28 01:50:07,014: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:50:07.019146201Z [2024-03-28 01:50:07,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:07.051186942Z [2024-03-28 01:50:07,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:50:07.052865367Z [2024-03-28 01:50:07,052: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:07.053030945Z [2024-03-28 01:50:07,052: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:07.053259216Z [2024-03-28 01:50:07,053: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:07.053361687Z [2024-03-28 01:50:07,053: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:50:07.053752148Z [2024-03-28 01:50:07,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:50:07.053823742Z [2024-03-28 01:50:07,053: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:07.210797243Z [2024-03-28 01:50:07,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:07.863318954Z [2024-03-28 01:50:07,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[419ab576-55c5-41c3-aef0-970f62f42b8f] succeeded in 2.597215912000138s: None 2024-03-28T01:50:08.404093257Z [2024-03-28 01:50:08,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[951155e1-810c-4020-b08c-1f56cf2557fe] received 2024-03-28T01:50:08.434884795Z [2024-03-28 01:50:08,434: INFO/ForkPoolWorker-15] [951155e1-810c-4020-b08c-1f56cf2557fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:50:08.875863150Z [2024-03-28 01:50:08,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:50:10.326719496Z [2024-03-28 01:50:10,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:50:10.331967128Z [2024-03-28 01:50:10,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:10.356618659Z [2024-03-28 01:50:10,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:50:10.358515418Z [2024-03-28 01:50:10,358: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:10.358645177Z [2024-03-28 01:50:10,358: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:10.358960700Z [2024-03-28 01:50:10,358: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:10.359227149Z [2024-03-28 01:50:10,358: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:50:10.359804485Z [2024-03-28 01:50:10,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:50:10.359971193Z [2024-03-28 01:50:10,359: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:10.457515003Z [2024-03-28 01:50:10,457: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:11.037245658Z [2024-03-28 01:50:11,036: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[951155e1-810c-4020-b08c-1f56cf2557fe] succeeded in 2.618190940999739s: None 2024-03-28T01:50:11.324012509Z [2024-03-28 01:50:11,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[020999c0-1039-402a-aeac-2f99640e69d0] received 2024-03-28T01:50:11.332575574Z [2024-03-28 01:50:11,332: INFO/ForkPoolWorker-15] [020999c0-1039-402a-aeac-2f99640e69d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:50:11.680944316Z [2024-03-28 01:50:11,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:50:12.939022220Z [2024-03-28 01:50:12,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:50:12.944733216Z [2024-03-28 01:50:12,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:50:12.967960175Z [2024-03-28 01:50:12,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:50:12.969325605Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:50:12.969339565Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:50:12.969530146Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:50:12.969601120Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:50:12.969947035Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:50:12.969966389Z [2024-03-28 01:50:12,969: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:50:13.060990486Z [2024-03-28 01:50:13,060: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:50:13.664462100Z [2024-03-28 01:50:13,661: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[020999c0-1039-402a-aeac-2f99640e69d0] succeeded in 2.334876945999895s: None 2024-03-28T01:51:01.274594804Z [2024-03-28 01:51:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[710b838d-814b-4712-a15d-a0c2a8cb0940] received 2024-03-28T01:51:01.282449047Z [2024-03-28 01:51:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1732798-88fe-42e2-9a9a-f9a515ab9071] received 2024-03-28T01:51:01.283694142Z [2024-03-28 01:51:01,283: INFO/ForkPoolWorker-15] [710b838d-814b-4712-a15d-a0c2a8cb0940] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:51:01.295967068Z [2024-03-28 01:51:01,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe8661e8-2beb-4d45-a8b4-12ea2b1b5ee7] received 2024-03-28T01:51:01.297999303Z [2024-03-28 01:51:01,297: INFO/ForkPoolWorker-16] [a1732798-88fe-42e2-9a9a-f9a515ab9071] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:51:01.319444496Z [2024-03-28 01:51:01,319: INFO/ForkPoolWorker-1] [fe8661e8-2beb-4d45-a8b4-12ea2b1b5ee7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:51:01.654941887Z [2024-03-28 01:51:01,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:51:01.683914863Z [2024-03-28 01:51:01,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:51:01.690842908Z [2024-03-28 01:51:01,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:51:01.881332364Z [2024-03-28 01:51:01,880: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:51:01.886147535Z [2024-03-28 01:51:01,885: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:51:01.911758368Z [2024-03-28 01:51:01,911: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:51:01.913336405Z [2024-03-28 01:51:01,913: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:51:01.913640738Z [2024-03-28 01:51:01,913: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:51:01.913813586Z [2024-03-28 01:51:01,913: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:51:01.914259495Z [2024-03-28 01:51:01,914: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:51:02.017249441Z [2024-03-28 01:51:02,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:51:02.795066179Z [2024-03-28 01:51:02,794: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe8661e8-2beb-4d45-a8b4-12ea2b1b5ee7] succeeded in 1.4947409879996485s: None 2024-03-28T01:51:02.899165009Z [2024-03-28 01:51:02,898: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:51:02.903170966Z [2024-03-28 01:51:02,902: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:51:02.928039511Z [2024-03-28 01:51:02,927: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:51:02.929829947Z [2024-03-28 01:51:02,929: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:51:02.930021201Z [2024-03-28 01:51:02,929: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:51:02.930270270Z [2024-03-28 01:51:02,929: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:51:02.930446266Z [2024-03-28 01:51:02,930: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:51:02.930870321Z [2024-03-28 01:51:02,930: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:51:02.931018004Z [2024-03-28 01:51:02,930: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:51:02.967490392Z [2024-03-28 01:51:02,967: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:51:02.971201775Z [2024-03-28 01:51:02,970: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:51:02.997782639Z [2024-03-28 01:51:02,997: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:51:02.999346754Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:51:02.999364780Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:51:02.999520872Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:51:02.999531335Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:51:02.999945403Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:51:02.999962099Z [2024-03-28 01:51:02,999: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:51:03.072924017Z [2024-03-28 01:51:03,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:51:03.112862936Z [2024-03-28 01:51:03,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:51:04.915938089Z [2024-03-28 01:51:04,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1732798-88fe-42e2-9a9a-f9a515ab9071] succeeded in 3.6275891730001604s: None 2024-03-28T01:51:04.980923307Z [2024-03-28 01:51:04,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[710b838d-814b-4712-a15d-a0c2a8cb0940] succeeded in 3.704660710999633s: None 2024-03-28T01:52:00.472219248Z [2024-03-28 01:52:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88dd6576-ab64-4195-91b3-c85e5c7ac1e7] received 2024-03-28T01:52:00.477807747Z [2024-03-28 01:52:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7e9ff61-be3f-4525-9950-d99d27cf3be4] received 2024-03-28T01:52:00.486623813Z [2024-03-28 01:52:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[950848d0-c5b2-4826-9666-9076b55f503e] received 2024-03-28T01:52:00.491009520Z [2024-03-28 01:52:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ca8896-afaf-4a29-9e99-455a604ca0d2] received 2024-03-28T01:52:00.498712688Z [2024-03-28 01:52:00,498: INFO/ForkPoolWorker-15] [88dd6576-ab64-4195-91b3-c85e5c7ac1e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:52:00.499450726Z [2024-03-28 01:52:00,499: INFO/ForkPoolWorker-16] [c7e9ff61-be3f-4525-9950-d99d27cf3be4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:52:00.503967756Z [2024-03-28 01:52:00,503: INFO/ForkPoolWorker-1] [950848d0-c5b2-4826-9666-9076b55f503e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:52:00.516291328Z [2024-03-28 01:52:00,515: INFO/ForkPoolWorker-2] [23ca8896-afaf-4a29-9e99-455a604ca0d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:52:00.806148132Z [2024-03-28 01:52:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:52:00.888552602Z [2024-03-28 01:52:00,884: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:52:00.923881199Z [2024-03-28 01:52:00,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:52:01.092487133Z [2024-03-28 01:52:01,089: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:52:01.279711617Z [2024-03-28 01:52:01,279: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:52:01.287154594Z [2024-03-28 01:52:01,286: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:52:01.367422803Z [2024-03-28 01:52:01,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:52:01.370414009Z [2024-03-28 01:52:01,370: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:52:01.370493811Z [2024-03-28 01:52:01,370: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:52:01.370604934Z [2024-03-28 01:52:01,370: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:52:01.370957946Z [2024-03-28 01:52:01,370: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:52:01.740153065Z [2024-03-28 01:52:01,739: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:52:01.775001687Z [2024-03-28 01:52:01,774: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:52:02.728599296Z [2024-03-28 01:52:02,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88dd6576-ab64-4195-91b3-c85e5c7ac1e7] succeeded in 2.2491808680006216s: None 2024-03-28T01:52:02.763971969Z [2024-03-28 01:52:02,763: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23ca8896-afaf-4a29-9e99-455a604ca0d2] succeeded in 2.2539377470002364s: None 2024-03-28T01:52:03.193730182Z [2024-03-28 01:52:03,193: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:52:03.197830039Z [2024-03-28 01:52:03,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:52:03.227416054Z [2024-03-28 01:52:03,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:52:03.229275122Z [2024-03-28 01:52:03,228: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:52:03.229629167Z [2024-03-28 01:52:03,229: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:52:03.230011170Z [2024-03-28 01:52:03,229: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:52:03.230243190Z [2024-03-28 01:52:03,230: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:52:03.230916397Z [2024-03-28 01:52:03,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:52:03.231148327Z [2024-03-28 01:52:03,230: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:52:03.340204853Z [2024-03-28 01:52:03,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:52:03.345638778Z [2024-03-28 01:52:03,344: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:52:03.371703946Z [2024-03-28 01:52:03,366: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:52:03.380712626Z [2024-03-28 01:52:03,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:52:03.383011278Z [2024-03-28 01:52:03,382: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:52:03.383085599Z [2024-03-28 01:52:03,382: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:52:03.383347322Z [2024-03-28 01:52:03,383: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:52:03.383425318Z [2024-03-28 01:52:03,383: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:52:03.383757357Z [2024-03-28 01:52:03,383: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:52:03.383882523Z [2024-03-28 01:52:03,383: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:52:03.476739484Z [2024-03-28 01:52:03,476: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:52:04.958396223Z [2024-03-28 01:52:04,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[950848d0-c5b2-4826-9666-9076b55f503e] succeeded in 4.465919173999282s: None 2024-03-28T01:52:05.267042770Z [2024-03-28 01:52:05,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7e9ff61-be3f-4525-9950-d99d27cf3be4] succeeded in 4.786432129999412s: None 2024-03-28T01:53:00.825252516Z [2024-03-28 01:53:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[151d8c08-9e2f-402e-a728-cfdbba09f1bb] received 2024-03-28T01:53:00.832193894Z [2024-03-28 01:53:00,831: INFO/ForkPoolWorker-15] [151d8c08-9e2f-402e-a728-cfdbba09f1bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:53:00.838329445Z [2024-03-28 01:53:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55f9557f-7682-4038-a7ac-b3ba2d97b63e] received 2024-03-28T01:53:00.840662988Z [2024-03-28 01:53:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b64f5a0c-d614-4372-aa12-ef54bf8369d1] received 2024-03-28T01:53:00.848116003Z [2024-03-28 01:53:00,847: INFO/ForkPoolWorker-16] [55f9557f-7682-4038-a7ac-b3ba2d97b63e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:53:00.856239287Z [2024-03-28 01:53:00,855: INFO/ForkPoolWorker-1] [b64f5a0c-d614-4372-aa12-ef54bf8369d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:53:01.140360528Z [2024-03-28 01:53:01,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:53:01.141523497Z [2024-03-28 01:53:01,138: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:53:01.198958879Z [2024-03-28 01:53:01,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:53:01.462982203Z [2024-03-28 01:53:01,462: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T01:53:01.467420358Z [2024-03-28 01:53:01,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:53:01.492859682Z [2024-03-28 01:53:01,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:53:01.495993126Z [2024-03-28 01:53:01,495: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:53:01.496101221Z [2024-03-28 01:53:01,495: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:53:01.496269338Z [2024-03-28 01:53:01,496: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T01:53:01.496551881Z [2024-03-28 01:53:01,496: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:53:01.622225350Z [2024-03-28 01:53:01,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:53:02.400375545Z [2024-03-28 01:53:02,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[151d8c08-9e2f-402e-a728-cfdbba09f1bb] succeeded in 1.5733379250004873s: None 2024-03-28T01:53:02.656538946Z [2024-03-28 01:53:02,656: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:53:02.660557939Z [2024-03-28 01:53:02,660: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:53:02.680687373Z [2024-03-28 01:53:02,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:53:02.682000047Z [2024-03-28 01:53:02,681: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:53:02.682018334Z [2024-03-28 01:53:02,681: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:53:02.682129444Z [2024-03-28 01:53:02,681: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:53:02.682152302Z [2024-03-28 01:53:02,682: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:53:02.682366022Z [2024-03-28 01:53:02,682: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:53:02.682377189Z [2024-03-28 01:53:02,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:53:02.698961556Z [2024-03-28 01:53:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:53:02.702505909Z [2024-03-28 01:53:02,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:53:02.738833126Z [2024-03-28 01:53:02,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:53:02.739985285Z [2024-03-28 01:53:02,739: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:53:02.740006173Z [2024-03-28 01:53:02,739: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:53:02.740076847Z [2024-03-28 01:53:02,739: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:53:02.740157449Z [2024-03-28 01:53:02,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:53:02.740383833Z [2024-03-28 01:53:02,740: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:53:02.740390106Z [2024-03-28 01:53:02,740: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:53:02.782631244Z [2024-03-28 01:53:02,782: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:53:02.859420072Z [2024-03-28 01:53:02,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:53:04.851573846Z [2024-03-28 01:53:04,851: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55f9557f-7682-4038-a7ac-b3ba2d97b63e] succeeded in 4.011375365000276s: None 2024-03-28T01:53:05.262814158Z [2024-03-28 01:53:05,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b64f5a0c-d614-4372-aa12-ef54bf8369d1] succeeded in 4.417272029999367s: None 2024-03-28T01:54:01.209192151Z [2024-03-28 01:54:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0ea1cdd-922b-4428-b56f-a8573212c1ef] received 2024-03-28T01:54:01.214580764Z [2024-03-28 01:54:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34632418-530f-42a0-9643-14fe11afa56b] received 2024-03-28T01:54:01.219256555Z [2024-03-28 01:54:01,218: INFO/ForkPoolWorker-15] [b0ea1cdd-922b-4428-b56f-a8573212c1ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:54:01.219830346Z [2024-03-28 01:54:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dea92696-f96d-4a84-9f10-c48f26e4a67c] received 2024-03-28T01:54:01.236318662Z [2024-03-28 01:54:01,235: INFO/ForkPoolWorker-16] [34632418-530f-42a0-9643-14fe11afa56b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:54:01.243195938Z [2024-03-28 01:54:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74078295-7b3f-4c45-990f-3c772d95ea67] received 2024-03-28T01:54:01.248310320Z [2024-03-28 01:54:01,247: INFO/ForkPoolWorker-1] [dea92696-f96d-4a84-9f10-c48f26e4a67c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:54:01.273976057Z [2024-03-28 01:54:01,273: INFO/ForkPoolWorker-2] [74078295-7b3f-4c45-990f-3c772d95ea67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:54:01.584110908Z [2024-03-28 01:54:01,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:54:01.720162091Z [2024-03-28 01:54:01,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:54:01.747802869Z [2024-03-28 01:54:01,744: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:54:01.818606570Z [2024-03-28 01:54:01,818: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T01:54:01.823558996Z [2024-03-28 01:54:01,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:54:01.871996767Z [2024-03-28 01:54:01,871: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:54:01.873386054Z [2024-03-28 01:54:01,873: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:54:01.873528768Z [2024-03-28 01:54:01,873: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:54:01.873594952Z [2024-03-28 01:54:01,873: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T01:54:01.873811086Z [2024-03-28 01:54:01,873: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:54:01.893560855Z [2024-03-28 01:54:01,888: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:54:02.022414710Z [2024-03-28 01:54:02,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:54:02.152543861Z [2024-03-28 01:54:02,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:54:02.864284626Z [2024-03-28 01:54:02,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0ea1cdd-922b-4428-b56f-a8573212c1ef] succeeded in 1.6525787950004087s: None 2024-03-28T01:54:02.927335658Z [2024-03-28 01:54:02,926: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dea92696-f96d-4a84-9f10-c48f26e4a67c] succeeded in 1.6989316979997966s: None 2024-03-28T01:54:03.508491649Z [2024-03-28 01:54:03,507: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:54:03.512581591Z [2024-03-28 01:54:03,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:54:03.541538366Z [2024-03-28 01:54:03,541: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:54:03.544234157Z [2024-03-28 01:54:03,543: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:54:03.544506018Z [2024-03-28 01:54:03,544: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:54:03.544855376Z [2024-03-28 01:54:03,544: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:54:03.545081132Z [2024-03-28 01:54:03,544: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:54:03.545641849Z [2024-03-28 01:54:03,545: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:54:03.545844897Z [2024-03-28 01:54:03,545: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:54:03.590559749Z [2024-03-28 01:54:03,571: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:54:03.590594510Z [2024-03-28 01:54:03,574: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:54:03.630764993Z [2024-03-28 01:54:03,630: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:54:03.635101660Z [2024-03-28 01:54:03,634: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:54:03.635121958Z [2024-03-28 01:54:03,634: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:54:03.635126098Z [2024-03-28 01:54:03,634: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:54:03.635129677Z [2024-03-28 01:54:03,634: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:54:03.635326950Z [2024-03-28 01:54:03,635: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:54:03.635408358Z [2024-03-28 01:54:03,635: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:54:03.686895148Z [2024-03-28 01:54:03,686: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:54:03.746741045Z [2024-03-28 01:54:03,746: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:54:05.322944938Z [2024-03-28 01:54:05,322: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34632418-530f-42a0-9643-14fe11afa56b] succeeded in 4.100783429999865s: None 2024-03-28T01:54:05.640963418Z [2024-03-28 01:54:05,640: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74078295-7b3f-4c45-990f-3c772d95ea67] succeeded in 4.389922911999747s: None 2024-03-28T01:55:00.399498805Z [2024-03-28 01:55:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[607cbab9-02e0-4c60-beaa-a759d52ed6fa] received 2024-03-28T01:55:00.402134676Z [2024-03-28 01:55:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1775d4ea-c1e7-4821-b564-702d3b350615] received 2024-03-28T01:55:00.404548814Z [2024-03-28 01:55:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33f0df09-214e-432c-af76-5df017d3cdfe] received 2024-03-28T01:55:00.408735170Z [2024-03-28 01:55:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b42989ab-0e1e-4013-a362-06c0c65988cb] received 2024-03-28T01:55:00.410608154Z [2024-03-28 01:55:00,410: INFO/ForkPoolWorker-15] [607cbab9-02e0-4c60-beaa-a759d52ed6fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:55:00.411725793Z [2024-03-28 01:55:00,411: INFO/ForkPoolWorker-16] [1775d4ea-c1e7-4821-b564-702d3b350615] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:55:00.417009484Z [2024-03-28 01:55:00,416: INFO/ForkPoolWorker-1] [33f0df09-214e-432c-af76-5df017d3cdfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:55:00.417539177Z [2024-03-28 01:55:00,417: INFO/ForkPoolWorker-2] [b42989ab-0e1e-4013-a362-06c0c65988cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:55:00.722631855Z [2024-03-28 01:55:00,718: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:55:00.763313391Z [2024-03-28 01:55:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:55:00.777810872Z [2024-03-28 01:55:00,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:55:00.782030387Z [2024-03-28 01:55:00,775: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:55:00.915730359Z [2024-03-28 01:55:00,915: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:55:00.927738746Z [2024-03-28 01:55:00,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:00.995050504Z [2024-03-28 01:55:00,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:55:00.998340592Z [2024-03-28 01:55:00,998: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:55:00.998474471Z [2024-03-28 01:55:00,998: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:55:00.998540687Z [2024-03-28 01:55:00,998: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:55:00.998805003Z [2024-03-28 01:55:00,998: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:55:01.148541081Z [2024-03-28 01:55:01,148: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:01.857561783Z [2024-03-28 01:55:01,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1775d4ea-c1e7-4821-b564-702d3b350615] succeeded in 1.4519059439999182s: None 2024-03-28T01:55:02.298396235Z [2024-03-28 01:55:02,297: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:55:02.302429676Z [2024-03-28 01:55:02,301: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:02.305863603Z [2024-03-28 01:55:02,305: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T01:55:02.309616758Z [2024-03-28 01:55:02,309: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:02.331963801Z [2024-03-28 01:55:02,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:55:02.334512140Z [2024-03-28 01:55:02,334: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:02.334610399Z [2024-03-28 01:55:02,334: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:02.334829554Z [2024-03-28 01:55:02,334: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:02.334879763Z [2024-03-28 01:55:02,334: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:55:02.335234843Z [2024-03-28 01:55:02,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:55:02.335358055Z [2024-03-28 01:55:02,335: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:02.339218772Z [2024-03-28 01:55:02,338: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:55:02.342424895Z [2024-03-28 01:55:02,342: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:02.342713446Z [2024-03-28 01:55:02,342: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:02.343190599Z [2024-03-28 01:55:02,342: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:02.343503691Z [2024-03-28 01:55:02,343: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T01:55:02.344256602Z [2024-03-28 01:55:02,344: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:55:02.345147682Z [2024-03-28 01:55:02,344: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:02.444153917Z [2024-03-28 01:55:02,443: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:02.446712970Z [2024-03-28 01:55:02,446: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:02.462429697Z [2024-03-28 01:55:02,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:55:02.466325766Z [2024-03-28 01:55:02,465: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:02.499956155Z [2024-03-28 01:55:02,499: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:55:02.502591910Z [2024-03-28 01:55:02,502: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:02.502986319Z [2024-03-28 01:55:02,502: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:02.503442911Z [2024-03-28 01:55:02,503: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:02.503759057Z [2024-03-28 01:55:02,503: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:55:02.504432418Z [2024-03-28 01:55:02,504: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:55:02.505381568Z [2024-03-28 01:55:02,504: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:02.628480928Z [2024-03-28 01:55:02,628: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:03.415366347Z [2024-03-28 01:55:03,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16d48e65-8e19-45e2-ba70-67fce401a5fd] received 2024-03-28T01:55:03.434113685Z [2024-03-28 01:55:03,433: INFO/ForkPoolWorker-16] [16d48e65-8e19-45e2-ba70-67fce401a5fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:55:03.514211974Z [2024-03-28 01:55:03,513: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33f0df09-214e-432c-af76-5df017d3cdfe] succeeded in 3.1074873749994367s: None 2024-03-28T01:55:03.788440241Z [2024-03-28 01:55:03,784: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:55:04.654207284Z [2024-03-28 01:55:04,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[607cbab9-02e0-4c60-beaa-a759d52ed6fa] succeeded in 4.252531633999752s: None 2024-03-28T01:55:05.077192533Z [2024-03-28 01:55:05,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b42989ab-0e1e-4013-a362-06c0c65988cb] succeeded in 4.666253089999373s: None 2024-03-28T01:55:05.187163000Z [2024-03-28 01:55:05,186: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:55:05.195987717Z [2024-03-28 01:55:05,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:05.219773202Z [2024-03-28 01:55:05,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:55:05.221702382Z [2024-03-28 01:55:05,221: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:05.221868610Z [2024-03-28 01:55:05,221: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:05.222150611Z [2024-03-28 01:55:05,221: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:05.222310566Z [2024-03-28 01:55:05,222: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:55:05.222893988Z [2024-03-28 01:55:05,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:55:05.223035872Z [2024-03-28 01:55:05,222: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:05.327033139Z [2024-03-28 01:55:05,326: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:05.966462153Z [2024-03-28 01:55:05,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b26deaa-a17b-4ccb-a4ec-033038e933da] received 2024-03-28T01:55:05.983029235Z [2024-03-28 01:55:05,982: INFO/ForkPoolWorker-15] [7b26deaa-a17b-4ccb-a4ec-033038e933da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T01:55:05.988166028Z [2024-03-28 01:55:05,987: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16d48e65-8e19-45e2-ba70-67fce401a5fd] succeeded in 2.5725262830001157s: None 2024-03-28T01:55:06.330098927Z [2024-03-28 01:55:06,326: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:55:07.547942732Z [2024-03-28 01:55:07,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:55:07.552260535Z [2024-03-28 01:55:07,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:07.569599953Z [2024-03-28 01:55:07,569: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:55:07.570941542Z [2024-03-28 01:55:07,570: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:07.571007582Z [2024-03-28 01:55:07,570: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:07.573714897Z [2024-03-28 01:55:07,570: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:07.573816649Z [2024-03-28 01:55:07,573: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:55:07.574097841Z [2024-03-28 01:55:07,573: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:55:07.574175121Z [2024-03-28 01:55:07,574: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:07.657973648Z [2024-03-28 01:55:07,657: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:08.375244172Z [2024-03-28 01:55:08,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eeca4ff1-19eb-40aa-aed9-d168d461e2ea] received 2024-03-28T01:55:08.389182371Z [2024-03-28 01:55:08,388: INFO/ForkPoolWorker-16] [eeca4ff1-19eb-40aa-aed9-d168d461e2ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T01:55:08.537572298Z [2024-03-28 01:55:08,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b26deaa-a17b-4ccb-a4ec-033038e933da] succeeded in 2.568240550000155s: None 2024-03-28T01:55:08.828236036Z [2024-03-28 01:55:08,824: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T01:55:10.157815702Z [2024-03-28 01:55:10,157: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:55:10.164711640Z [2024-03-28 01:55:10,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:55:10.204763653Z [2024-03-28 01:55:10,204: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:55:10.207026462Z [2024-03-28 01:55:10,206: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:55:10.207118203Z [2024-03-28 01:55:10,206: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:55:10.207321276Z [2024-03-28 01:55:10,207: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:55:10.207426277Z [2024-03-28 01:55:10,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:55:10.207825129Z [2024-03-28 01:55:10,207: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T01:55:10.207948046Z [2024-03-28 01:55:10,207: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:55:10.342890364Z [2024-03-28 01:55:10,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:55:10.937217449Z [2024-03-28 01:55:10,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eeca4ff1-19eb-40aa-aed9-d168d461e2ea] succeeded in 2.558047107000675s: None 2024-03-28T01:56:01.229822070Z [2024-03-28 01:56:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26b32318-453c-48c0-b140-49fd05eab88d] received 2024-03-28T01:56:01.236268068Z [2024-03-28 01:56:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b748258-4956-45c8-96be-d6ab64bf7978] received 2024-03-28T01:56:01.246207342Z [2024-03-28 01:56:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab1d26fc-870a-45a7-8b7b-38e131acb6a8] received 2024-03-28T01:56:01.250796480Z [2024-03-28 01:56:01,250: INFO/ForkPoolWorker-16] [8b748258-4956-45c8-96be-d6ab64bf7978] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:56:01.254471373Z [2024-03-28 01:56:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e087d3c-87f4-47a1-b305-edb6fb59eeff] received 2024-03-28T01:56:01.254509839Z [2024-03-28 01:56:01,254: INFO/ForkPoolWorker-15] [26b32318-453c-48c0-b140-49fd05eab88d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:56:01.262500131Z [2024-03-28 01:56:01,262: INFO/ForkPoolWorker-1] [ab1d26fc-870a-45a7-8b7b-38e131acb6a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:56:01.268986377Z [2024-03-28 01:56:01,268: INFO/ForkPoolWorker-2] [1e087d3c-87f4-47a1-b305-edb6fb59eeff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:56:01.672756717Z [2024-03-28 01:56:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:56:01.721528355Z [2024-03-28 01:56:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:56:01.785265423Z [2024-03-28 01:56:01,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:56:01.906311567Z [2024-03-28 01:56:01,902: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:56:02.137605316Z [2024-03-28 01:56:02,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:56:02.155420099Z [2024-03-28 01:56:02,154: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:56:02.167030604Z [2024-03-28 01:56:02,165: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:56:02.234675590Z [2024-03-28 01:56:02,234: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:56:02.238551660Z [2024-03-28 01:56:02,238: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:56:02.238602601Z [2024-03-28 01:56:02,238: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:56:02.238769603Z [2024-03-28 01:56:02,238: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:56:02.239123888Z [2024-03-28 01:56:02,238: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:56:02.383281072Z [2024-03-28 01:56:02,382: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:56:02.871085240Z [2024-03-28 01:56:02,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26b32318-453c-48c0-b140-49fd05eab88d] succeeded in 1.6309142760001123s: None 2024-03-28T01:56:03.215829897Z [2024-03-28 01:56:03,215: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e087d3c-87f4-47a1-b305-edb6fb59eeff] succeeded in 1.9573337850006283s: None 2024-03-28T01:56:03.453886790Z [2024-03-28 01:56:03,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:56:03.460233790Z [2024-03-28 01:56:03,459: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:56:03.512280317Z [2024-03-28 01:56:03,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:56:03.514905919Z [2024-03-28 01:56:03,514: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:56:03.515300294Z [2024-03-28 01:56:03,515: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:56:03.515595107Z [2024-03-28 01:56:03,515: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:56:03.515798954Z [2024-03-28 01:56:03,515: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:56:03.516934502Z [2024-03-28 01:56:03,516: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:56:03.517225297Z [2024-03-28 01:56:03,517: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:56:03.635889440Z [2024-03-28 01:56:03,635: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:56:03.696066548Z [2024-03-28 01:56:03,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:56:03.699593840Z [2024-03-28 01:56:03,699: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:56:03.724011387Z [2024-03-28 01:56:03,723: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:56:03.726304970Z [2024-03-28 01:56:03,725: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:56:03.726349291Z [2024-03-28 01:56:03,725: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:56:03.726361516Z [2024-03-28 01:56:03,725: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:56:03.726369384Z [2024-03-28 01:56:03,725: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:56:03.726374452Z [2024-03-28 01:56:03,726: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:56:03.726379602Z [2024-03-28 01:56:03,726: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:56:03.822356854Z [2024-03-28 01:56:03,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:56:05.693767280Z [2024-03-28 01:56:05,692: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab1d26fc-870a-45a7-8b7b-38e131acb6a8] succeeded in 4.445662547000211s: None 2024-03-28T01:56:06.935343809Z [2024-03-28 01:56:06,934: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b748258-4956-45c8-96be-d6ab64bf7978] succeeded in 5.693825294999442s: None 2024-03-28T01:57:01.081188196Z [2024-03-28 01:57:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f8f733d-3166-4e59-b05c-d70bcf68e89d] received 2024-03-28T01:57:01.088559291Z [2024-03-28 01:57:01,088: INFO/ForkPoolWorker-15] [5f8f733d-3166-4e59-b05c-d70bcf68e89d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:57:01.105967100Z [2024-03-28 01:57:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d848ff4-4f18-4d4e-8f2f-f879fea213b6] received 2024-03-28T01:57:01.108778064Z [2024-03-28 01:57:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae3015af-14bc-43a1-a7b2-e3157b306518] received 2024-03-28T01:57:01.114555635Z [2024-03-28 01:57:01,114: INFO/ForkPoolWorker-16] [3d848ff4-4f18-4d4e-8f2f-f879fea213b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:57:01.122598035Z [2024-03-28 01:57:01,122: INFO/ForkPoolWorker-1] [ae3015af-14bc-43a1-a7b2-e3157b306518] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:57:01.447692402Z [2024-03-28 01:57:01,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:57:01.491197879Z [2024-03-28 01:57:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:57:01.569293481Z [2024-03-28 01:57:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:57:01.744576627Z [2024-03-28 01:57:01,744: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:57:01.748979272Z [2024-03-28 01:57:01,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:57:01.779923543Z [2024-03-28 01:57:01,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:57:01.781935291Z [2024-03-28 01:57:01,781: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:57:01.782212896Z [2024-03-28 01:57:01,781: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:57:01.782390858Z [2024-03-28 01:57:01,782: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:57:01.782933885Z [2024-03-28 01:57:01,782: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:57:01.891251636Z [2024-03-28 01:57:01,890: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:57:02.538385676Z [2024-03-28 01:57:02,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d848ff4-4f18-4d4e-8f2f-f879fea213b6] succeeded in 1.4308067760002814s: None 2024-03-28T01:57:02.770972754Z [2024-03-28 01:57:02,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:57:02.774385885Z [2024-03-28 01:57:02,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:57:02.806321906Z [2024-03-28 01:57:02,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:57:02.807579779Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:57:02.807594939Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:57:02.807706359Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:57:02.807716852Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:57:02.807954294Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:57:02.807997851Z [2024-03-28 01:57:02,807: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:57:02.965238564Z [2024-03-28 01:57:02,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:57:03.247012095Z [2024-03-28 01:57:03,246: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:57:03.250548280Z [2024-03-28 01:57:03,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:57:03.272578171Z [2024-03-28 01:57:03,272: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:57:03.273941688Z [2024-03-28 01:57:03,273: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:57:03.274000303Z [2024-03-28 01:57:03,273: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:57:03.274183925Z [2024-03-28 01:57:03,273: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:57:03.274323532Z [2024-03-28 01:57:03,274: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:57:03.274637782Z [2024-03-28 01:57:03,274: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:57:03.274743702Z [2024-03-28 01:57:03,274: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:57:03.384937575Z [2024-03-28 01:57:03,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:57:04.776415201Z [2024-03-28 01:57:04,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f8f733d-3166-4e59-b05c-d70bcf68e89d] succeeded in 3.693707766999978s: None 2024-03-28T01:57:05.731262796Z [2024-03-28 01:57:05,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae3015af-14bc-43a1-a7b2-e3157b306518] succeeded in 4.619886081000004s: None 2024-03-28T01:58:01.204196138Z [2024-03-28 01:58:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf6daab-b0bb-40a3-a851-a46656aa8ee9] received 2024-03-28T01:58:01.207165229Z [2024-03-28 01:58:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3438213-ea65-4f2f-9ee6-b52b6feecbfd] received 2024-03-28T01:58:01.218089002Z [2024-03-28 01:58:01,217: INFO/ForkPoolWorker-16] [b3438213-ea65-4f2f-9ee6-b52b6feecbfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:58:01.227898723Z [2024-03-28 01:58:01,227: INFO/ForkPoolWorker-15] [baf6daab-b0bb-40a3-a851-a46656aa8ee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T01:58:01.250952073Z [2024-03-28 01:58:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b6d50f-5d66-49f8-9e23-2c79b952fff5] received 2024-03-28T01:58:01.252499767Z [2024-03-28 01:58:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb5686ba-c405-4677-ac4b-bbc42a98585c] received 2024-03-28T01:58:01.265349947Z [2024-03-28 01:58:01,264: INFO/ForkPoolWorker-1] [65b6d50f-5d66-49f8-9e23-2c79b952fff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:58:01.267927460Z [2024-03-28 01:58:01,267: INFO/ForkPoolWorker-2] [eb5686ba-c405-4677-ac4b-bbc42a98585c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:58:01.654028060Z [2024-03-28 01:58:01,646: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:58:01.986517247Z [2024-03-28 01:58:01,981: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:58:02.114376582Z [2024-03-28 01:58:02,110: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T01:58:02.153179622Z [2024-03-28 01:58:02,152: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T01:58:02.159828605Z [2024-03-28 01:58:02,159: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:58:02.314699742Z [2024-03-28 01:58:02,314: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T01:58:02.320994086Z [2024-03-28 01:58:02,320: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:58:02.321461888Z [2024-03-28 01:58:02,320: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:58:02.321739378Z [2024-03-28 01:58:02,321: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T01:58:02.324874650Z [2024-03-28 01:58:02,321: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:58:02.453027267Z [2024-03-28 01:58:02,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:58:02.455258432Z [2024-03-28 01:58:02,454: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:58:02.460640036Z [2024-03-28 01:58:02,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:58:03.279805491Z [2024-03-28 01:58:03,279: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb5686ba-c405-4677-ac4b-bbc42a98585c] succeeded in 2.0238519790000282s: None 2024-03-28T01:58:03.301350286Z [2024-03-28 01:58:03,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[baf6daab-b0bb-40a3-a851-a46656aa8ee9] succeeded in 2.0932005459999345s: None 2024-03-28T01:58:03.999317612Z [2024-03-28 01:58:03,998: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T01:58:04.003061286Z [2024-03-28 01:58:04,002: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:58:04.025960547Z [2024-03-28 01:58:04,025: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:58:04.027318772Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:58:04.027334361Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:58:04.027468000Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:58:04.027481796Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T01:58:04.027732997Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:58:04.027772864Z [2024-03-28 01:58:04,027: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:58:04.132489039Z [2024-03-28 01:58:04,132: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:58:04.259048787Z [2024-03-28 01:58:04,258: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:58:04.262633425Z [2024-03-28 01:58:04,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:58:04.284425587Z [2024-03-28 01:58:04,284: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:58:04.286119316Z [2024-03-28 01:58:04,285: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:58:04.286281379Z [2024-03-28 01:58:04,286: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:58:04.286510664Z [2024-03-28 01:58:04,286: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:58:04.286646146Z [2024-03-28 01:58:04,286: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:58:04.287007281Z [2024-03-28 01:58:04,286: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:58:04.287141861Z [2024-03-28 01:58:04,287: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:58:04.408094797Z [2024-03-28 01:58:04,407: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:58:06.193048207Z [2024-03-28 01:58:06,192: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3438213-ea65-4f2f-9ee6-b52b6feecbfd] succeeded in 4.982081664000361s: None 2024-03-28T01:58:06.512156327Z [2024-03-28 01:58:06,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65b6d50f-5d66-49f8-9e23-2c79b952fff5] succeeded in 5.25727394400019s: None 2024-03-28T01:59:00.952091763Z [2024-03-28 01:59:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2097d8ff-d11a-4f65-bc18-682ef3787aef] received 2024-03-28T01:59:00.955103593Z [2024-03-28 01:59:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5604a0ef-8a06-4027-9aa5-d0acb8a4463f] received 2024-03-28T01:59:00.957064595Z [2024-03-28 01:59:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6295d048-971b-45b4-b4fb-908ac720b965] received 2024-03-28T01:59:00.963887095Z [2024-03-28 01:59:00,963: INFO/ForkPoolWorker-1] [6295d048-971b-45b4-b4fb-908ac720b965] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T01:59:00.967456896Z [2024-03-28 01:59:00,967: INFO/ForkPoolWorker-16] [5604a0ef-8a06-4027-9aa5-d0acb8a4463f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T01:59:00.968460035Z [2024-03-28 01:59:00,968: INFO/ForkPoolWorker-15] [2097d8ff-d11a-4f65-bc18-682ef3787aef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T01:59:01.283702813Z [2024-03-28 01:59:01,280: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T01:59:01.284114976Z [2024-03-28 01:59:01,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T01:59:01.326635550Z [2024-03-28 01:59:01,322: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T01:59:01.446068426Z [2024-03-28 01:59:01,445: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T01:59:01.450237053Z [2024-03-28 01:59:01,449: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:59:01.472264535Z [2024-03-28 01:59:01,472: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T01:59:01.473945265Z [2024-03-28 01:59:01,473: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T01:59:01.474156251Z [2024-03-28 01:59:01,473: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T01:59:01.474294445Z [2024-03-28 01:59:01,474: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T01:59:01.474637139Z [2024-03-28 01:59:01,474: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T01:59:01.566811734Z [2024-03-28 01:59:01,566: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:59:02.334545540Z [2024-03-28 01:59:02,334: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5604a0ef-8a06-4027-9aa5-d0acb8a4463f] succeeded in 1.3758077759994194s: None 2024-03-28T01:59:02.776438817Z [2024-03-28 01:59:02,775: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T01:59:02.780142575Z [2024-03-28 01:59:02,779: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:59:02.811306154Z [2024-03-28 01:59:02,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T01:59:02.815405088Z [2024-03-28 01:59:02,815: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:59:02.815595934Z [2024-03-28 01:59:02,815: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:59:02.815799856Z [2024-03-28 01:59:02,815: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:59:02.816016910Z [2024-03-28 01:59:02,815: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T01:59:02.816283978Z [2024-03-28 01:59:02,816: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T01:59:02.816392783Z [2024-03-28 01:59:02,816: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:59:02.830789160Z [2024-03-28 01:59:02,830: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T01:59:02.834591534Z [2024-03-28 01:59:02,834: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T01:59:02.878317166Z [2024-03-28 01:59:02,877: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T01:59:02.887351180Z [2024-03-28 01:59:02,886: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T01:59:02.887668926Z [2024-03-28 01:59:02,887: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T01:59:02.887945625Z [2024-03-28 01:59:02,887: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T01:59:02.888190101Z [2024-03-28 01:59:02,887: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T01:59:02.889023827Z [2024-03-28 01:59:02,888: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T01:59:02.889225551Z [2024-03-28 01:59:02,888: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T01:59:02.971299865Z [2024-03-28 01:59:02,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:59:03.017219835Z [2024-03-28 01:59:03,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T01:59:05.064164339Z [2024-03-28 01:59:05,063: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6295d048-971b-45b4-b4fb-908ac720b965] succeeded in 4.105473187999451s: None 2024-03-28T01:59:05.331838460Z [2024-03-28 01:59:05,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2097d8ff-d11a-4f65-bc18-682ef3787aef] succeeded in 4.377785266999126s: None 2024-03-28T02:00:00.841123408Z [2024-03-28 02:00:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb4fa32b-c119-4989-8bde-c4ee61e5bfbf] received 2024-03-28T02:00:00.843928704Z [2024-03-28 02:00:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cc65520-46fa-4b72-873f-ce008445b420] received 2024-03-28T02:00:00.848774302Z [2024-03-28 02:00:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfca6e3a-fe28-41c7-86bb-381b79552cea] received 2024-03-28T02:00:00.852483832Z [2024-03-28 02:00:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80d12c24-5c4d-4566-a47d-b7cf3181163b] received 2024-03-28T02:00:00.852512994Z [2024-03-28 02:00:00,852: INFO/ForkPoolWorker-15] [cb4fa32b-c119-4989-8bde-c4ee61e5bfbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:00:00.852821592Z [2024-03-28 02:00:00,852: INFO/ForkPoolWorker-16] [2cc65520-46fa-4b72-873f-ce008445b420] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:00:00.855066347Z [2024-03-28 02:00:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31b7ea4c-6063-4e99-b0c9-b3f4261c6f02] received 2024-03-28T02:00:00.862642369Z [2024-03-28 02:00:00,862: INFO/ForkPoolWorker-2] [80d12c24-5c4d-4566-a47d-b7cf3181163b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:00:00.863724300Z [2024-03-28 02:00:00,863: INFO/ForkPoolWorker-1] [bfca6e3a-fe28-41c7-86bb-381b79552cea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:00:00.883846686Z [2024-03-28 02:00:00,883: INFO/ForkPoolWorker-3] [31b7ea4c-6063-4e99-b0c9-b3f4261c6f02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:00:01.222932024Z [2024-03-28 02:00:01,212: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:00:01.342236583Z [2024-03-28 02:00:01,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:00:01.559199814Z [2024-03-28 02:00:01,558: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:01.578223850Z [2024-03-28 02:00:01,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:00:01.587166000Z [2024-03-28 02:00:01,582: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:00:01.779794383Z [2024-03-28 02:00:01,773: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:00:02.064048032Z [2024-03-28 02:00:02,062: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T02:00:02.069526891Z [2024-03-28 02:00:02,068: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:02.121739028Z [2024-03-28 02:00:02,121: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:00:02.122983839Z [2024-03-28 02:00:02,122: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:00:02.123042858Z [2024-03-28 02:00:02,122: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:00:02.123138750Z [2024-03-28 02:00:02,123: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T02:00:02.123438959Z [2024-03-28 02:00:02,123: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:00:02.235989881Z [2024-03-28 02:00:02,235: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:02.625449561Z [2024-03-28 02:00:02,624: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[80d12c24-5c4d-4566-a47d-b7cf3181163b] succeeded in 1.7710685629990621s: None 2024-03-28T02:00:03.401431213Z [2024-03-28 02:00:03,400: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[31b7ea4c-6063-4e99-b0c9-b3f4261c6f02] succeeded in 2.542736319001051s: None 2024-03-28T02:00:03.517771214Z [2024-03-28 02:00:03,517: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:00:03.523752891Z [2024-03-28 02:00:03,523: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:03.552859889Z [2024-03-28 02:00:03,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:00:03.554723001Z [2024-03-28 02:00:03,554: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:03.554788655Z [2024-03-28 02:00:03,554: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:03.554950249Z [2024-03-28 02:00:03,554: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:03.555077396Z [2024-03-28 02:00:03,554: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:00:03.555444631Z [2024-03-28 02:00:03,555: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:00:03.556070187Z [2024-03-28 02:00:03,555: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:03.595025597Z [2024-03-28 02:00:03,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:00:03.602948170Z [2024-03-28 02:00:03,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:03.650973356Z [2024-03-28 02:00:03,650: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:03.651146484Z [2024-03-28 02:00:03,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:00:03.653576645Z [2024-03-28 02:00:03,653: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:03.653815710Z [2024-03-28 02:00:03,653: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:03.654107167Z [2024-03-28 02:00:03,653: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:03.654327133Z [2024-03-28 02:00:03,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:00:03.654834745Z [2024-03-28 02:00:03,654: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:00:03.655042374Z [2024-03-28 02:00:03,654: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:03.742358679Z [2024-03-28 02:00:03,741: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:00:03.761876106Z [2024-03-28 02:00:03,747: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:03.799634163Z [2024-03-28 02:00:03,798: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:00:03.805774554Z [2024-03-28 02:00:03,802: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:03.805821742Z [2024-03-28 02:00:03,805: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:03.809708871Z [2024-03-28 02:00:03,806: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:03.809746131Z [2024-03-28 02:00:03,808: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:00:03.809752819Z [2024-03-28 02:00:03,808: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:00:03.809759068Z [2024-03-28 02:00:03,808: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:03.856884584Z [2024-03-28 02:00:03,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:03.994207165Z [2024-03-28 02:00:03,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:04.832034858Z [2024-03-28 02:00:04,831: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2cc65520-46fa-4b72-873f-ce008445b420] succeeded in 3.985886746999313s: None 2024-03-28T02:00:05.134507336Z [2024-03-28 02:00:05,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12824353-baed-4202-b80e-bc2d28b4251a] received 2024-03-28T02:00:05.145030915Z [2024-03-28 02:00:05,144: INFO/ForkPoolWorker-16] [12824353-baed-4202-b80e-bc2d28b4251a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:00:05.479306009Z [2024-03-28 02:00:05,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:00:05.507145000Z [2024-03-28 02:00:05,506: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bfca6e3a-fe28-41c7-86bb-381b79552cea] succeeded in 4.656087200000911s: None 2024-03-28T02:00:06.405244627Z [2024-03-28 02:00:06,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb4fa32b-c119-4989-8bde-c4ee61e5bfbf] succeeded in 5.560165777000293s: None 2024-03-28T02:00:06.861828345Z [2024-03-28 02:00:06,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:00:06.866567346Z [2024-03-28 02:00:06,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:06.889237315Z [2024-03-28 02:00:06,888: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:00:06.891775992Z [2024-03-28 02:00:06,891: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:06.891807012Z [2024-03-28 02:00:06,891: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:06.892139294Z [2024-03-28 02:00:06,891: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:06.892261695Z [2024-03-28 02:00:06,892: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:00:06.892907417Z [2024-03-28 02:00:06,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:00:06.892920748Z [2024-03-28 02:00:06,892: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:07.013172821Z [2024-03-28 02:00:07,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:07.707860241Z [2024-03-28 02:00:07,707: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12824353-baed-4202-b80e-bc2d28b4251a] succeeded in 2.570572053000433s: None 2024-03-28T02:00:08.732273232Z [2024-03-28 02:00:08,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e3d49b8-f0f5-47b9-a12a-8f7fcd5040b3] received 2024-03-28T02:00:08.742113853Z [2024-03-28 02:00:08,741: INFO/ForkPoolWorker-15] [8e3d49b8-f0f5-47b9-a12a-8f7fcd5040b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:00:09.047084492Z [2024-03-28 02:00:09,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:00:10.487350723Z [2024-03-28 02:00:10,486: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:00:10.490977944Z [2024-03-28 02:00:10,490: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:10.526515442Z [2024-03-28 02:00:10,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:00:10.530879601Z [2024-03-28 02:00:10,530: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:10.531170083Z [2024-03-28 02:00:10,530: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:10.531413106Z [2024-03-28 02:00:10,531: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:10.531571784Z [2024-03-28 02:00:10,531: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:00:10.531956178Z [2024-03-28 02:00:10,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:00:10.532165381Z [2024-03-28 02:00:10,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:10.620304890Z [2024-03-28 02:00:10,620: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:11.328390376Z [2024-03-28 02:00:11,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e3d49b8-f0f5-47b9-a12a-8f7fcd5040b3] succeeded in 2.5933074559998204s: None 2024-03-28T02:00:11.466114585Z [2024-03-28 02:00:11,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18b892b-c8aa-4703-9176-0d21e5935a2f] received 2024-03-28T02:00:11.478844500Z [2024-03-28 02:00:11,478: INFO/ForkPoolWorker-15] [e18b892b-c8aa-4703-9176-0d21e5935a2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:00:11.771997464Z [2024-03-28 02:00:11,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:00:12.919023672Z [2024-03-28 02:00:12,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:00:12.922362769Z [2024-03-28 02:00:12,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:00:12.942412174Z [2024-03-28 02:00:12,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:00:12.943732228Z [2024-03-28 02:00:12,943: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:00:12.943803083Z [2024-03-28 02:00:12,943: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:00:12.943880141Z [2024-03-28 02:00:12,943: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:00:12.943928925Z [2024-03-28 02:00:12,943: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:00:12.944587376Z [2024-03-28 02:00:12,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:00:12.944641091Z [2024-03-28 02:00:12,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:00:13.032344457Z [2024-03-28 02:00:13,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:00:13.643515056Z [2024-03-28 02:00:13,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e18b892b-c8aa-4703-9176-0d21e5935a2f] succeeded in 2.1744439089998195s: None 2024-03-28T02:01:00.654960532Z [2024-03-28 02:01:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dbcd872-6c8b-4888-9c7d-57d0af78f34e] received 2024-03-28T02:01:00.656568452Z [2024-03-28 02:01:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05aaf70b-3211-49c6-9476-3c7ad9af84be] received 2024-03-28T02:01:00.665346140Z [2024-03-28 02:01:00,664: INFO/ForkPoolWorker-15] [4dbcd872-6c8b-4888-9c7d-57d0af78f34e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:01:00.671099231Z [2024-03-28 02:01:00,670: INFO/ForkPoolWorker-16] [05aaf70b-3211-49c6-9476-3c7ad9af84be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:01:00.677688429Z [2024-03-28 02:01:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adc1d51c-69ec-4889-8199-82455c745c68] received 2024-03-28T02:01:00.688870216Z [2024-03-28 02:01:00,688: INFO/ForkPoolWorker-1] [adc1d51c-69ec-4889-8199-82455c745c68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:01:00.961961008Z [2024-03-28 02:01:00,958: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:01:00.987226779Z [2024-03-28 02:01:00,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:01:01.019268797Z [2024-03-28 02:01:01,016: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:01:01.217601884Z [2024-03-28 02:01:01,217: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T02:01:01.225684552Z [2024-03-28 02:01:01,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:01:01.254082989Z [2024-03-28 02:01:01,253: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:01:01.257128596Z [2024-03-28 02:01:01,256: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:01:01.257340421Z [2024-03-28 02:01:01,257: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:01:01.258682334Z [2024-03-28 02:01:01,258: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T02:01:01.259325700Z [2024-03-28 02:01:01,259: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:01:01.378694962Z [2024-03-28 02:01:01,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:01:02.034798595Z [2024-03-28 02:01:02,034: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4dbcd872-6c8b-4888-9c7d-57d0af78f34e] succeeded in 1.3783055650001188s: None 2024-03-28T02:01:02.322172779Z [2024-03-28 02:01:02,321: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:01:02.325866906Z [2024-03-28 02:01:02,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:01:02.377998439Z [2024-03-28 02:01:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:01:02.380321933Z [2024-03-28 02:01:02,380: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:01:02.380344711Z [2024-03-28 02:01:02,380: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:01:02.380551626Z [2024-03-28 02:01:02,380: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:01:02.380679187Z [2024-03-28 02:01:02,380: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:01:02.381990037Z [2024-03-28 02:01:02,380: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:01:02.382229887Z [2024-03-28 02:01:02,382: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:01:02.383533295Z [2024-03-28 02:01:02,383: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:01:02.387968890Z [2024-03-28 02:01:02,387: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:01:02.442287469Z [2024-03-28 02:01:02,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:01:02.446325924Z [2024-03-28 02:01:02,445: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:01:02.446719264Z [2024-03-28 02:01:02,446: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:01:02.450469099Z [2024-03-28 02:01:02,446: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:01:02.450837093Z [2024-03-28 02:01:02,450: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:01:02.452174637Z [2024-03-28 02:01:02,451: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:01:02.452449206Z [2024-03-28 02:01:02,452: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:01:02.504561860Z [2024-03-28 02:01:02,504: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:01:02.600439247Z [2024-03-28 02:01:02,600: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:01:04.265406411Z [2024-03-28 02:01:04,264: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[adc1d51c-69ec-4889-8199-82455c745c68] succeeded in 3.5858237160009594s: None 2024-03-28T02:01:04.480356937Z [2024-03-28 02:01:04,479: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05aaf70b-3211-49c6-9476-3c7ad9af84be] succeeded in 3.8214179200003855s: None 2024-03-28T02:02:00.496552147Z [2024-03-28 02:02:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b996da7b-3136-4c08-9c3e-41a25e899e50] received 2024-03-28T02:02:00.499521003Z [2024-03-28 02:02:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc0592c6-bc71-4fe7-857b-b96105666bc7] received 2024-03-28T02:02:00.501826655Z [2024-03-28 02:02:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42525f6e-de36-4ce3-b193-aaaaba0fd300] received 2024-03-28T02:02:00.504483787Z [2024-03-28 02:02:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c82b0941-b919-45c5-ac45-9b5ef7ffe03f] received 2024-03-28T02:02:00.512285006Z [2024-03-28 02:02:00,511: INFO/ForkPoolWorker-16] [bc0592c6-bc71-4fe7-857b-b96105666bc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:02:00.518381454Z [2024-03-28 02:02:00,518: INFO/ForkPoolWorker-15] [b996da7b-3136-4c08-9c3e-41a25e899e50] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:02:00.519331662Z [2024-03-28 02:02:00,518: INFO/ForkPoolWorker-1] [42525f6e-de36-4ce3-b193-aaaaba0fd300] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:02:00.520136543Z [2024-03-28 02:02:00,519: INFO/ForkPoolWorker-2] [c82b0941-b919-45c5-ac45-9b5ef7ffe03f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:02:00.831784579Z [2024-03-28 02:02:00,827: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:02:00.854957825Z [2024-03-28 02:02:00,851: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:02:01.006329984Z [2024-03-28 02:02:01,002: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:02:01.014497838Z [2024-03-28 02:02:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:02:01.076384156Z [2024-03-28 02:02:01,075: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:02:01.086711048Z [2024-03-28 02:02:01,085: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:02:01.149012739Z [2024-03-28 02:02:01,148: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:02:01.154706187Z [2024-03-28 02:02:01,154: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:02:01.155114912Z [2024-03-28 02:02:01,154: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:02:01.155449267Z [2024-03-28 02:02:01,155: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:02:01.156024749Z [2024-03-28 02:02:01,155: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:02:01.264904809Z [2024-03-28 02:02:01,264: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:02:01.326585990Z [2024-03-28 02:02:01,326: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:02:01.963099159Z [2024-03-28 02:02:01,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b996da7b-3136-4c08-9c3e-41a25e899e50] succeeded in 1.4638241520005977s: None 2024-03-28T02:02:02.130858414Z [2024-03-28 02:02:02,130: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c82b0941-b919-45c5-ac45-9b5ef7ffe03f] succeeded in 1.6240339579999272s: None 2024-03-28T02:02:02.205303460Z [2024-03-28 02:02:02,204: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:02:02.209253682Z [2024-03-28 02:02:02,208: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:02:02.244768641Z [2024-03-28 02:02:02,244: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:02:02.246945462Z [2024-03-28 02:02:02,246: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:02:02.247005154Z [2024-03-28 02:02:02,246: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:02:02.247241122Z [2024-03-28 02:02:02,246: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:02:02.247427716Z [2024-03-28 02:02:02,247: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:02:02.247893918Z [2024-03-28 02:02:02,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:02:02.248244632Z [2024-03-28 02:02:02,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:02:02.358900567Z [2024-03-28 02:02:02,358: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:02:02.562178718Z [2024-03-28 02:02:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:02:02.566023170Z [2024-03-28 02:02:02,565: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:02:02.589842025Z [2024-03-28 02:02:02,589: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:02:02.591634423Z [2024-03-28 02:02:02,591: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:02:02.591697816Z [2024-03-28 02:02:02,591: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:02:02.591899479Z [2024-03-28 02:02:02,591: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:02:02.591964893Z [2024-03-28 02:02:02,591: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:02:02.592373200Z [2024-03-28 02:02:02,592: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:02:02.592430898Z [2024-03-28 02:02:02,592: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:02:02.732731781Z [2024-03-28 02:02:02,732: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:02:04.240282169Z [2024-03-28 02:02:04,239: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42525f6e-de36-4ce3-b193-aaaaba0fd300] succeeded in 3.73626534199866s: None 2024-03-28T02:02:04.330184351Z [2024-03-28 02:02:04,329: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc0592c6-bc71-4fe7-857b-b96105666bc7] succeeded in 3.829014063998329s: None 2024-03-28T02:03:00.257791285Z [2024-03-28 02:03:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3a26774-26fb-4650-a296-9e642197059c] received 2024-03-28T02:03:00.259589206Z [2024-03-28 02:03:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9571b8b-23c6-412f-8266-8dafe7d6930a] received 2024-03-28T02:03:00.261676081Z [2024-03-28 02:03:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f74375e-82ca-426d-b1cd-820c16f04ae7] received 2024-03-28T02:03:00.265989175Z [2024-03-28 02:03:00,265: INFO/ForkPoolWorker-15] [b3a26774-26fb-4650-a296-9e642197059c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:03:00.275520558Z [2024-03-28 02:03:00,275: INFO/ForkPoolWorker-1] [9f74375e-82ca-426d-b1cd-820c16f04ae7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:03:00.275673232Z [2024-03-28 02:03:00,275: INFO/ForkPoolWorker-16] [e9571b8b-23c6-412f-8266-8dafe7d6930a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:03:00.571741361Z [2024-03-28 02:03:00,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:03:00.578949989Z [2024-03-28 02:03:00,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:03:00.596808651Z [2024-03-28 02:03:00,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:03:00.738775167Z [2024-03-28 02:03:00,738: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T02:03:00.743294225Z [2024-03-28 02:03:00,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:03:00.762812183Z [2024-03-28 02:03:00,762: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:03:00.764041998Z [2024-03-28 02:03:00,763: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:03:00.764111549Z [2024-03-28 02:03:00,763: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:03:00.764192782Z [2024-03-28 02:03:00,764: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T02:03:00.764427655Z [2024-03-28 02:03:00,764: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:03:00.899220398Z [2024-03-28 02:03:00,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:03:01.587103529Z [2024-03-28 02:03:01,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3a26774-26fb-4650-a296-9e642197059c] succeeded in 1.3276328649990319s: None 2024-03-28T02:03:01.928425331Z [2024-03-28 02:03:01,928: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:03:01.932137077Z [2024-03-28 02:03:01,931: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:03:01.974444972Z [2024-03-28 02:03:01,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:03:01.976754750Z [2024-03-28 02:03:01,976: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:03:01.976888222Z [2024-03-28 02:03:01,976: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:03:01.977123330Z [2024-03-28 02:03:01,976: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:03:01.977217707Z [2024-03-28 02:03:01,977: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:03:01.977531756Z [2024-03-28 02:03:01,977: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:03:01.978088535Z [2024-03-28 02:03:01,977: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:03:02.093713994Z [2024-03-28 02:03:02,093: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:03:02.148097426Z [2024-03-28 02:03:02,147: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:03:02.151986967Z [2024-03-28 02:03:02,151: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:03:02.173630436Z [2024-03-28 02:03:02,173: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:03:02.175338323Z [2024-03-28 02:03:02,175: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:03:02.175626487Z [2024-03-28 02:03:02,175: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:03:02.175873995Z [2024-03-28 02:03:02,175: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:03:02.175895465Z [2024-03-28 02:03:02,175: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:03:02.176284566Z [2024-03-28 02:03:02,176: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:03:02.176310259Z [2024-03-28 02:03:02,176: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:03:02.280281548Z [2024-03-28 02:03:02,279: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:03:03.723098516Z [2024-03-28 02:03:03,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f74375e-82ca-426d-b1cd-820c16f04ae7] succeeded in 3.4555351290000544s: None 2024-03-28T02:03:04.215762544Z [2024-03-28 02:03:04,215: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9571b8b-23c6-412f-8266-8dafe7d6930a] succeeded in 3.9525469149994024s: None 2024-03-28T02:04:01.102417703Z [2024-03-28 02:04:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeef3d82-ed48-4480-bf35-bb527e9ef09b] received 2024-03-28T02:04:01.106699630Z [2024-03-28 02:04:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5abaffae-3131-4ce5-b164-71ab61bbd27f] received 2024-03-28T02:04:01.113091119Z [2024-03-28 02:04:01,112: INFO/ForkPoolWorker-15] [aeef3d82-ed48-4480-bf35-bb527e9ef09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:04:01.116269790Z [2024-03-28 02:04:01,115: INFO/ForkPoolWorker-16] [5abaffae-3131-4ce5-b164-71ab61bbd27f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:04:01.128394711Z [2024-03-28 02:04:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efc42a55-c584-4ffb-a1bb-02f95b82f422] received 2024-03-28T02:04:01.134713120Z [2024-03-28 02:04:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc3399f8-2638-4cb1-b120-bc71d66753f0] received 2024-03-28T02:04:01.137338411Z [2024-03-28 02:04:01,137: INFO/ForkPoolWorker-1] [efc42a55-c584-4ffb-a1bb-02f95b82f422] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:04:01.147140611Z [2024-03-28 02:04:01,146: INFO/ForkPoolWorker-2] [fc3399f8-2638-4cb1-b120-bc71d66753f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:04:01.497041006Z [2024-03-28 02:04:01,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:04:01.510224693Z [2024-03-28 02:04:01,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:04:01.556328359Z [2024-03-28 02:04:01,552: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:04:01.759234360Z [2024-03-28 02:04:01,754: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:04:01.791577070Z [2024-03-28 02:04:01,791: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:04:01.804539406Z [2024-03-28 02:04:01,803: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:04:01.847716952Z [2024-03-28 02:04:01,847: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:04:01.860237578Z [2024-03-28 02:04:01,859: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:04:01.860704021Z [2024-03-28 02:04:01,860: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:04:01.861622022Z [2024-03-28 02:04:01,861: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:04:01.862208941Z [2024-03-28 02:04:01,861: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:04:01.975902235Z [2024-03-28 02:04:01,975: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:04:02.080900408Z [2024-03-28 02:04:02,080: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:04:02.762128057Z [2024-03-28 02:04:02,761: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[efc42a55-c584-4ffb-a1bb-02f95b82f422] succeeded in 1.6314063130012073s: None 2024-03-28T02:04:02.962135654Z [2024-03-28 02:04:02,961: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5abaffae-3131-4ce5-b164-71ab61bbd27f] succeeded in 1.853298616999382s: None 2024-03-28T02:04:03.336551192Z [2024-03-28 02:04:03,336: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:04:03.341741215Z [2024-03-28 02:04:03,341: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:04:03.361667897Z [2024-03-28 02:04:03,361: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:04:03.363259339Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:04:03.363324436Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:04:03.363497765Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:04:03.363562071Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:04:03.363867336Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:04:03.363944229Z [2024-03-28 02:04:03,363: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:04:03.413098574Z [2024-03-28 02:04:03,412: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:04:03.416733355Z [2024-03-28 02:04:03,416: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:04:03.439556199Z [2024-03-28 02:04:03,439: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:04:03.441044090Z [2024-03-28 02:04:03,440: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:04:03.441175917Z [2024-03-28 02:04:03,441: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:04:03.441315590Z [2024-03-28 02:04:03,441: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:04:03.441402488Z [2024-03-28 02:04:03,441: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:04:03.441761974Z [2024-03-28 02:04:03,441: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:04:03.441881177Z [2024-03-28 02:04:03,441: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:04:03.466515228Z [2024-03-28 02:04:03,466: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:04:03.525671741Z [2024-03-28 02:04:03,525: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:04:05.050656931Z [2024-03-28 02:04:05,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aeef3d82-ed48-4480-bf35-bb527e9ef09b] succeeded in 3.944586812000125s: None 2024-03-28T02:04:05.387542804Z [2024-03-28 02:04:05,387: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc3399f8-2638-4cb1-b120-bc71d66753f0] succeeded in 4.249197629000264s: None 2024-03-28T02:05:00.800908240Z [2024-03-28 02:05:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157571f9-522b-488a-a9b7-b24bb1a652bb] received 2024-03-28T02:05:00.807157698Z [2024-03-28 02:05:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3722083-686b-46bd-9f55-9d78303973b8] received 2024-03-28T02:05:00.809240158Z [2024-03-28 02:05:00,808: INFO/ForkPoolWorker-15] [157571f9-522b-488a-a9b7-b24bb1a652bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:05:00.818249303Z [2024-03-28 02:05:00,817: INFO/ForkPoolWorker-16] [c3722083-686b-46bd-9f55-9d78303973b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:05:00.823142922Z [2024-03-28 02:05:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2cd2c62-d524-4c48-a9d8-28cd041ec11f] received 2024-03-28T02:05:00.832507868Z [2024-03-28 02:05:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9230dcd8-a2c2-478d-890d-1c0c37259bbf] received 2024-03-28T02:05:00.836583816Z [2024-03-28 02:05:00,836: INFO/ForkPoolWorker-1] [d2cd2c62-d524-4c48-a9d8-28cd041ec11f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:05:00.843249878Z [2024-03-28 02:05:00,842: INFO/ForkPoolWorker-2] [9230dcd8-a2c2-478d-890d-1c0c37259bbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:05:01.319654734Z [2024-03-28 02:05:01,316: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:05:01.360780139Z [2024-03-28 02:05:01,356: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:05:01.475729872Z [2024-03-28 02:05:01,470: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:05:01.517987257Z [2024-03-28 02:05:01,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:05:01.566052456Z [2024-03-28 02:05:01,565: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:05:01.570694098Z [2024-03-28 02:05:01,570: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:01.610351392Z [2024-03-28 02:05:01,610: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:05:01.611793048Z [2024-03-28 02:05:01,611: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:05:01.612012165Z [2024-03-28 02:05:01,611: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:05:01.612160541Z [2024-03-28 02:05:01,611: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:05:01.612480207Z [2024-03-28 02:05:01,612: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:05:01.725744339Z [2024-03-28 02:05:01,725: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:02.557169961Z [2024-03-28 02:05:02,556: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9230dcd8-a2c2-478d-890d-1c0c37259bbf] succeeded in 1.7225646910010255s: None 2024-03-28T02:05:02.964626786Z [2024-03-28 02:05:02,964: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:05:02.968482526Z [2024-03-28 02:05:02,967: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:03.016814336Z [2024-03-28 02:05:03,016: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:05:03.018764626Z [2024-03-28 02:05:03,018: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:03.018806101Z [2024-03-28 02:05:03,018: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:03.019004735Z [2024-03-28 02:05:03,018: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:03.019031762Z [2024-03-28 02:05:03,018: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:05:03.019505829Z [2024-03-28 02:05:03,019: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:05:03.019533388Z [2024-03-28 02:05:03,019: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:03.139733674Z [2024-03-28 02:05:03,139: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:03.260082377Z [2024-03-28 02:05:03,259: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:05:03.264193934Z [2024-03-28 02:05:03,263: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:03.294966495Z [2024-03-28 02:05:03,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:05:03.296854062Z [2024-03-28 02:05:03,296: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:03.296991928Z [2024-03-28 02:05:03,296: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:03.297331697Z [2024-03-28 02:05:03,296: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:03.297526677Z [2024-03-28 02:05:03,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:05:03.297967697Z [2024-03-28 02:05:03,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:05:03.298118846Z [2024-03-28 02:05:03,297: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:03.315179771Z [2024-03-28 02:05:03,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:05:03.319154359Z [2024-03-28 02:05:03,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:03.355968551Z [2024-03-28 02:05:03,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:05:03.358568608Z [2024-03-28 02:05:03,358: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:03.358807196Z [2024-03-28 02:05:03,358: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:03.359019030Z [2024-03-28 02:05:03,358: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:03.359163873Z [2024-03-28 02:05:03,359: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:05:03.359555640Z [2024-03-28 02:05:03,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:05:03.359739680Z [2024-03-28 02:05:03,359: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:03.411716679Z [2024-03-28 02:05:03,411: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:03.557710257Z [2024-03-28 02:05:03,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:04.367242253Z [2024-03-28 02:05:04,366: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[157571f9-522b-488a-a9b7-b24bb1a652bb] succeeded in 3.564070182999785s: None 2024-03-28T02:05:05.045155033Z [2024-03-28 02:05:05,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64e7f7dc-db6b-449f-952d-60db4c5a6145] received 2024-03-28T02:05:05.059552016Z [2024-03-28 02:05:05,059: INFO/ForkPoolWorker-15] [64e7f7dc-db6b-449f-952d-60db4c5a6145] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:05:05.433164312Z [2024-03-28 02:05:05,432: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3722083-686b-46bd-9f55-9d78303973b8] succeeded in 4.621337011998548s: None 2024-03-28T02:05:05.445086708Z [2024-03-28 02:05:05,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:05:05.652137594Z [2024-03-28 02:05:05,651: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2cd2c62-d524-4c48-a9d8-28cd041ec11f] succeeded in 4.825299657000869s: None 2024-03-28T02:05:06.925867070Z [2024-03-28 02:05:06,925: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:05:06.929351848Z [2024-03-28 02:05:06,928: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:06.953852649Z [2024-03-28 02:05:06,953: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:05:06.955273895Z [2024-03-28 02:05:06,954: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:06.955356627Z [2024-03-28 02:05:06,955: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:06.955730388Z [2024-03-28 02:05:06,955: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:06.955849551Z [2024-03-28 02:05:06,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:05:06.956292881Z [2024-03-28 02:05:06,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:05:06.956486865Z [2024-03-28 02:05:06,956: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:07.050031579Z [2024-03-28 02:05:07,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:07.735623934Z [2024-03-28 02:05:07,735: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64e7f7dc-db6b-449f-952d-60db4c5a6145] succeeded in 2.687640473001011s: None 2024-03-28T02:05:08.635339549Z [2024-03-28 02:05:08,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eeb037a-6e16-4111-980b-6806d8183892] received 2024-03-28T02:05:08.651256259Z [2024-03-28 02:05:08,650: INFO/ForkPoolWorker-15] [8eeb037a-6e16-4111-980b-6806d8183892] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:05:08.990708136Z [2024-03-28 02:05:08,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:05:10.625808991Z [2024-03-28 02:05:10,624: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:05:10.629737713Z [2024-03-28 02:05:10,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:10.666282089Z [2024-03-28 02:05:10,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:05:10.670589682Z [2024-03-28 02:05:10,670: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:10.670711637Z [2024-03-28 02:05:10,670: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:10.670994719Z [2024-03-28 02:05:10,670: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:10.671110696Z [2024-03-28 02:05:10,670: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:05:10.671604930Z [2024-03-28 02:05:10,671: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:05:10.671654845Z [2024-03-28 02:05:10,671: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:10.778561103Z [2024-03-28 02:05:10,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:11.383495305Z [2024-03-28 02:05:11,382: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8eeb037a-6e16-4111-980b-6806d8183892] succeeded in 2.744319841998731s: None 2024-03-28T02:05:11.494170206Z [2024-03-28 02:05:11,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[059e36bd-c99b-468d-a3ba-e886ef41d176] received 2024-03-28T02:05:11.503204259Z [2024-03-28 02:05:11,502: INFO/ForkPoolWorker-15] [059e36bd-c99b-468d-a3ba-e886ef41d176] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:05:11.844968874Z [2024-03-28 02:05:11,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:05:13.093214128Z [2024-03-28 02:05:13,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:05:13.099302878Z [2024-03-28 02:05:13,098: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:05:13.123925611Z [2024-03-28 02:05:13,123: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:05:13.125616393Z [2024-03-28 02:05:13,125: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:05:13.125801976Z [2024-03-28 02:05:13,125: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:05:13.125984333Z [2024-03-28 02:05:13,125: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:05:13.125996972Z [2024-03-28 02:05:13,125: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:05:13.126268052Z [2024-03-28 02:05:13,126: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:05:13.126277092Z [2024-03-28 02:05:13,126: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:05:13.214842221Z [2024-03-28 02:05:13,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:05:13.801810689Z [2024-03-28 02:05:13,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[059e36bd-c99b-468d-a3ba-e886ef41d176] succeeded in 2.3046446059997834s: None 2024-03-28T02:06:01.095023438Z [2024-03-28 02:06:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36cafc19-f45e-4714-9429-0669adc4848b] received 2024-03-28T02:06:01.103682635Z [2024-03-28 02:06:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3665a34b-ae61-4d14-ae21-0ab7b02ac39b] received 2024-03-28T02:06:01.109018449Z [2024-03-28 02:06:01,108: INFO/ForkPoolWorker-15] [36cafc19-f45e-4714-9429-0669adc4848b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:06:01.112306826Z [2024-03-28 02:06:01,109: INFO/ForkPoolWorker-16] [3665a34b-ae61-4d14-ae21-0ab7b02ac39b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:06:01.112336245Z [2024-03-28 02:06:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79ded1e9-63e4-4918-ba85-e9fb7097dd5c] received 2024-03-28T02:06:01.112660784Z [2024-03-28 02:06:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd839497-ba27-4f41-9aed-55ed7c33857b] received 2024-03-28T02:06:01.121374712Z [2024-03-28 02:06:01,120: INFO/ForkPoolWorker-2] [fd839497-ba27-4f41-9aed-55ed7c33857b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:06:01.123761905Z [2024-03-28 02:06:01,123: INFO/ForkPoolWorker-1] [79ded1e9-63e4-4918-ba85-e9fb7097dd5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:06:01.474469468Z [2024-03-28 02:06:01,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:06:01.515191917Z [2024-03-28 02:06:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:06:01.564814047Z [2024-03-28 02:06:01,558: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:06:01.655719233Z [2024-03-28 02:06:01,651: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:06:01.839519701Z [2024-03-28 02:06:01,838: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:06:01.846025423Z [2024-03-28 02:06:01,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:06:01.890968426Z [2024-03-28 02:06:01,890: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:06:01.892442906Z [2024-03-28 02:06:01,892: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:06:01.892714963Z [2024-03-28 02:06:01,892: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:06:01.892830238Z [2024-03-28 02:06:01,892: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:06:01.893794081Z [2024-03-28 02:06:01,893: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:06:02.058073381Z [2024-03-28 02:06:02,057: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:06:02.148538944Z [2024-03-28 02:06:02,148: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:06:02.769426306Z [2024-03-28 02:06:02,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3665a34b-ae61-4d14-ae21-0ab7b02ac39b] succeeded in 1.665557448999607s: None 2024-03-28T02:06:02.813468761Z [2024-03-28 02:06:02,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79ded1e9-63e4-4918-ba85-e9fb7097dd5c] succeeded in 1.701028972000131s: None 2024-03-28T02:06:03.119869080Z [2024-03-28 02:06:03,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:06:03.123811269Z [2024-03-28 02:06:03,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:06:03.147342821Z [2024-03-28 02:06:03,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:06:03.149001671Z [2024-03-28 02:06:03,148: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:06:03.149239854Z [2024-03-28 02:06:03,148: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:06:03.149432836Z [2024-03-28 02:06:03,149: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:06:03.149665755Z [2024-03-28 02:06:03,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:06:03.150066242Z [2024-03-28 02:06:03,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:06:03.150659696Z [2024-03-28 02:06:03,150: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:06:03.251585944Z [2024-03-28 02:06:03,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:06:03.253921457Z [2024-03-28 02:06:03,253: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:06:03.258781180Z [2024-03-28 02:06:03,258: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:06:03.296126605Z [2024-03-28 02:06:03,295: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:06:03.299189173Z [2024-03-28 02:06:03,298: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:06:03.299242454Z [2024-03-28 02:06:03,299: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:06:03.299346782Z [2024-03-28 02:06:03,299: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:06:03.299363924Z [2024-03-28 02:06:03,299: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:06:03.299686099Z [2024-03-28 02:06:03,299: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:06:03.299767763Z [2024-03-28 02:06:03,299: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:06:03.426945116Z [2024-03-28 02:06:03,426: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:06:04.994907375Z [2024-03-28 02:06:04,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36cafc19-f45e-4714-9429-0669adc4848b] succeeded in 3.897295294000287s: None 2024-03-28T02:06:05.667021530Z [2024-03-28 02:06:05,666: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd839497-ba27-4f41-9aed-55ed7c33857b] succeeded in 4.552370608000274s: None 2024-03-28T02:07:00.344877259Z [2024-03-28 02:07:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3944b280-f826-4313-9056-aa575b9f0fc8] received 2024-03-28T02:07:00.346940855Z [2024-03-28 02:07:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d5deec3-d8dd-456c-9332-ff342c425443] received 2024-03-28T02:07:00.352914235Z [2024-03-28 02:07:00,352: INFO/ForkPoolWorker-15] [3944b280-f826-4313-9056-aa575b9f0fc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:07:00.355550443Z [2024-03-28 02:07:00,355: INFO/ForkPoolWorker-16] [8d5deec3-d8dd-456c-9332-ff342c425443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:07:00.364488358Z [2024-03-28 02:07:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fea024f6-bdab-4cd2-92fa-d03e0d4b0b99] received 2024-03-28T02:07:00.379535859Z [2024-03-28 02:07:00,379: INFO/ForkPoolWorker-1] [fea024f6-bdab-4cd2-92fa-d03e0d4b0b99] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:07:00.698031740Z [2024-03-28 02:07:00,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:07:00.705403521Z [2024-03-28 02:07:00,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:07:00.823689688Z [2024-03-28 02:07:00,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:07:00.957653785Z [2024-03-28 02:07:00,955: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:07:00.964463430Z [2024-03-28 02:07:00,963: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:07:01.008125926Z [2024-03-28 02:07:01,007: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:07:01.009897634Z [2024-03-28 02:07:01,009: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:07:01.010593914Z [2024-03-28 02:07:01,010: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:07:01.010658516Z [2024-03-28 02:07:01,010: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:07:01.010953914Z [2024-03-28 02:07:01,010: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:07:01.114847713Z [2024-03-28 02:07:01,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:07:01.893774465Z [2024-03-28 02:07:01,893: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fea024f6-bdab-4cd2-92fa-d03e0d4b0b99] succeeded in 1.5274216249999881s: None 2024-03-28T02:07:02.269193363Z [2024-03-28 02:07:02,268: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:07:02.277355421Z [2024-03-28 02:07:02,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:07:02.306499293Z [2024-03-28 02:07:02,306: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:07:02.309384627Z [2024-03-28 02:07:02,308: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:07:02.309726819Z [2024-03-28 02:07:02,309: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:07:02.310024331Z [2024-03-28 02:07:02,309: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:07:02.310144477Z [2024-03-28 02:07:02,310: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:07:02.310535708Z [2024-03-28 02:07:02,310: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:07:02.310664536Z [2024-03-28 02:07:02,310: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:07:02.376198139Z [2024-03-28 02:07:02,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:07:02.383055028Z [2024-03-28 02:07:02,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:07:02.411991427Z [2024-03-28 02:07:02,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:07:02.414844242Z [2024-03-28 02:07:02,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:07:02.416878423Z [2024-03-28 02:07:02,416: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:07:02.417225788Z [2024-03-28 02:07:02,416: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:07:02.417570303Z [2024-03-28 02:07:02,417: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:07:02.417701319Z [2024-03-28 02:07:02,417: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:07:02.418168413Z [2024-03-28 02:07:02,417: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:07:02.418828050Z [2024-03-28 02:07:02,418: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:07:02.539851615Z [2024-03-28 02:07:02,539: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:07:04.165602588Z [2024-03-28 02:07:04,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3944b280-f826-4313-9056-aa575b9f0fc8] succeeded in 3.818794582999544s: None 2024-03-28T02:07:04.662785674Z [2024-03-28 02:07:04,662: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d5deec3-d8dd-456c-9332-ff342c425443] succeeded in 4.314187813999524s: None 2024-03-28T02:08:00.227202015Z [2024-03-28 02:08:00,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0005823d-1d32-491c-b5b1-80b187a6d406] received 2024-03-28T02:08:00.230131890Z [2024-03-28 02:08:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[886e171c-72c4-467e-bd39-6e1561b48f4e] received 2024-03-28T02:08:00.231723184Z [2024-03-28 02:08:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bf2dacd-79bb-4091-9203-9c437cc31057] received 2024-03-28T02:08:00.233933018Z [2024-03-28 02:08:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2718a51e-3b43-49d7-a06f-a5ba468c930a] received 2024-03-28T02:08:00.238777291Z [2024-03-28 02:08:00,238: INFO/ForkPoolWorker-15] [0005823d-1d32-491c-b5b1-80b187a6d406] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:08:00.247654159Z [2024-03-28 02:08:00,247: INFO/ForkPoolWorker-16] [886e171c-72c4-467e-bd39-6e1561b48f4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:08:00.247766768Z [2024-03-28 02:08:00,247: INFO/ForkPoolWorker-1] [9bf2dacd-79bb-4091-9203-9c437cc31057] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:08:00.252674472Z [2024-03-28 02:08:00,252: INFO/ForkPoolWorker-2] [2718a51e-3b43-49d7-a06f-a5ba468c930a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:08:00.574327996Z [2024-03-28 02:08:00,571: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:08:00.589564643Z [2024-03-28 02:08:00,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:08:00.623762036Z [2024-03-28 02:08:00,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:08:00.782572379Z [2024-03-28 02:08:00,782: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:08:00.792366365Z [2024-03-28 02:08:00,791: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:08:00.834999222Z [2024-03-28 02:08:00,829: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:08:00.839990592Z [2024-03-28 02:08:00,839: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:08:00.841914385Z [2024-03-28 02:08:00,841: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:08:00.841928961Z [2024-03-28 02:08:00,841: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:08:00.841947684Z [2024-03-28 02:08:00,841: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:08:00.842116064Z [2024-03-28 02:08:00,842: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:08:00.906944687Z [2024-03-28 02:08:00,906: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:08:01.016718861Z [2024-03-28 02:08:01,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:08:01.716924775Z [2024-03-28 02:08:01,716: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[886e171c-72c4-467e-bd39-6e1561b48f4e] succeeded in 1.4845166359991708s: None 2024-03-28T02:08:01.993986572Z [2024-03-28 02:08:01,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9bf2dacd-79bb-4091-9203-9c437cc31057] succeeded in 1.759718110999529s: None 2024-03-28T02:08:02.395122976Z [2024-03-28 02:08:02,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:08:02.400097188Z [2024-03-28 02:08:02,399: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:08:02.461347630Z [2024-03-28 02:08:02,461: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:08:02.468426831Z [2024-03-28 02:08:02,468: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:08:02.468762461Z [2024-03-28 02:08:02,468: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:08:02.470112150Z [2024-03-28 02:08:02,468: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:08:02.471082687Z [2024-03-28 02:08:02,470: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:08:02.473958028Z [2024-03-28 02:08:02,472: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:08:02.474770180Z [2024-03-28 02:08:02,474: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:08:02.667704757Z [2024-03-28 02:08:02,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:08:02.750323407Z [2024-03-28 02:08:02,749: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:08:02.754222937Z [2024-03-28 02:08:02,753: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:08:02.794217085Z [2024-03-28 02:08:02,793: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:08:02.802337362Z [2024-03-28 02:08:02,802: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:08:02.802581500Z [2024-03-28 02:08:02,802: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:08:02.803443494Z [2024-03-28 02:08:02,803: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:08:02.803605117Z [2024-03-28 02:08:02,803: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:08:02.803964670Z [2024-03-28 02:08:02,803: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:08:02.804111415Z [2024-03-28 02:08:02,803: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:08:02.908233085Z [2024-03-28 02:08:02,907: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:08:04.541541288Z [2024-03-28 02:08:04,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0005823d-1d32-491c-b5b1-80b187a6d406] succeeded in 4.312470544000462s: None 2024-03-28T02:08:05.014312855Z [2024-03-28 02:08:05,013: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2718a51e-3b43-49d7-a06f-a5ba468c930a] succeeded in 4.773587440000483s: None 2024-03-28T02:09:01.062943667Z [2024-03-28 02:09:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1b17be4-eeb6-457d-bb6f-73058efa1b92] received 2024-03-28T02:09:01.070660451Z [2024-03-28 02:09:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f98e6ad-e95d-4b10-850d-4bdca0a96791] received 2024-03-28T02:09:01.072015516Z [2024-03-28 02:09:01,070: INFO/ForkPoolWorker-15] [a1b17be4-eeb6-457d-bb6f-73058efa1b92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:09:01.074224268Z [2024-03-28 02:09:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8fbc2db-451e-445a-85b4-8c14ed5bdc2b] received 2024-03-28T02:09:01.087479443Z [2024-03-28 02:09:01,087: INFO/ForkPoolWorker-16] [0f98e6ad-e95d-4b10-850d-4bdca0a96791] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:09:01.094014607Z [2024-03-28 02:09:01,093: INFO/ForkPoolWorker-1] [d8fbc2db-451e-445a-85b4-8c14ed5bdc2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:09:01.469867379Z [2024-03-28 02:09:01,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:09:01.520881604Z [2024-03-28 02:09:01,517: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:09:01.532406497Z [2024-03-28 02:09:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:09:01.700694079Z [2024-03-28 02:09:01,700: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:09:01.705026443Z [2024-03-28 02:09:01,704: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:09:01.730913172Z [2024-03-28 02:09:01,730: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:09:01.731969966Z [2024-03-28 02:09:01,731: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:09:01.732013411Z [2024-03-28 02:09:01,731: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:09:01.732061076Z [2024-03-28 02:09:01,731: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:09:01.732266296Z [2024-03-28 02:09:01,732: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:09:01.865657035Z [2024-03-28 02:09:01,865: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:09:02.674333122Z [2024-03-28 02:09:02,672: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d8fbc2db-451e-445a-85b4-8c14ed5bdc2b] succeeded in 1.5969024459991488s: None 2024-03-28T02:09:02.852915704Z [2024-03-28 02:09:02,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:09:02.856742335Z [2024-03-28 02:09:02,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:09:02.876145349Z [2024-03-28 02:09:02,875: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:09:02.877949054Z [2024-03-28 02:09:02,877: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:09:02.878083446Z [2024-03-28 02:09:02,877: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:09:02.878376495Z [2024-03-28 02:09:02,878: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:09:02.878571527Z [2024-03-28 02:09:02,878: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:09:02.879036458Z [2024-03-28 02:09:02,878: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:09:02.879204581Z [2024-03-28 02:09:02,878: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:09:02.985720453Z [2024-03-28 02:09:02,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:09:03.083251147Z [2024-03-28 02:09:03,082: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:09:03.090830809Z [2024-03-28 02:09:03,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:09:03.128026974Z [2024-03-28 02:09:03,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:09:03.130283376Z [2024-03-28 02:09:03,129: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:09:03.130332506Z [2024-03-28 02:09:03,130: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:09:03.130550682Z [2024-03-28 02:09:03,130: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:09:03.130661454Z [2024-03-28 02:09:03,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:09:03.131052281Z [2024-03-28 02:09:03,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:09:03.131189823Z [2024-03-28 02:09:03,131: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:09:03.221404732Z [2024-03-28 02:09:03,221: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:09:05.702395393Z [2024-03-28 02:09:05,702: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f98e6ad-e95d-4b10-850d-4bdca0a96791] succeeded in 4.629884387999482s: None 2024-03-28T02:09:06.408360691Z [2024-03-28 02:09:06,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1b17be4-eeb6-457d-bb6f-73058efa1b92] succeeded in 5.34326568600045s: None 2024-03-28T02:10:00.896773195Z [2024-03-28 02:10:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99548b1b-cb49-4c0b-918d-af9673765be8] received 2024-03-28T02:10:00.903572928Z [2024-03-28 02:10:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70b3eeac-9f45-4797-8a7c-5eb9d412164f] received 2024-03-28T02:10:00.914448970Z [2024-03-28 02:10:00,914: INFO/ForkPoolWorker-15] [99548b1b-cb49-4c0b-918d-af9673765be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:10:00.916373052Z [2024-03-28 02:10:00,916: INFO/ForkPoolWorker-16] [70b3eeac-9f45-4797-8a7c-5eb9d412164f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:10:00.921350040Z [2024-03-28 02:10:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fb2e6e8-8219-4c87-8f2f-717d0d61c53c] received 2024-03-28T02:10:00.927804130Z [2024-03-28 02:10:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20526bec-29f7-453c-99f7-0806b4806c9b] received 2024-03-28T02:10:00.936120190Z [2024-03-28 02:10:00,935: INFO/ForkPoolWorker-1] [6fb2e6e8-8219-4c87-8f2f-717d0d61c53c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:10:00.951407073Z [2024-03-28 02:10:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ac6ac09-4cc7-4bee-9dd5-295f63a7b769] received 2024-03-28T02:10:00.960103163Z [2024-03-28 02:10:00,959: INFO/ForkPoolWorker-2] [20526bec-29f7-453c-99f7-0806b4806c9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:10:00.978091744Z [2024-03-28 02:10:00,977: INFO/ForkPoolWorker-3] [5ac6ac09-4cc7-4bee-9dd5-295f63a7b769] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:10:01.300033708Z [2024-03-28 02:10:01,296: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:10:01.450572588Z [2024-03-28 02:10:01,446: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:10:01.651530207Z [2024-03-28 02:10:01,646: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:10:01.690960098Z [2024-03-28 02:10:01,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:10:01.826838461Z [2024-03-28 02:10:01,815: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:10:01.871400792Z [2024-03-28 02:10:01,871: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:02.234864473Z [2024-03-28 02:10:02,234: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T02:10:02.244737872Z [2024-03-28 02:10:02,244: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:02.291934931Z [2024-03-28 02:10:02,291: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:10:02.296761669Z [2024-03-28 02:10:02,296: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:10:02.296796798Z [2024-03-28 02:10:02,296: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:10:02.297015882Z [2024-03-28 02:10:02,296: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T02:10:02.297512270Z [2024-03-28 02:10:02,297: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:10:02.465528469Z [2024-03-28 02:10:02,465: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:02.761413223Z [2024-03-28 02:10:02,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70b3eeac-9f45-4797-8a7c-5eb9d412164f] succeeded in 1.8508707830005733s: None 2024-03-28T02:10:03.397605860Z [2024-03-28 02:10:03,394: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5ac6ac09-4cc7-4bee-9dd5-295f63a7b769] succeeded in 2.4332721089995175s: None 2024-03-28T02:10:03.498210807Z [2024-03-28 02:10:03,489: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:10:03.498265299Z [2024-03-28 02:10:03,494: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:03.519591694Z [2024-03-28 02:10:03,519: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:10:03.523660575Z [2024-03-28 02:10:03,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:03.537780877Z [2024-03-28 02:10:03,534: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:10:03.539214507Z [2024-03-28 02:10:03,538: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:03.539234530Z [2024-03-28 02:10:03,538: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:03.539240668Z [2024-03-28 02:10:03,538: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:03.539247861Z [2024-03-28 02:10:03,538: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:10:03.540652700Z [2024-03-28 02:10:03,539: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:10:03.540675040Z [2024-03-28 02:10:03,539: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:03.551060624Z [2024-03-28 02:10:03,550: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:10:03.555029695Z [2024-03-28 02:10:03,554: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:03.555077491Z [2024-03-28 02:10:03,554: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:03.555166390Z [2024-03-28 02:10:03,555: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:03.555197720Z [2024-03-28 02:10:03,555: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:10:03.555873627Z [2024-03-28 02:10:03,555: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:10:03.556083330Z [2024-03-28 02:10:03,555: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:03.710218022Z [2024-03-28 02:10:03,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:03.717686260Z [2024-03-28 02:10:03,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:03.974236199Z [2024-03-28 02:10:03,973: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:10:03.986254272Z [2024-03-28 02:10:03,984: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:04.027294512Z [2024-03-28 02:10:04,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:10:04.034876522Z [2024-03-28 02:10:04,034: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:04.035085193Z [2024-03-28 02:10:04,034: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:04.035715330Z [2024-03-28 02:10:04,035: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:04.035936024Z [2024-03-28 02:10:04,035: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:10:04.036496016Z [2024-03-28 02:10:04,036: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:10:04.036710379Z [2024-03-28 02:10:04,036: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:04.173437428Z [2024-03-28 02:10:04,173: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:04.481670727Z [2024-03-28 02:10:04,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99548b1b-cb49-4c0b-918d-af9673765be8] succeeded in 3.5754705750005087s: None 2024-03-28T02:10:05.195170394Z [2024-03-28 02:10:05,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21a34872-e032-4ac0-afac-ef1f2b7189cf] received 2024-03-28T02:10:05.204482102Z [2024-03-28 02:10:05,204: INFO/ForkPoolWorker-15] [21a34872-e032-4ac0-afac-ef1f2b7189cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:10:05.642399238Z [2024-03-28 02:10:05,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:10:05.691815931Z [2024-03-28 02:10:05,691: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20526bec-29f7-453c-99f7-0806b4806c9b] succeeded in 4.761264996999671s: None 2024-03-28T02:10:06.620535135Z [2024-03-28 02:10:06,620: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6fb2e6e8-8219-4c87-8f2f-717d0d61c53c] succeeded in 5.692425155000819s: None 2024-03-28T02:10:06.833046157Z [2024-03-28 02:10:06,832: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:10:06.836242307Z [2024-03-28 02:10:06,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:06.852348760Z [2024-03-28 02:10:06,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:10:06.853691863Z [2024-03-28 02:10:06,853: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:06.853704804Z [2024-03-28 02:10:06,853: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:06.853814629Z [2024-03-28 02:10:06,853: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:06.853828532Z [2024-03-28 02:10:06,853: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:10:06.854066418Z [2024-03-28 02:10:06,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:10:06.854195990Z [2024-03-28 02:10:06,854: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:06.932931902Z [2024-03-28 02:10:06,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:07.618813678Z [2024-03-28 02:10:07,618: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21a34872-e032-4ac0-afac-ef1f2b7189cf] succeeded in 2.4204257530000177s: None 2024-03-28T02:10:07.980214787Z [2024-03-28 02:10:07,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3537bb39-776b-4911-adde-e1b260839ff3] received 2024-03-28T02:10:07.990471161Z [2024-03-28 02:10:07,990: INFO/ForkPoolWorker-15] [3537bb39-776b-4911-adde-e1b260839ff3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:10:08.322318630Z [2024-03-28 02:10:08,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:10:09.690227490Z [2024-03-28 02:10:09,689: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:10:09.694120346Z [2024-03-28 02:10:09,693: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:09.712378392Z [2024-03-28 02:10:09,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:10:09.714063740Z [2024-03-28 02:10:09,713: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:09.714264808Z [2024-03-28 02:10:09,714: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:09.714506835Z [2024-03-28 02:10:09,714: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:09.714669534Z [2024-03-28 02:10:09,714: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:10:09.715047774Z [2024-03-28 02:10:09,714: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:10:09.715331500Z [2024-03-28 02:10:09,715: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:09.840226414Z [2024-03-28 02:10:09,839: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:10.515736212Z [2024-03-28 02:10:10,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f0ba7e-26f7-4250-98f4-d393fca7cad9] received 2024-03-28T02:10:10.527146622Z [2024-03-28 02:10:10,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3537bb39-776b-4911-adde-e1b260839ff3] succeeded in 2.5453557330001786s: None 2024-03-28T02:10:10.540107647Z [2024-03-28 02:10:10,539: INFO/ForkPoolWorker-16] [f7f0ba7e-26f7-4250-98f4-d393fca7cad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:10:10.866529909Z [2024-03-28 02:10:10,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:10:12.155406269Z [2024-03-28 02:10:12,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:10:12.158964665Z [2024-03-28 02:10:12,158: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:10:12.178337910Z [2024-03-28 02:10:12,178: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:10:12.180238664Z [2024-03-28 02:10:12,179: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:10:12.180442798Z [2024-03-28 02:10:12,180: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:10:12.180780701Z [2024-03-28 02:10:12,180: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:10:12.180924573Z [2024-03-28 02:10:12,180: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:10:12.181344324Z [2024-03-28 02:10:12,181: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:10:12.181576774Z [2024-03-28 02:10:12,181: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:10:12.261580227Z [2024-03-28 02:10:12,261: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:10:12.847246877Z [2024-03-28 02:10:12,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7f0ba7e-26f7-4250-98f4-d393fca7cad9] succeeded in 2.3286232059999747s: None 2024-03-28T02:11:01.256291256Z [2024-03-28 02:11:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0749cd6e-3b29-4efe-be33-2543eedefcf1] received 2024-03-28T02:11:01.259814666Z [2024-03-28 02:11:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fc5f4de-8097-455c-a0c0-5934e17b9894] received 2024-03-28T02:11:01.263113344Z [2024-03-28 02:11:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d98555e9-190f-4b54-abed-bacc4069ac19] received 2024-03-28T02:11:01.269289774Z [2024-03-28 02:11:01,268: INFO/ForkPoolWorker-16] [4fc5f4de-8097-455c-a0c0-5934e17b9894] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:11:01.271487672Z [2024-03-28 02:11:01,271: INFO/ForkPoolWorker-15] [0749cd6e-3b29-4efe-be33-2543eedefcf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:11:01.274494213Z [2024-03-28 02:11:01,274: INFO/ForkPoolWorker-1] [d98555e9-190f-4b54-abed-bacc4069ac19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:11:01.606184226Z [2024-03-28 02:11:01,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:11:01.663144979Z [2024-03-28 02:11:01,659: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:11:01.772278859Z [2024-03-28 02:11:01,768: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:11:01.790147115Z [2024-03-28 02:11:01,789: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T02:11:01.794786897Z [2024-03-28 02:11:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:11:01.820837979Z [2024-03-28 02:11:01,820: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:11:01.822146931Z [2024-03-28 02:11:01,821: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:11:01.822312814Z [2024-03-28 02:11:01,822: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:11:01.822416905Z [2024-03-28 02:11:01,822: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T02:11:01.822741019Z [2024-03-28 02:11:01,822: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:11:01.969064785Z [2024-03-28 02:11:01,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:11:02.581121559Z [2024-03-28 02:11:02,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0749cd6e-3b29-4efe-be33-2543eedefcf1] succeeded in 1.3201518400001078s: None 2024-03-28T02:11:03.011549442Z [2024-03-28 02:11:03,010: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:11:03.016664168Z [2024-03-28 02:11:03,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:11:03.037698096Z [2024-03-28 02:11:03,037: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:11:03.039404049Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:11:03.039506760Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:11:03.039658521Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:11:03.039720928Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:11:03.040006731Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:11:03.040077235Z [2024-03-28 02:11:03,039: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:11:03.145421608Z [2024-03-28 02:11:03,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:11:03.216226019Z [2024-03-28 02:11:03,215: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:11:03.220034369Z [2024-03-28 02:11:03,219: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:11:03.257597525Z [2024-03-28 02:11:03,257: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:11:03.260211035Z [2024-03-28 02:11:03,259: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:11:03.260350011Z [2024-03-28 02:11:03,260: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:11:03.260580522Z [2024-03-28 02:11:03,260: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:11:03.260730220Z [2024-03-28 02:11:03,260: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:11:03.261105983Z [2024-03-28 02:11:03,260: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:11:03.261304168Z [2024-03-28 02:11:03,261: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:11:03.365200048Z [2024-03-28 02:11:03,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:11:05.188270601Z [2024-03-28 02:11:05,187: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fc5f4de-8097-455c-a0c0-5934e17b9894] succeeded in 3.9273833299994294s: None 2024-03-28T02:11:05.972800322Z [2024-03-28 02:11:05,972: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d98555e9-190f-4b54-abed-bacc4069ac19] succeeded in 4.707737067999915s: None 2024-03-28T02:12:00.404948770Z [2024-03-28 02:12:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cb7161a-d418-4b59-93e3-6208dd5a0412] received 2024-03-28T02:12:00.413666064Z [2024-03-28 02:12:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb8ea5d4-ba55-44cf-943c-3440f85b4ad6] received 2024-03-28T02:12:00.415840150Z [2024-03-28 02:12:00,415: INFO/ForkPoolWorker-15] [5cb7161a-d418-4b59-93e3-6208dd5a0412] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:12:00.420066299Z [2024-03-28 02:12:00,419: INFO/ForkPoolWorker-16] [cb8ea5d4-ba55-44cf-943c-3440f85b4ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:12:00.421226195Z [2024-03-28 02:12:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0c0f739-d78c-4670-96b4-6dea4c1f7f98] received 2024-03-28T02:12:00.424895170Z [2024-03-28 02:12:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6a0b948-4ce0-4f0c-b2ab-86237bde2c64] received 2024-03-28T02:12:00.440462611Z [2024-03-28 02:12:00,440: INFO/ForkPoolWorker-2] [e6a0b948-4ce0-4f0c-b2ab-86237bde2c64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:12:00.440594863Z [2024-03-28 02:12:00,440: INFO/ForkPoolWorker-1] [e0c0f739-d78c-4670-96b4-6dea4c1f7f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:12:00.746265032Z [2024-03-28 02:12:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:12:00.872967245Z [2024-03-28 02:12:00,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:12:00.874007423Z [2024-03-28 02:12:00,870: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:12:00.956041900Z [2024-03-28 02:12:00,951: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:12:01.123804371Z [2024-03-28 02:12:01,123: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:12:01.176058972Z [2024-03-28 02:12:01,175: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:12:01.180510402Z [2024-03-28 02:12:01,180: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:12:01.215780824Z [2024-03-28 02:12:01,215: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:12:01.218010265Z [2024-03-28 02:12:01,217: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:12:01.220146593Z [2024-03-28 02:12:01,217: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:12:01.220470143Z [2024-03-28 02:12:01,220: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:12:01.220796993Z [2024-03-28 02:12:01,220: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:12:01.367346545Z [2024-03-28 02:12:01,366: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:12:02.023505909Z [2024-03-28 02:12:02,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cb7161a-d418-4b59-93e3-6208dd5a0412] succeeded in 1.6160611039995274s: None 2024-03-28T02:12:02.589602309Z [2024-03-28 02:12:02,589: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:12:02.593372712Z [2024-03-28 02:12:02,592: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:12:02.620323010Z [2024-03-28 02:12:02,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:12:02.622846390Z [2024-03-28 02:12:02,622: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:12:02.622874974Z [2024-03-28 02:12:02,622: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:12:02.623181214Z [2024-03-28 02:12:02,622: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:12:02.623228628Z [2024-03-28 02:12:02,623: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:12:02.623561722Z [2024-03-28 02:12:02,623: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:12:02.623605535Z [2024-03-28 02:12:02,623: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:12:02.647174730Z [2024-03-28 02:12:02,646: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e6a0b948-4ce0-4f0c-b2ab-86237bde2c64] succeeded in 2.2200456199989276s: None 2024-03-28T02:12:02.741190844Z [2024-03-28 02:12:02,740: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:12:02.960363639Z [2024-03-28 02:12:02,959: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:12:02.963915498Z [2024-03-28 02:12:02,963: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:12:02.981173777Z [2024-03-28 02:12:02,980: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:12:02.988986931Z [2024-03-28 02:12:02,988: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:12:02.989138065Z [2024-03-28 02:12:02,988: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:12:02.989403634Z [2024-03-28 02:12:02,989: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:12:02.989574310Z [2024-03-28 02:12:02,989: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:12:02.990002169Z [2024-03-28 02:12:02,989: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:12:02.990039142Z [2024-03-28 02:12:02,989: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:12:03.094610216Z [2024-03-28 02:12:03,094: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:12:04.949125824Z [2024-03-28 02:12:04,948: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0c0f739-d78c-4670-96b4-6dea4c1f7f98] succeeded in 4.525505430001431s: None 2024-03-28T02:12:05.010534046Z [2024-03-28 02:12:05,010: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb8ea5d4-ba55-44cf-943c-3440f85b4ad6] succeeded in 4.595013277999897s: None 2024-03-28T02:13:00.654841819Z [2024-03-28 02:13:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[735e7fdc-b0a5-459a-864a-8d50a5ceba30] received 2024-03-28T02:13:00.658874840Z [2024-03-28 02:13:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab93670-8eaa-40ff-a5aa-c229fbcc6f39] received 2024-03-28T02:13:00.661635978Z [2024-03-28 02:13:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c353439f-5972-4e55-bc18-206c24c564a0] received 2024-03-28T02:13:00.666187041Z [2024-03-28 02:13:00,665: INFO/ForkPoolWorker-15] [735e7fdc-b0a5-459a-864a-8d50a5ceba30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:13:00.674456992Z [2024-03-28 02:13:00,674: INFO/ForkPoolWorker-16] [4ab93670-8eaa-40ff-a5aa-c229fbcc6f39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:13:00.679718921Z [2024-03-28 02:13:00,679: INFO/ForkPoolWorker-1] [c353439f-5972-4e55-bc18-206c24c564a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:13:01.067199939Z [2024-03-28 02:13:01,064: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:13:01.131131893Z [2024-03-28 02:13:01,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:13:01.154279929Z [2024-03-28 02:13:01,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:13:01.296588939Z [2024-03-28 02:13:01,296: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:13:01.301033975Z [2024-03-28 02:13:01,300: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:13:01.322358035Z [2024-03-28 02:13:01,322: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:13:01.324269254Z [2024-03-28 02:13:01,324: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:13:01.324490930Z [2024-03-28 02:13:01,324: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:13:01.324651186Z [2024-03-28 02:13:01,324: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:13:01.324983291Z [2024-03-28 02:13:01,324: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:13:01.429211521Z [2024-03-28 02:13:01,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:13:02.128433515Z [2024-03-28 02:13:02,128: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ab93670-8eaa-40ff-a5aa-c229fbcc6f39] succeeded in 1.4679310499996063s: None 2024-03-28T02:13:02.265125160Z [2024-03-28 02:13:02,264: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:13:02.268924044Z [2024-03-28 02:13:02,268: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:13:02.290509340Z [2024-03-28 02:13:02,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:13:02.292190339Z [2024-03-28 02:13:02,291: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:13:02.292231624Z [2024-03-28 02:13:02,292: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:13:02.292446477Z [2024-03-28 02:13:02,292: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:13:02.292477842Z [2024-03-28 02:13:02,292: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:13:02.292882790Z [2024-03-28 02:13:02,292: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:13:02.292935139Z [2024-03-28 02:13:02,292: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:13:02.382851290Z [2024-03-28 02:13:02,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:13:02.491495639Z [2024-03-28 02:13:02,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:13:02.494896998Z [2024-03-28 02:13:02,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:13:02.521870856Z [2024-03-28 02:13:02,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:13:02.523174028Z [2024-03-28 02:13:02,522: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:13:02.523191763Z [2024-03-28 02:13:02,523: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:13:02.523324485Z [2024-03-28 02:13:02,523: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:13:02.523352032Z [2024-03-28 02:13:02,523: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:13:02.523554292Z [2024-03-28 02:13:02,523: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:13:02.523572120Z [2024-03-28 02:13:02,523: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:13:02.608498782Z [2024-03-28 02:13:02,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:13:03.995377221Z [2024-03-28 02:13:03,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c353439f-5972-4e55-bc18-206c24c564a0] succeeded in 3.3306700399989495s: None 2024-03-28T02:13:05.269868728Z [2024-03-28 02:13:05,269: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[735e7fdc-b0a5-459a-864a-8d50a5ceba30] succeeded in 4.611764504001258s: None 2024-03-28T02:14:01.347690248Z [2024-03-28 02:14:01,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[674d0abc-31aa-4556-9736-2844f12b1f92] received 2024-03-28T02:14:01.353027039Z [2024-03-28 02:14:01,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69d032f5-b7ef-4267-934b-745cbb553f98] received 2024-03-28T02:14:01.360983887Z [2024-03-28 02:14:01,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca4c688a-85eb-4c2e-b90d-149e2394ec42] received 2024-03-28T02:14:01.362518600Z [2024-03-28 02:14:01,362: INFO/ForkPoolWorker-16] [69d032f5-b7ef-4267-934b-745cbb553f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:14:01.366365115Z [2024-03-28 02:14:01,365: INFO/ForkPoolWorker-15] [674d0abc-31aa-4556-9736-2844f12b1f92] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:14:01.368616521Z [2024-03-28 02:14:01,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2dad72f-390a-48ff-bc31-5ced4e72632d] received 2024-03-28T02:14:01.371947244Z [2024-03-28 02:14:01,369: INFO/ForkPoolWorker-1] [ca4c688a-85eb-4c2e-b90d-149e2394ec42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:14:01.379752236Z [2024-03-28 02:14:01,379: INFO/ForkPoolWorker-2] [f2dad72f-390a-48ff-bc31-5ced4e72632d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:14:01.731374839Z [2024-03-28 02:14:01,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:14:01.903714192Z [2024-03-28 02:14:01,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:14:01.916815236Z [2024-03-28 02:14:01,916: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:14:01.921338574Z [2024-03-28 02:14:01,920: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:14:01.954391360Z [2024-03-28 02:14:01,954: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:14:01.956098611Z [2024-03-28 02:14:01,955: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:14:01.956256302Z [2024-03-28 02:14:01,956: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:14:01.956406229Z [2024-03-28 02:14:01,956: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:14:01.956698140Z [2024-03-28 02:14:01,956: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:14:01.996978901Z [2024-03-28 02:14:01,992: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:14:02.032970818Z [2024-03-28 02:14:02,028: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:14:02.089788105Z [2024-03-28 02:14:02,089: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:14:02.534521461Z [2024-03-28 02:14:02,534: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:14:02.876148260Z [2024-03-28 02:14:02,875: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2dad72f-390a-48ff-bc31-5ced4e72632d] succeeded in 1.5020045799992658s: None 2024-03-28T02:14:03.350478462Z [2024-03-28 02:14:03,350: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[674d0abc-31aa-4556-9736-2844f12b1f92] succeeded in 1.9984227109998756s: None 2024-03-28T02:14:03.496019434Z [2024-03-28 02:14:03,493: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:14:03.497660221Z [2024-03-28 02:14:03,497: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:14:03.530798109Z [2024-03-28 02:14:03,530: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:14:03.537629109Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:14:03.537667258Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:14:03.537692668Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:14:03.537699626Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:14:03.537705051Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:14:03.537710075Z [2024-03-28 02:14:03,534: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:14:03.556462080Z [2024-03-28 02:14:03,556: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:14:03.567281220Z [2024-03-28 02:14:03,561: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:14:03.608273489Z [2024-03-28 02:14:03,608: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:14:03.609855083Z [2024-03-28 02:14:03,609: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:14:03.609880472Z [2024-03-28 02:14:03,609: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:14:03.610002798Z [2024-03-28 02:14:03,609: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:14:03.610019653Z [2024-03-28 02:14:03,609: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:14:03.610260315Z [2024-03-28 02:14:03,610: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:14:03.610380988Z [2024-03-28 02:14:03,610: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:14:03.648044272Z [2024-03-28 02:14:03,647: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:14:03.763179946Z [2024-03-28 02:14:03,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:14:05.806537997Z [2024-03-28 02:14:05,805: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca4c688a-85eb-4c2e-b90d-149e2394ec42] succeeded in 4.443011299001228s: None 2024-03-28T02:14:06.211488321Z [2024-03-28 02:14:06,210: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69d032f5-b7ef-4267-934b-745cbb553f98] succeeded in 4.8554508139986865s: None 2024-03-28T02:15:00.264680583Z [2024-03-28 02:15:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f88079aa-89f5-401b-989b-e844b51003d4] received 2024-03-28T02:15:00.273950527Z [2024-03-28 02:15:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3413269d-ec81-4ec8-a833-d9e5b58d597f] received 2024-03-28T02:15:00.274726426Z [2024-03-28 02:15:00,274: INFO/ForkPoolWorker-15] [f88079aa-89f5-401b-989b-e844b51003d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:15:00.275883457Z [2024-03-28 02:15:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37b8501e-05fa-4e66-bda7-8322721db710] received 2024-03-28T02:15:00.287818525Z [2024-03-28 02:15:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c4062c8-34ca-485e-82c2-e539d800e753] received 2024-03-28T02:15:00.287849101Z [2024-03-28 02:15:00,286: INFO/ForkPoolWorker-1] [37b8501e-05fa-4e66-bda7-8322721db710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:15:00.298567084Z [2024-03-28 02:15:00,298: INFO/ForkPoolWorker-16] [3413269d-ec81-4ec8-a833-d9e5b58d597f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:15:00.300383549Z [2024-03-28 02:15:00,300: INFO/ForkPoolWorker-2] [0c4062c8-34ca-485e-82c2-e539d800e753] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:15:00.621652938Z [2024-03-28 02:15:00,616: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:15:00.702395903Z [2024-03-28 02:15:00,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:15:00.727335503Z [2024-03-28 02:15:00,718: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:15:00.839372363Z [2024-03-28 02:15:00,836: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:15:00.923291624Z [2024-03-28 02:15:00,922: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:15:00.927916781Z [2024-03-28 02:15:00,927: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:00.960379127Z [2024-03-28 02:15:00,960: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:15:00.962002777Z [2024-03-28 02:15:00,961: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:15:00.962077464Z [2024-03-28 02:15:00,961: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:15:00.962158149Z [2024-03-28 02:15:00,962: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:15:00.962691818Z [2024-03-28 02:15:00,962: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:15:01.064566970Z [2024-03-28 02:15:01,064: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:01.800635549Z [2024-03-28 02:15:01,800: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c4062c8-34ca-485e-82c2-e539d800e753] succeeded in 1.5109065679989726s: None 2024-03-28T02:15:02.169123495Z [2024-03-28 02:15:02,168: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:15:02.174423452Z [2024-03-28 02:15:02,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:02.228767213Z [2024-03-28 02:15:02,228: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:15:02.231356778Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:02.231393864Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:02.231580219Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:02.231591915Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:15:02.231894918Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:15:02.231933642Z [2024-03-28 02:15:02,231: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:02.247651479Z [2024-03-28 02:15:02,247: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:15:02.251572979Z [2024-03-28 02:15:02,251: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:02.291353180Z [2024-03-28 02:15:02,291: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:15:02.294459482Z [2024-03-28 02:15:02,294: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:02.294802803Z [2024-03-28 02:15:02,294: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:02.295109658Z [2024-03-28 02:15:02,294: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:02.295318510Z [2024-03-28 02:15:02,295: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:15:02.295780997Z [2024-03-28 02:15:02,295: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:15:02.296507801Z [2024-03-28 02:15:02,296: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:02.364850032Z [2024-03-28 02:15:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:02.374961131Z [2024-03-28 02:15:02,374: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:15:02.378899295Z [2024-03-28 02:15:02,378: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:02.414103659Z [2024-03-28 02:15:02,413: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:15:02.415425735Z [2024-03-28 02:15:02,415: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:02.415967704Z [2024-03-28 02:15:02,415: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:02.416081149Z [2024-03-28 02:15:02,415: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:02.416346022Z [2024-03-28 02:15:02,416: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:02.416605618Z [2024-03-28 02:15:02,416: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:15:02.417011498Z [2024-03-28 02:15:02,416: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:15:02.417111617Z [2024-03-28 02:15:02,416: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:02.592097163Z [2024-03-28 02:15:02,591: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:03.146443668Z [2024-03-28 02:15:03,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f88079aa-89f5-401b-989b-e844b51003d4] succeeded in 2.878666283999337s: None 2024-03-28T02:15:03.359685475Z [2024-03-28 02:15:03,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82f71249-36b3-4efb-b632-90f0a0054811] received 2024-03-28T02:15:03.365989424Z [2024-03-28 02:15:03,365: INFO/ForkPoolWorker-15] [82f71249-36b3-4efb-b632-90f0a0054811] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:15:03.806800259Z [2024-03-28 02:15:03,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:15:04.032457540Z [2024-03-28 02:15:04,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3413269d-ec81-4ec8-a833-d9e5b58d597f] succeeded in 3.753669808998893s: None 2024-03-28T02:15:04.657097732Z [2024-03-28 02:15:04,656: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37b8501e-05fa-4e66-bda7-8322721db710] succeeded in 4.379434955999386s: None 2024-03-28T02:15:05.066296035Z [2024-03-28 02:15:05,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:15:05.069784556Z [2024-03-28 02:15:05,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:05.093869357Z [2024-03-28 02:15:05,093: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:15:05.095284693Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:05.095319616Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:05.095495108Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:05.095594816Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:15:05.095933458Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:15:05.096045827Z [2024-03-28 02:15:05,095: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:05.179130771Z [2024-03-28 02:15:05,178: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:05.723073106Z [2024-03-28 02:15:05,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82f71249-36b3-4efb-b632-90f0a0054811] succeeded in 2.362688977998914s: None 2024-03-28T02:15:05.870993257Z [2024-03-28 02:15:05,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[702215c0-34cf-4134-a2fd-9e340885965c] received 2024-03-28T02:15:05.878837175Z [2024-03-28 02:15:05,878: INFO/ForkPoolWorker-15] [702215c0-34cf-4134-a2fd-9e340885965c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:15:06.205402433Z [2024-03-28 02:15:06,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:15:07.351002161Z [2024-03-28 02:15:07,350: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:15:07.354636401Z [2024-03-28 02:15:07,354: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:07.372371151Z [2024-03-28 02:15:07,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:15:07.373722457Z [2024-03-28 02:15:07,373: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:07.373878296Z [2024-03-28 02:15:07,373: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:07.374099763Z [2024-03-28 02:15:07,373: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:07.374155674Z [2024-03-28 02:15:07,374: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:15:07.374452319Z [2024-03-28 02:15:07,374: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:15:07.374584388Z [2024-03-28 02:15:07,374: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:07.464222021Z [2024-03-28 02:15:07,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:08.027434291Z [2024-03-28 02:15:08,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[702215c0-34cf-4134-a2fd-9e340885965c] succeeded in 2.154627731999426s: None 2024-03-28T02:15:08.370540990Z [2024-03-28 02:15:08,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b7de972-2b73-483d-8803-64080225baee] received 2024-03-28T02:15:08.391297684Z [2024-03-28 02:15:08,391: INFO/ForkPoolWorker-15] [7b7de972-2b73-483d-8803-64080225baee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:15:08.753864255Z [2024-03-28 02:15:08,750: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:15:10.075684120Z [2024-03-28 02:15:10,075: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:15:10.079164266Z [2024-03-28 02:15:10,078: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:15:10.114952323Z [2024-03-28 02:15:10,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:15:10.117465632Z [2024-03-28 02:15:10,117: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:15:10.117644133Z [2024-03-28 02:15:10,117: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:15:10.117899133Z [2024-03-28 02:15:10,117: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:15:10.118028923Z [2024-03-28 02:15:10,117: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:15:10.118400669Z [2024-03-28 02:15:10,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:15:10.118505254Z [2024-03-28 02:15:10,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:15:10.215170627Z [2024-03-28 02:15:10,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:15:10.837615767Z [2024-03-28 02:15:10,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b7de972-2b73-483d-8803-64080225baee] succeeded in 2.464210758000263s: None 2024-03-28T02:16:00.314685063Z [2024-03-28 02:16:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9d3cfb6-bb54-4a5a-8fe5-b9bea296fe06] received 2024-03-28T02:16:00.316401847Z [2024-03-28 02:16:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4638859-81c4-4f01-a573-df03483e734d] received 2024-03-28T02:16:00.337698142Z [2024-03-28 02:16:00,335: INFO/ForkPoolWorker-15] [c9d3cfb6-bb54-4a5a-8fe5-b9bea296fe06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:16:00.351064769Z [2024-03-28 02:16:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12fe2fe5-47a5-4593-8854-4ff3154b8b65] received 2024-03-28T02:16:00.365383044Z [2024-03-28 02:16:00,364: INFO/ForkPoolWorker-1] [12fe2fe5-47a5-4593-8854-4ff3154b8b65] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:16:00.372128501Z [2024-03-28 02:16:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d8c3ba6-ba13-4bbb-b43e-c5c9cdbdc530] received 2024-03-28T02:16:00.372872755Z [2024-03-28 02:16:00,372: INFO/ForkPoolWorker-16] [a4638859-81c4-4f01-a573-df03483e734d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:16:00.383451554Z [2024-03-28 02:16:00,383: INFO/ForkPoolWorker-2] [0d8c3ba6-ba13-4bbb-b43e-c5c9cdbdc530] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:16:00.779008186Z [2024-03-28 02:16:00,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:16:00.953421030Z [2024-03-28 02:16:00,950: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:16:00.978927875Z [2024-03-28 02:16:00,975: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:16:01.009116747Z [2024-03-28 02:16:01,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:16:01.235470010Z [2024-03-28 02:16:01,235: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:16:01.262606141Z [2024-03-28 02:16:01,262: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:16:01.291450289Z [2024-03-28 02:16:01,291: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:16:01.334470855Z [2024-03-28 02:16:01,334: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:16:01.338541942Z [2024-03-28 02:16:01,338: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:16:01.338691953Z [2024-03-28 02:16:01,338: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:16:01.338832807Z [2024-03-28 02:16:01,338: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:16:01.339368952Z [2024-03-28 02:16:01,339: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:16:01.481154092Z [2024-03-28 02:16:01,480: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:16:02.230375977Z [2024-03-28 02:16:02,229: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12fe2fe5-47a5-4593-8854-4ff3154b8b65] succeeded in 1.87537990599958s: None 2024-03-28T02:16:02.414848517Z [2024-03-28 02:16:02,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4638859-81c4-4f01-a573-df03483e734d] succeeded in 2.067754450999928s: None 2024-03-28T02:16:02.732790331Z [2024-03-28 02:16:02,732: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:16:02.736391337Z [2024-03-28 02:16:02,735: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:16:02.768032965Z [2024-03-28 02:16:02,767: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:16:02.770459031Z [2024-03-28 02:16:02,770: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:16:02.770539713Z [2024-03-28 02:16:02,770: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:16:02.770863569Z [2024-03-28 02:16:02,770: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:16:02.770936862Z [2024-03-28 02:16:02,770: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:16:02.772389792Z [2024-03-28 02:16:02,772: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:16:02.772480692Z [2024-03-28 02:16:02,772: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:16:02.886291857Z [2024-03-28 02:16:02,885: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:16:02.984494692Z [2024-03-28 02:16:02,983: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:16:02.989720965Z [2024-03-28 02:16:02,989: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:16:03.034228354Z [2024-03-28 02:16:03,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:16:03.046634442Z [2024-03-28 02:16:03,046: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:16:03.046857166Z [2024-03-28 02:16:03,046: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:16:03.047135039Z [2024-03-28 02:16:03,046: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:16:03.047396834Z [2024-03-28 02:16:03,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:16:03.051696720Z [2024-03-28 02:16:03,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:16:03.052023116Z [2024-03-28 02:16:03,051: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:16:03.205278440Z [2024-03-28 02:16:03,204: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:16:04.827280265Z [2024-03-28 02:16:04,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9d3cfb6-bb54-4a5a-8fe5-b9bea296fe06] succeeded in 4.509408484998858s: None 2024-03-28T02:16:05.042594166Z [2024-03-28 02:16:05,042: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0d8c3ba6-ba13-4bbb-b43e-c5c9cdbdc530] succeeded in 4.6685563049995835s: None 2024-03-28T02:17:01.099065628Z [2024-03-28 02:17:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3611dac1-326c-4d8e-b515-6e85a7ffbec2] received 2024-03-28T02:17:01.115558301Z [2024-03-28 02:17:01,115: INFO/ForkPoolWorker-15] [3611dac1-326c-4d8e-b515-6e85a7ffbec2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:17:01.123076613Z [2024-03-28 02:17:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06709b9d-8b98-42b1-9671-1e25c37faf39] received 2024-03-28T02:17:01.130065667Z [2024-03-28 02:17:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a7928b5-9e20-40d0-9cd2-9a0c12d23f42] received 2024-03-28T02:17:01.130273166Z [2024-03-28 02:17:01,130: INFO/ForkPoolWorker-16] [06709b9d-8b98-42b1-9671-1e25c37faf39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:17:01.142301378Z [2024-03-28 02:17:01,142: INFO/ForkPoolWorker-1] [7a7928b5-9e20-40d0-9cd2-9a0c12d23f42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:17:01.470228972Z [2024-03-28 02:17:01,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:17:01.490266163Z [2024-03-28 02:17:01,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:17:01.506511057Z [2024-03-28 02:17:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:17:01.669056414Z [2024-03-28 02:17:01,668: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:17:01.673558329Z [2024-03-28 02:17:01,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:17:01.709582156Z [2024-03-28 02:17:01,709: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:17:01.713308805Z [2024-03-28 02:17:01,712: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:17:01.715797493Z [2024-03-28 02:17:01,715: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:17:01.715830242Z [2024-03-28 02:17:01,715: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:17:01.716132811Z [2024-03-28 02:17:01,715: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:17:01.854323933Z [2024-03-28 02:17:01,853: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:17:02.498856359Z [2024-03-28 02:17:02,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[06709b9d-8b98-42b1-9671-1e25c37faf39] succeeded in 1.3742687190006109s: None 2024-03-28T02:17:02.876602358Z [2024-03-28 02:17:02,876: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:17:02.880067058Z [2024-03-28 02:17:02,879: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:17:02.907477680Z [2024-03-28 02:17:02,907: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:17:02.910537361Z [2024-03-28 02:17:02,910: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:17:02.910562828Z [2024-03-28 02:17:02,910: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:17:02.911345475Z [2024-03-28 02:17:02,910: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:17:02.911519032Z [2024-03-28 02:17:02,911: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:17:02.911892646Z [2024-03-28 02:17:02,911: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:17:02.911905713Z [2024-03-28 02:17:02,911: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:17:02.921071366Z [2024-03-28 02:17:02,920: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:17:02.924615696Z [2024-03-28 02:17:02,924: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:17:02.963386750Z [2024-03-28 02:17:02,963: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:17:02.967364002Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:17:02.967458086Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:17:02.967485016Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:17:02.967497562Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:17:02.967799028Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:17:02.967860859Z [2024-03-28 02:17:02,967: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:17:03.052920952Z [2024-03-28 02:17:03,052: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:17:03.076542587Z [2024-03-28 02:17:03,076: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:17:04.639461372Z [2024-03-28 02:17:04,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a7928b5-9e20-40d0-9cd2-9a0c12d23f42] succeeded in 3.507724111999778s: None 2024-03-28T02:17:04.911198802Z [2024-03-28 02:17:04,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3611dac1-326c-4d8e-b515-6e85a7ffbec2] succeeded in 3.809926625001026s: None 2024-03-28T02:18:00.968491592Z [2024-03-28 02:18:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71ffb201-77f5-4f1f-b6aa-7ca8834fdcb3] received 2024-03-28T02:18:00.975227512Z [2024-03-28 02:18:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46661b2c-2c2e-4d42-975d-e8268601f423] received 2024-03-28T02:18:00.978421865Z [2024-03-28 02:18:00,978: INFO/ForkPoolWorker-15] [71ffb201-77f5-4f1f-b6aa-7ca8834fdcb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:18:00.979464798Z [2024-03-28 02:18:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59260d6e-14cb-4ad3-8aa9-ded1dc97e0a7] received 2024-03-28T02:18:00.981621079Z [2024-03-28 02:18:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfba22b4-2113-4d4f-934f-0e5440f81ff6] received 2024-03-28T02:18:00.983293176Z [2024-03-28 02:18:00,983: INFO/ForkPoolWorker-16] [46661b2c-2c2e-4d42-975d-e8268601f423] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:18:01.000096598Z [2024-03-28 02:18:00,999: INFO/ForkPoolWorker-1] [59260d6e-14cb-4ad3-8aa9-ded1dc97e0a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:18:01.006028269Z [2024-03-28 02:18:01,003: INFO/ForkPoolWorker-2] [bfba22b4-2113-4d4f-934f-0e5440f81ff6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:18:01.300618303Z [2024-03-28 02:18:01,296: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:18:01.323777067Z [2024-03-28 02:18:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:18:01.461622239Z [2024-03-28 02:18:01,454: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:18:01.535898433Z [2024-03-28 02:18:01,532: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:18:01.715053868Z [2024-03-28 02:18:01,714: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:18:01.722211264Z [2024-03-28 02:18:01,721: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:18:01.763076195Z [2024-03-28 02:18:01,762: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:18:01.764703542Z [2024-03-28 02:18:01,764: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:18:01.764884232Z [2024-03-28 02:18:01,764: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:18:01.765024410Z [2024-03-28 02:18:01,764: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:18:01.765701968Z [2024-03-28 02:18:01,765: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:18:01.840404118Z [2024-03-28 02:18:01,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:18:01.924570666Z [2024-03-28 02:18:01,924: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:18:02.482296905Z [2024-03-28 02:18:02,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71ffb201-77f5-4f1f-b6aa-7ca8834fdcb3] succeeded in 1.512150857000961s: None 2024-03-28T02:18:02.648615120Z [2024-03-28 02:18:02,648: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bfba22b4-2113-4d4f-934f-0e5440f81ff6] succeeded in 1.6639700969990372s: None 2024-03-28T02:18:02.936169973Z [2024-03-28 02:18:02,935: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:18:02.939863365Z [2024-03-28 02:18:02,939: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:18:02.950561310Z [2024-03-28 02:18:02,950: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:18:02.954252295Z [2024-03-28 02:18:02,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:18:02.959279916Z [2024-03-28 02:18:02,959: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:18:02.961075830Z [2024-03-28 02:18:02,960: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:18:02.961099392Z [2024-03-28 02:18:02,960: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:18:02.961105970Z [2024-03-28 02:18:02,960: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:18:02.961113642Z [2024-03-28 02:18:02,960: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:18:02.961304057Z [2024-03-28 02:18:02,961: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:18:02.961343556Z [2024-03-28 02:18:02,961: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:18:02.979506933Z [2024-03-28 02:18:02,979: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:18:02.980926060Z [2024-03-28 02:18:02,980: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:18:02.980950272Z [2024-03-28 02:18:02,980: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:18:02.981179341Z [2024-03-28 02:18:02,981: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:18:02.981253159Z [2024-03-28 02:18:02,981: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:18:02.981652957Z [2024-03-28 02:18:02,981: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:18:02.981870979Z [2024-03-28 02:18:02,981: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:18:03.044067312Z [2024-03-28 02:18:03,043: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:18:03.077989859Z [2024-03-28 02:18:03,077: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:18:04.703881616Z [2024-03-28 02:18:04,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59260d6e-14cb-4ad3-8aa9-ded1dc97e0a7] succeeded in 3.7210808959989663s: None 2024-03-28T02:18:05.034303940Z [2024-03-28 02:18:05,033: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46661b2c-2c2e-4d42-975d-e8268601f423] succeeded in 4.057320566000271s: None 2024-03-28T02:19:00.652371289Z [2024-03-28 02:19:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7125320-cb43-43a5-aed9-4ca61da1755a] received 2024-03-28T02:19:00.656948471Z [2024-03-28 02:19:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[674bace3-1a5d-43cf-8094-f8ae9074ceb2] received 2024-03-28T02:19:00.659943744Z [2024-03-28 02:19:00,659: INFO/ForkPoolWorker-15] [f7125320-cb43-43a5-aed9-4ca61da1755a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:19:00.667670170Z [2024-03-28 02:19:00,667: INFO/ForkPoolWorker-16] [674bace3-1a5d-43cf-8094-f8ae9074ceb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:19:00.669438046Z [2024-03-28 02:19:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8980755c-557a-4b7e-b898-4432981b362e] received 2024-03-28T02:19:00.683351929Z [2024-03-28 02:19:00,683: INFO/ForkPoolWorker-1] [8980755c-557a-4b7e-b898-4432981b362e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:19:00.957700023Z [2024-03-28 02:19:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:19:00.971640786Z [2024-03-28 02:19:00,966: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:19:00.974543558Z [2024-03-28 02:19:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:19:01.127850608Z [2024-03-28 02:19:01,127: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:19:01.132065609Z [2024-03-28 02:19:01,131: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:19:01.160553262Z [2024-03-28 02:19:01,160: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:19:01.162754701Z [2024-03-28 02:19:01,162: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:19:01.163045821Z [2024-03-28 02:19:01,162: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:19:01.163271967Z [2024-03-28 02:19:01,163: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:19:01.163729750Z [2024-03-28 02:19:01,163: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:19:01.250244632Z [2024-03-28 02:19:01,249: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:19:01.932997338Z [2024-03-28 02:19:01,932: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[674bace3-1a5d-43cf-8094-f8ae9074ceb2] succeeded in 1.272021329999916s: None 2024-03-28T02:19:02.152952133Z [2024-03-28 02:19:02,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:19:02.156537793Z [2024-03-28 02:19:02,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:19:02.181036974Z [2024-03-28 02:19:02,180: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:19:02.182681222Z [2024-03-28 02:19:02,182: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:19:02.182842473Z [2024-03-28 02:19:02,182: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:19:02.183060734Z [2024-03-28 02:19:02,182: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:19:02.183088904Z [2024-03-28 02:19:02,182: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:19:02.183515874Z [2024-03-28 02:19:02,183: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:19:02.183623533Z [2024-03-28 02:19:02,183: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:19:02.273397040Z [2024-03-28 02:19:02,273: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:19:02.278052719Z [2024-03-28 02:19:02,277: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:19:02.318296658Z [2024-03-28 02:19:02,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:19:02.331616660Z [2024-03-28 02:19:02,331: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:19:02.332101585Z [2024-03-28 02:19:02,331: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:19:02.332530102Z [2024-03-28 02:19:02,332: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:19:02.332767010Z [2024-03-28 02:19:02,332: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:19:02.333331698Z [2024-03-28 02:19:02,333: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:19:02.333637720Z [2024-03-28 02:19:02,333: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:19:02.350670087Z [2024-03-28 02:19:02,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:19:02.420862139Z [2024-03-28 02:19:02,420: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:19:04.638994750Z [2024-03-28 02:19:04,638: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8980755c-557a-4b7e-b898-4432981b362e] succeeded in 3.9670106149987987s: None 2024-03-28T02:19:04.743813196Z [2024-03-28 02:19:04,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7125320-cb43-43a5-aed9-4ca61da1755a] succeeded in 4.089751327001068s: None 2024-03-28T02:20:00.415745568Z [2024-03-28 02:20:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db57fd1d-1b62-44b3-b305-c7e84f092560] received 2024-03-28T02:20:00.422450726Z [2024-03-28 02:20:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[606669c2-3989-4372-b4d2-4740c864f5cc] received 2024-03-28T02:20:00.424485803Z [2024-03-28 02:20:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d8e29ee-bc0d-4a1f-ae5a-67838c6796dc] received 2024-03-28T02:20:00.427542366Z [2024-03-28 02:20:00,427: INFO/ForkPoolWorker-15] [db57fd1d-1b62-44b3-b305-c7e84f092560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:20:00.431860111Z [2024-03-28 02:20:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b73abb51-75e8-4f38-bbfa-f4a34da7c1f4] received 2024-03-28T02:20:00.437492373Z [2024-03-28 02:20:00,437: INFO/ForkPoolWorker-16] [606669c2-3989-4372-b4d2-4740c864f5cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:20:00.441403157Z [2024-03-28 02:20:00,441: INFO/ForkPoolWorker-2] [b73abb51-75e8-4f38-bbfa-f4a34da7c1f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:20:00.442821094Z [2024-03-28 02:20:00,442: INFO/ForkPoolWorker-1] [6d8e29ee-bc0d-4a1f-ae5a-67838c6796dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:20:00.449410331Z [2024-03-28 02:20:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cbd9227-aea9-4d7e-acc6-4388eb0c8bd6] received 2024-03-28T02:20:00.477580995Z [2024-03-28 02:20:00,477: INFO/ForkPoolWorker-3] [5cbd9227-aea9-4d7e-acc6-4388eb0c8bd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:20:00.772936722Z [2024-03-28 02:20:00,769: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:20:00.885065864Z [2024-03-28 02:20:00,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:20:00.892385657Z [2024-03-28 02:20:00,888: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:20:00.932810392Z [2024-03-28 02:20:00,929: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:20:01.066944331Z [2024-03-28 02:20:01,066: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:20:01.072361171Z [2024-03-28 02:20:01,071: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:01.102616153Z [2024-03-28 02:20:01,102: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:20:01.105356557Z [2024-03-28 02:20:01,105: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:20:01.105722820Z [2024-03-28 02:20:01,105: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:20:01.105943023Z [2024-03-28 02:20:01,105: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:20:01.106541006Z [2024-03-28 02:20:01,106: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:20:01.164249316Z [2024-03-28 02:20:01,150: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:20:01.244949683Z [2024-03-28 02:20:01,244: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:01.576978469Z [2024-03-28 02:20:01,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:02.371273748Z [2024-03-28 02:20:02,370: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d8e29ee-bc0d-4a1f-ae5a-67838c6796dc] succeeded in 1.9418229040002188s: None 2024-03-28T02:20:02.671760332Z [2024-03-28 02:20:02,671: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[606669c2-3989-4372-b4d2-4740c864f5cc] succeeded in 2.2445723979999457s: None 2024-03-28T02:20:03.097440429Z [2024-03-28 02:20:03,097: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:20:03.103280812Z [2024-03-28 02:20:03,102: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:03.110160763Z [2024-03-28 02:20:03,109: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T02:20:03.131061525Z [2024-03-28 02:20:03,128: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:03.161820937Z [2024-03-28 02:20:03,161: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:20:03.170287620Z [2024-03-28 02:20:03,169: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:03.170327868Z [2024-03-28 02:20:03,169: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:03.172668028Z [2024-03-28 02:20:03,170: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:03.172701426Z [2024-03-28 02:20:03,171: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:20:03.172706184Z [2024-03-28 02:20:03,172: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:20:03.172709646Z [2024-03-28 02:20:03,172: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:03.267539619Z [2024-03-28 02:20:03,267: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:20:03.275805838Z [2024-03-28 02:20:03,275: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:03.275969695Z [2024-03-28 02:20:03,275: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:03.276228854Z [2024-03-28 02:20:03,275: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:03.276473440Z [2024-03-28 02:20:03,276: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T02:20:03.276985162Z [2024-03-28 02:20:03,276: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:20:03.277666072Z [2024-03-28 02:20:03,276: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:03.341464929Z [2024-03-28 02:20:03,341: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:03.516857672Z [2024-03-28 02:20:03,516: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:03.696212718Z [2024-03-28 02:20:03,695: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:20:03.706430406Z [2024-03-28 02:20:03,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:03.758500010Z [2024-03-28 02:20:03,758: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:20:03.762382218Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:03.762411857Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:03.762506693Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:03.762533366Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:20:03.762815189Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:20:03.762829054Z [2024-03-28 02:20:03,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:03.878355156Z [2024-03-28 02:20:03,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:04.526956070Z [2024-03-28 02:20:04,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db57fd1d-1b62-44b3-b305-c7e84f092560] succeeded in 4.10875353800111s: None 2024-03-28T02:20:05.312772977Z [2024-03-28 02:20:05,311: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5cbd9227-aea9-4d7e-acc6-4388eb0c8bd6] succeeded in 4.8595046999998885s: None 2024-03-28T02:20:05.562128255Z [2024-03-28 02:20:05,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa37e077-e1ba-4cea-b4ac-733ad1067e13] received 2024-03-28T02:20:05.570962551Z [2024-03-28 02:20:05,570: INFO/ForkPoolWorker-15] [aa37e077-e1ba-4cea-b4ac-733ad1067e13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:20:05.899464378Z [2024-03-28 02:20:05,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:20:06.031847093Z [2024-03-28 02:20:06,031: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b73abb51-75e8-4f38-bbfa-f4a34da7c1f4] succeeded in 5.597764014999484s: None 2024-03-28T02:20:07.032294269Z [2024-03-28 02:20:07,031: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:20:07.035553680Z [2024-03-28 02:20:07,035: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:07.053133453Z [2024-03-28 02:20:07,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:20:07.054457193Z [2024-03-28 02:20:07,054: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:07.054482045Z [2024-03-28 02:20:07,054: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:07.054707367Z [2024-03-28 02:20:07,054: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:07.054766919Z [2024-03-28 02:20:07,054: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:20:07.055184058Z [2024-03-28 02:20:07,054: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:20:07.055279465Z [2024-03-28 02:20:07,055: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:07.167738784Z [2024-03-28 02:20:07,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:07.754281402Z [2024-03-28 02:20:07,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa37e077-e1ba-4cea-b4ac-733ad1067e13] succeeded in 2.1904954580004414s: None 2024-03-28T02:20:08.562285544Z [2024-03-28 02:20:08,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d492e53-7d6a-4259-93e0-0b17ca17c760] received 2024-03-28T02:20:08.580762069Z [2024-03-28 02:20:08,580: INFO/ForkPoolWorker-15] [0d492e53-7d6a-4259-93e0-0b17ca17c760] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:20:08.995617642Z [2024-03-28 02:20:08,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:20:10.255987771Z [2024-03-28 02:20:10,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:20:10.259532618Z [2024-03-28 02:20:10,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:10.282646740Z [2024-03-28 02:20:10,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:20:10.284098095Z [2024-03-28 02:20:10,283: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:10.284308530Z [2024-03-28 02:20:10,284: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:10.284535054Z [2024-03-28 02:20:10,284: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:10.284702153Z [2024-03-28 02:20:10,284: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:20:10.285037504Z [2024-03-28 02:20:10,284: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:20:10.285218757Z [2024-03-28 02:20:10,285: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:10.389626557Z [2024-03-28 02:20:10,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:11.070247248Z [2024-03-28 02:20:11,069: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d492e53-7d6a-4259-93e0-0b17ca17c760] succeeded in 2.5052337710003485s: None 2024-03-28T02:20:11.075537965Z [2024-03-28 02:20:11,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae637fc6-45ea-4c81-8e9c-73bd581be780] received 2024-03-28T02:20:11.083830482Z [2024-03-28 02:20:11,083: INFO/ForkPoolWorker-15] [ae637fc6-45ea-4c81-8e9c-73bd581be780] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:20:11.389029160Z [2024-03-28 02:20:11,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:20:12.645775678Z [2024-03-28 02:20:12,645: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:20:12.649268288Z [2024-03-28 02:20:12,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:20:12.673695910Z [2024-03-28 02:20:12,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:20:12.675625815Z [2024-03-28 02:20:12,675: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:20:12.675804355Z [2024-03-28 02:20:12,675: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:20:12.676019454Z [2024-03-28 02:20:12,675: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:20:12.676133007Z [2024-03-28 02:20:12,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:20:12.676472973Z [2024-03-28 02:20:12,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:20:12.676645239Z [2024-03-28 02:20:12,676: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:20:12.765312552Z [2024-03-28 02:20:12,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:20:13.456144636Z [2024-03-28 02:20:13,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae637fc6-45ea-4c81-8e9c-73bd581be780] succeeded in 2.3782425669996883s: None 2024-03-28T02:21:00.300578167Z [2024-03-28 02:21:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa4a59d-1cdd-4a38-af1d-c71de35d0d42] received 2024-03-28T02:21:00.304366010Z [2024-03-28 02:21:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcad1862-f369-42e7-9c6b-5fe55a0139f5] received 2024-03-28T02:21:00.308707505Z [2024-03-28 02:21:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f2f438-790d-41e6-9cee-64eb83dd85c0] received 2024-03-28T02:21:00.310855858Z [2024-03-28 02:21:00,310: INFO/ForkPoolWorker-15] [8fa4a59d-1cdd-4a38-af1d-c71de35d0d42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:21:00.313001760Z [2024-03-28 02:21:00,312: INFO/ForkPoolWorker-16] [fcad1862-f369-42e7-9c6b-5fe55a0139f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:21:00.323264785Z [2024-03-28 02:21:00,322: INFO/ForkPoolWorker-1] [75f2f438-790d-41e6-9cee-64eb83dd85c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:21:00.607814683Z [2024-03-28 02:21:00,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:21:00.637274235Z [2024-03-28 02:21:00,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:21:00.651956167Z [2024-03-28 02:21:00,648: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:21:00.802385653Z [2024-03-28 02:21:00,801: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:21:00.806209556Z [2024-03-28 02:21:00,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:21:00.826691285Z [2024-03-28 02:21:00,826: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:21:00.827711483Z [2024-03-28 02:21:00,827: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:21:00.827836630Z [2024-03-28 02:21:00,827: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:21:00.827893613Z [2024-03-28 02:21:00,827: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:21:00.828122201Z [2024-03-28 02:21:00,828: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:21:00.914875651Z [2024-03-28 02:21:00,914: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:21:01.472765730Z [2024-03-28 02:21:01,472: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcad1862-f369-42e7-9c6b-5fe55a0139f5] succeeded in 1.1666323499994178s: None 2024-03-28T02:21:01.870623636Z [2024-03-28 02:21:01,870: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:21:01.874182893Z [2024-03-28 02:21:01,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:21:01.897961524Z [2024-03-28 02:21:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:21:01.899509722Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:21:01.899534455Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:21:01.899678232Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:21:01.899724498Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:21:01.900005414Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:21:01.900047311Z [2024-03-28 02:21:01,899: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:21:01.904204486Z [2024-03-28 02:21:01,903: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:21:01.908045736Z [2024-03-28 02:21:01,907: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:21:01.935426732Z [2024-03-28 02:21:01,935: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:21:01.937152176Z [2024-03-28 02:21:01,936: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:21:01.937323968Z [2024-03-28 02:21:01,937: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:21:01.937678601Z [2024-03-28 02:21:01,937: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:21:01.937886207Z [2024-03-28 02:21:01,937: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:21:01.938290427Z [2024-03-28 02:21:01,938: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:21:01.938492424Z [2024-03-28 02:21:01,938: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:21:01.995840256Z [2024-03-28 02:21:01,995: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:21:02.021580602Z [2024-03-28 02:21:02,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:21:03.719675688Z [2024-03-28 02:21:03,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75f2f438-790d-41e6-9cee-64eb83dd85c0] succeeded in 3.4089808050011925s: None 2024-03-28T02:21:04.209434968Z [2024-03-28 02:21:04,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fa4a59d-1cdd-4a38-af1d-c71de35d0d42] succeeded in 3.9075108649994945s: None 2024-03-28T02:22:01.260653359Z [2024-03-28 02:22:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc9bb39b-8678-4e1a-a8f5-ba860dc512a3] received 2024-03-28T02:22:01.264791211Z [2024-03-28 02:22:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cee3938-7233-4eac-9694-2f4f645a40c5] received 2024-03-28T02:22:01.267046426Z [2024-03-28 02:22:01,266: INFO/ForkPoolWorker-15] [dc9bb39b-8678-4e1a-a8f5-ba860dc512a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:22:01.267953388Z [2024-03-28 02:22:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67f14d79-e7fb-4b34-88d0-6c8bcb1fb269] received 2024-03-28T02:22:01.273370283Z [2024-03-28 02:22:01,273: INFO/ForkPoolWorker-16] [4cee3938-7233-4eac-9694-2f4f645a40c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:22:01.274998152Z [2024-03-28 02:22:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21d5a6ac-2109-4f9d-b2de-3a672ddae1c0] received 2024-03-28T02:22:01.291835969Z [2024-03-28 02:22:01,291: INFO/ForkPoolWorker-1] [67f14d79-e7fb-4b34-88d0-6c8bcb1fb269] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:22:01.292667829Z [2024-03-28 02:22:01,292: INFO/ForkPoolWorker-2] [21d5a6ac-2109-4f9d-b2de-3a672ddae1c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:22:01.661153574Z [2024-03-28 02:22:01,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:22:01.780334678Z [2024-03-28 02:22:01,776: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:22:01.820233668Z [2024-03-28 02:22:01,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:22:01.960727042Z [2024-03-28 02:22:01,951: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:22:02.186395913Z [2024-03-28 02:22:02,186: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:22:02.305471759Z [2024-03-28 02:22:02,305: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:22:02.310600277Z [2024-03-28 02:22:02,310: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:22:02.366613815Z [2024-03-28 02:22:02,366: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:22:02.370511131Z [2024-03-28 02:22:02,370: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:22:02.370618777Z [2024-03-28 02:22:02,370: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:22:02.370639589Z [2024-03-28 02:22:02,370: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:22:02.370996075Z [2024-03-28 02:22:02,370: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:22:02.492634496Z [2024-03-28 02:22:02,492: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:22:03.105432929Z [2024-03-28 02:22:03,104: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cee3938-7233-4eac-9694-2f4f645a40c5] succeeded in 1.8388477039989084s: None 2024-03-28T02:22:03.341776782Z [2024-03-28 02:22:03,341: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67f14d79-e7fb-4b34-88d0-6c8bcb1fb269] succeeded in 2.0716893120006716s: None 2024-03-28T02:22:03.554362450Z [2024-03-28 02:22:03,553: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:22:03.559252068Z [2024-03-28 02:22:03,558: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:22:03.587953326Z [2024-03-28 02:22:03,587: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:22:03.589757998Z [2024-03-28 02:22:03,589: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:22:03.589805409Z [2024-03-28 02:22:03,589: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:22:03.589975627Z [2024-03-28 02:22:03,589: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:22:03.590046066Z [2024-03-28 02:22:03,589: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:22:03.590719981Z [2024-03-28 02:22:03,590: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:22:03.590730767Z [2024-03-28 02:22:03,590: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:22:03.650945562Z [2024-03-28 02:22:03,650: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:22:03.654491940Z [2024-03-28 02:22:03,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:22:03.685197757Z [2024-03-28 02:22:03,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:22:03.686789863Z [2024-03-28 02:22:03,686: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:22:03.686825503Z [2024-03-28 02:22:03,686: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:22:03.686880800Z [2024-03-28 02:22:03,686: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:22:03.686930971Z [2024-03-28 02:22:03,686: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:22:03.687246352Z [2024-03-28 02:22:03,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:22:03.687272851Z [2024-03-28 02:22:03,687: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:22:03.701139738Z [2024-03-28 02:22:03,700: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:22:03.785996635Z [2024-03-28 02:22:03,785: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:22:05.873082362Z [2024-03-28 02:22:05,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc9bb39b-8678-4e1a-a8f5-ba860dc512a3] succeeded in 4.608650571000908s: None 2024-03-28T02:22:05.905163106Z [2024-03-28 02:22:05,904: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[21d5a6ac-2109-4f9d-b2de-3a672ddae1c0] succeeded in 4.623834013000305s: None 2024-03-28T02:23:01.030112201Z [2024-03-28 02:23:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df1026f8-9e58-43f2-b81e-721f63393f27] received 2024-03-28T02:23:01.035668145Z [2024-03-28 02:23:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4f49a0d-f85f-4b0c-a960-f83e45a0ba9b] received 2024-03-28T02:23:01.041229348Z [2024-03-28 02:23:01,040: INFO/ForkPoolWorker-15] [df1026f8-9e58-43f2-b81e-721f63393f27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:23:01.042906518Z [2024-03-28 02:23:01,042: INFO/ForkPoolWorker-16] [a4f49a0d-f85f-4b0c-a960-f83e45a0ba9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:23:01.050316361Z [2024-03-28 02:23:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67266b67-537a-4f2d-b981-8e77001b0472] received 2024-03-28T02:23:01.056141682Z [2024-03-28 02:23:01,055: INFO/ForkPoolWorker-1] [67266b67-537a-4f2d-b981-8e77001b0472] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:23:01.386621322Z [2024-03-28 02:23:01,382: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:23:01.391973952Z [2024-03-28 02:23:01,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:23:01.395490975Z [2024-03-28 02:23:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:23:01.548893257Z [2024-03-28 02:23:01,548: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:23:01.553057918Z [2024-03-28 02:23:01,552: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:23:01.577841835Z [2024-03-28 02:23:01,577: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:23:01.579024319Z [2024-03-28 02:23:01,578: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:23:01.579224549Z [2024-03-28 02:23:01,578: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:23:01.579258921Z [2024-03-28 02:23:01,579: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:23:01.579527335Z [2024-03-28 02:23:01,579: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:23:01.683158575Z [2024-03-28 02:23:01,682: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:23:02.298216438Z [2024-03-28 02:23:02,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67266b67-537a-4f2d-b981-8e77001b0472] succeeded in 1.2462515539991728s: None 2024-03-28T02:23:02.639830497Z [2024-03-28 02:23:02,639: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:23:02.643534690Z [2024-03-28 02:23:02,643: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:23:02.665410827Z [2024-03-28 02:23:02,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:23:02.668074311Z [2024-03-28 02:23:02,667: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:23:02.668244837Z [2024-03-28 02:23:02,667: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:23:02.668500568Z [2024-03-28 02:23:02,668: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:23:02.668646748Z [2024-03-28 02:23:02,668: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:23:02.669049091Z [2024-03-28 02:23:02,668: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:23:02.669160945Z [2024-03-28 02:23:02,669: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:23:02.692117207Z [2024-03-28 02:23:02,691: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:23:02.697786613Z [2024-03-28 02:23:02,697: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:23:02.718123559Z [2024-03-28 02:23:02,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:23:02.720229288Z [2024-03-28 02:23:02,719: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:23:02.720404384Z [2024-03-28 02:23:02,720: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:23:02.720680563Z [2024-03-28 02:23:02,720: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:23:02.720828881Z [2024-03-28 02:23:02,720: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:23:02.721284453Z [2024-03-28 02:23:02,721: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:23:02.721403455Z [2024-03-28 02:23:02,721: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:23:02.754099827Z [2024-03-28 02:23:02,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:23:02.811916249Z [2024-03-28 02:23:02,811: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:23:04.372573389Z [2024-03-28 02:23:04,372: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4f49a0d-f85f-4b0c-a960-f83e45a0ba9b] succeeded in 3.335102712999287s: None 2024-03-28T02:23:04.864579821Z [2024-03-28 02:23:04,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df1026f8-9e58-43f2-b81e-721f63393f27] succeeded in 3.832443503999457s: None 2024-03-28T02:24:00.806838705Z [2024-03-28 02:24:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca36b484-0095-4e87-b883-c9209cd82d93] received 2024-03-28T02:24:00.808659145Z [2024-03-28 02:24:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ddafed3-8370-44fa-9116-de11273b291d] received 2024-03-28T02:24:00.814056156Z [2024-03-28 02:24:00,813: INFO/ForkPoolWorker-15] [ca36b484-0095-4e87-b883-c9209cd82d93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:24:00.814651827Z [2024-03-28 02:24:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4cbe911-75ad-4ec5-8cd8-4b33886c3df8] received 2024-03-28T02:24:00.815021815Z [2024-03-28 02:24:00,814: INFO/ForkPoolWorker-16] [0ddafed3-8370-44fa-9116-de11273b291d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:24:00.820805490Z [2024-03-28 02:24:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cf97b6b-360a-4bdd-801c-10a19e284cd9] received 2024-03-28T02:24:00.822913821Z [2024-03-28 02:24:00,822: INFO/ForkPoolWorker-1] [b4cbe911-75ad-4ec5-8cd8-4b33886c3df8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:24:00.834945675Z [2024-03-28 02:24:00,831: INFO/ForkPoolWorker-2] [5cf97b6b-360a-4bdd-801c-10a19e284cd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:24:01.245015160Z [2024-03-28 02:24:01,238: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:24:01.360968377Z [2024-03-28 02:24:01,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:24:01.369047535Z [2024-03-28 02:24:01,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:24:01.419425168Z [2024-03-28 02:24:01,418: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:24:01.423648900Z [2024-03-28 02:24:01,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:24:01.464468373Z [2024-03-28 02:24:01,464: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:24:01.467347771Z [2024-03-28 02:24:01,466: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:24:01.467560111Z [2024-03-28 02:24:01,467: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:24:01.468527788Z [2024-03-28 02:24:01,468: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:24:01.469877318Z [2024-03-28 02:24:01,469: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:24:01.535611463Z [2024-03-28 02:24:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:24:01.580240285Z [2024-03-28 02:24:01,579: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:24:01.633187026Z [2024-03-28 02:24:01,632: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:24:02.516781131Z [2024-03-28 02:24:02,516: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5cf97b6b-360a-4bdd-801c-10a19e284cd9] succeeded in 1.6943356880001375s: None 2024-03-28T02:24:02.534033881Z [2024-03-28 02:24:02,533: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ddafed3-8370-44fa-9116-de11273b291d] succeeded in 1.7241937020007754s: None 2024-03-28T02:24:03.056250620Z [2024-03-28 02:24:03,055: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:24:03.060073846Z [2024-03-28 02:24:03,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:24:03.080935956Z [2024-03-28 02:24:03,080: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:24:03.082553420Z [2024-03-28 02:24:03,082: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:24:03.082599834Z [2024-03-28 02:24:03,082: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:24:03.082859072Z [2024-03-28 02:24:03,082: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:24:03.082938062Z [2024-03-28 02:24:03,082: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:24:03.083337444Z [2024-03-28 02:24:03,083: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:24:03.083510861Z [2024-03-28 02:24:03,083: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:24:03.184498519Z [2024-03-28 02:24:03,184: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:24:03.185957073Z [2024-03-28 02:24:03,185: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:24:03.188054383Z [2024-03-28 02:24:03,187: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:24:03.223173607Z [2024-03-28 02:24:03,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:24:03.225813530Z [2024-03-28 02:24:03,225: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:24:03.225837675Z [2024-03-28 02:24:03,225: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:24:03.226108765Z [2024-03-28 02:24:03,225: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:24:03.226235230Z [2024-03-28 02:24:03,226: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:24:03.226593213Z [2024-03-28 02:24:03,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:24:03.226604659Z [2024-03-28 02:24:03,226: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:24:03.318193477Z [2024-03-28 02:24:03,317: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:24:04.860548081Z [2024-03-28 02:24:04,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca36b484-0095-4e87-b883-c9209cd82d93] succeeded in 4.05067599099857s: None 2024-03-28T02:24:05.169133952Z [2024-03-28 02:24:05,168: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4cbe911-75ad-4ec5-8cd8-4b33886c3df8] succeeded in 4.351958055000068s: None 2024-03-28T02:25:00.608512382Z [2024-03-28 02:25:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e53f6a1-e25b-4d4c-a55c-1a532a80d907] received 2024-03-28T02:25:00.611885652Z [2024-03-28 02:25:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbe63b04-4103-4636-a715-d29133b7ec45] received 2024-03-28T02:25:00.616744207Z [2024-03-28 02:25:00,616: INFO/ForkPoolWorker-15] [1e53f6a1-e25b-4d4c-a55c-1a532a80d907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:25:00.623243399Z [2024-03-28 02:25:00,622: INFO/ForkPoolWorker-16] [bbe63b04-4103-4636-a715-d29133b7ec45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:25:00.628901200Z [2024-03-28 02:25:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4c4ca6-d779-4d69-87de-cf77b9606405] received 2024-03-28T02:25:00.632871126Z [2024-03-28 02:25:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a41e75df-7a22-452d-b962-ee9394c0366a] received 2024-03-28T02:25:00.644395607Z [2024-03-28 02:25:00,644: INFO/ForkPoolWorker-1] [8a4c4ca6-d779-4d69-87de-cf77b9606405] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:25:00.656273489Z [2024-03-28 02:25:00,655: INFO/ForkPoolWorker-2] [a41e75df-7a22-452d-b962-ee9394c0366a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:25:00.992127518Z [2024-03-28 02:25:00,989: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:25:01.030370767Z [2024-03-28 02:25:01,027: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:25:01.056548895Z [2024-03-28 02:25:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:25:01.090457183Z [2024-03-28 02:25:01,087: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:25:01.267624655Z [2024-03-28 02:25:01,267: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:25:01.271989367Z [2024-03-28 02:25:01,271: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:01.304629285Z [2024-03-28 02:25:01,304: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:25:01.306224211Z [2024-03-28 02:25:01,306: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:25:01.309803295Z [2024-03-28 02:25:01,309: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:25:01.310013361Z [2024-03-28 02:25:01,309: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:25:01.310440328Z [2024-03-28 02:25:01,310: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:25:01.450383907Z [2024-03-28 02:25:01,450: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:02.153330761Z [2024-03-28 02:25:02,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a41e75df-7a22-452d-b962-ee9394c0366a] succeeded in 1.512503125000876s: None 2024-03-28T02:25:02.358141060Z [2024-03-28 02:25:02,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:25:02.363262227Z [2024-03-28 02:25:02,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:02.416880301Z [2024-03-28 02:25:02,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:25:02.422302735Z [2024-03-28 02:25:02,421: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:02.422334223Z [2024-03-28 02:25:02,422: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:02.422540230Z [2024-03-28 02:25:02,422: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:02.422632863Z [2024-03-28 02:25:02,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:25:02.422994343Z [2024-03-28 02:25:02,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:25:02.423079097Z [2024-03-28 02:25:02,422: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:02.591490893Z [2024-03-28 02:25:02,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:02.617459929Z [2024-03-28 02:25:02,617: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:25:02.621569530Z [2024-03-28 02:25:02,621: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:02.663506731Z [2024-03-28 02:25:02,663: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:25:02.665579902Z [2024-03-28 02:25:02,665: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:02.665702744Z [2024-03-28 02:25:02,665: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:02.665959661Z [2024-03-28 02:25:02,665: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:02.666094346Z [2024-03-28 02:25:02,665: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:25:02.666485332Z [2024-03-28 02:25:02,666: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:25:02.666659337Z [2024-03-28 02:25:02,666: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:02.788862325Z [2024-03-28 02:25:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:02.847741136Z [2024-03-28 02:25:02,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:25:02.852160062Z [2024-03-28 02:25:02,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:02.934403161Z [2024-03-28 02:25:02,933: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:25:02.943093280Z [2024-03-28 02:25:02,942: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:02.943222984Z [2024-03-28 02:25:02,943: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:02.943503796Z [2024-03-28 02:25:02,943: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:02.944938123Z [2024-03-28 02:25:02,943: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:25:02.946906287Z [2024-03-28 02:25:02,946: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:25:02.947621300Z [2024-03-28 02:25:02,946: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:03.168489204Z [2024-03-28 02:25:03,168: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:03.593200787Z [2024-03-28 02:25:03,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e53f6a1-e25b-4d4c-a55c-1a532a80d907] succeeded in 2.980523231000916s: None 2024-03-28T02:25:03.833773165Z [2024-03-28 02:25:03,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66f2b98d-e6ad-4923-a85a-e451177b4d69] received 2024-03-28T02:25:03.854375510Z [2024-03-28 02:25:03,854: INFO/ForkPoolWorker-15] [66f2b98d-e6ad-4923-a85a-e451177b4d69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:25:04.186649897Z [2024-03-28 02:25:04,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:25:05.328511639Z [2024-03-28 02:25:05,328: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a4c4ca6-d779-4d69-87de-cf77b9606405] succeeded in 4.696529573999214s: None 2024-03-28T02:25:05.365832304Z [2024-03-28 02:25:05,365: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:25:05.369224456Z [2024-03-28 02:25:05,368: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:05.392405077Z [2024-03-28 02:25:05,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:25:05.394783358Z [2024-03-28 02:25:05,394: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:05.394913107Z [2024-03-28 02:25:05,394: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:05.395208799Z [2024-03-28 02:25:05,394: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:05.395337035Z [2024-03-28 02:25:05,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:25:05.395711261Z [2024-03-28 02:25:05,395: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:25:05.395869858Z [2024-03-28 02:25:05,395: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:05.511310032Z [2024-03-28 02:25:05,510: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:05.844785346Z [2024-03-28 02:25:05,844: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bbe63b04-4103-4636-a715-d29133b7ec45] succeeded in 5.228590161001193s: None 2024-03-28T02:25:06.165356519Z [2024-03-28 02:25:06,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32639cb0-078a-40c2-8da3-360273c93c4f] received 2024-03-28T02:25:06.186464286Z [2024-03-28 02:25:06,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66f2b98d-e6ad-4923-a85a-e451177b4d69] succeeded in 2.3510739220000687s: None 2024-03-28T02:25:06.187521902Z [2024-03-28 02:25:06,187: INFO/ForkPoolWorker-16] [32639cb0-078a-40c2-8da3-360273c93c4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:25:06.540678047Z [2024-03-28 02:25:06,537: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:25:07.721859851Z [2024-03-28 02:25:07,721: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:25:07.727499819Z [2024-03-28 02:25:07,727: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:07.766407295Z [2024-03-28 02:25:07,759: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:25:07.766441969Z [2024-03-28 02:25:07,760: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:07.766446322Z [2024-03-28 02:25:07,761: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:07.766450383Z [2024-03-28 02:25:07,761: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:07.766454487Z [2024-03-28 02:25:07,761: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:25:07.766462564Z [2024-03-28 02:25:07,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:25:07.766465898Z [2024-03-28 02:25:07,761: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:07.863001276Z [2024-03-28 02:25:07,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:08.529104587Z [2024-03-28 02:25:08,528: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32639cb0-078a-40c2-8da3-360273c93c4f] succeeded in 2.361852222999005s: None 2024-03-28T02:25:08.575289778Z [2024-03-28 02:25:08,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b439da19-aadb-4acd-94ec-03a01938791b] received 2024-03-28T02:25:08.589524183Z [2024-03-28 02:25:08,589: INFO/ForkPoolWorker-15] [b439da19-aadb-4acd-94ec-03a01938791b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:25:08.887391632Z [2024-03-28 02:25:08,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:25:10.192075116Z [2024-03-28 02:25:10,191: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:25:10.195592648Z [2024-03-28 02:25:10,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:25:10.220920324Z [2024-03-28 02:25:10,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:25:10.222507657Z [2024-03-28 02:25:10,222: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:25:10.222526017Z [2024-03-28 02:25:10,222: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:25:10.224415985Z [2024-03-28 02:25:10,222: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:25:10.224441137Z [2024-03-28 02:25:10,224: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:25:10.224819433Z [2024-03-28 02:25:10,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:25:10.224833122Z [2024-03-28 02:25:10,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:25:10.340387754Z [2024-03-28 02:25:10,340: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:25:10.974315400Z [2024-03-28 02:25:10,973: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b439da19-aadb-4acd-94ec-03a01938791b] succeeded in 2.396883307999815s: None 2024-03-28T02:26:01.249720380Z [2024-03-28 02:26:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14ec033a-e80b-4406-88d4-477d818215ff] received 2024-03-28T02:26:01.257214689Z [2024-03-28 02:26:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6d123ca-d659-452d-b596-e2f4dd048a17] received 2024-03-28T02:26:01.260561222Z [2024-03-28 02:26:01,260: INFO/ForkPoolWorker-15] [14ec033a-e80b-4406-88d4-477d818215ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:26:01.262112551Z [2024-03-28 02:26:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07c04f4a-5071-47ef-9912-26120c9abc45] received 2024-03-28T02:26:01.268119006Z [2024-03-28 02:26:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06a84a90-407a-4a1d-ace3-ed019dce8f3f] received 2024-03-28T02:26:01.277432018Z [2024-03-28 02:26:01,276: INFO/ForkPoolWorker-1] [07c04f4a-5071-47ef-9912-26120c9abc45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:26:01.278878692Z [2024-03-28 02:26:01,278: INFO/ForkPoolWorker-2] [06a84a90-407a-4a1d-ace3-ed019dce8f3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:26:01.288614265Z [2024-03-28 02:26:01,288: INFO/ForkPoolWorker-16] [a6d123ca-d659-452d-b596-e2f4dd048a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:26:01.653525015Z [2024-03-28 02:26:01,649: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:26:01.673357331Z [2024-03-28 02:26:01,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:26:01.800311410Z [2024-03-28 02:26:01,789: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:26:01.869147373Z [2024-03-28 02:26:01,868: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:26:01.873932318Z [2024-03-28 02:26:01,873: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:26:01.902472539Z [2024-03-28 02:26:01,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:26:01.914239693Z [2024-03-28 02:26:01,913: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:26:01.917228737Z [2024-03-28 02:26:01,916: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:26:01.917291224Z [2024-03-28 02:26:01,917: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:26:01.917343809Z [2024-03-28 02:26:01,917: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:26:01.917546200Z [2024-03-28 02:26:01,917: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:26:02.066773878Z [2024-03-28 02:26:02,066: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:26:02.292569650Z [2024-03-28 02:26:02,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:26:02.875293619Z [2024-03-28 02:26:02,874: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06a84a90-407a-4a1d-ace3-ed019dce8f3f] succeeded in 1.6042107819994271s: None 2024-03-28T02:26:03.223025729Z [2024-03-28 02:26:03,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14ec033a-e80b-4406-88d4-477d818215ff] succeeded in 1.9718651610000961s: None 2024-03-28T02:26:03.625643638Z [2024-03-28 02:26:03,621: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:26:03.626484237Z [2024-03-28 02:26:03,626: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:26:03.673782946Z [2024-03-28 02:26:03,663: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:26:03.673807252Z [2024-03-28 02:26:03,664: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:26:03.673811003Z [2024-03-28 02:26:03,664: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:26:03.673840597Z [2024-03-28 02:26:03,664: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:26:03.673845114Z [2024-03-28 02:26:03,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:26:03.673848230Z [2024-03-28 02:26:03,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:26:03.673852050Z [2024-03-28 02:26:03,665: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:26:03.765774364Z [2024-03-28 02:26:03,765: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:26:03.768136561Z [2024-03-28 02:26:03,767: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:26:03.776166079Z [2024-03-28 02:26:03,775: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:26:03.834620103Z [2024-03-28 02:26:03,834: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:26:03.838613082Z [2024-03-28 02:26:03,838: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:26:03.840588801Z [2024-03-28 02:26:03,838: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:26:03.840962155Z [2024-03-28 02:26:03,840: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:26:03.841189582Z [2024-03-28 02:26:03,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:26:03.841713352Z [2024-03-28 02:26:03,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:26:03.842140570Z [2024-03-28 02:26:03,841: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:26:03.947220945Z [2024-03-28 02:26:03,946: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:26:05.510187600Z [2024-03-28 02:26:05,509: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07c04f4a-5071-47ef-9912-26120c9abc45] succeeded in 4.2458957899998495s: None 2024-03-28T02:26:06.626373058Z [2024-03-28 02:26:06,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6d123ca-d659-452d-b596-e2f4dd048a17] succeeded in 5.365281802000027s: None 2024-03-28T02:27:01.193824431Z [2024-03-28 02:27:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f433fd95-d44f-4a4b-8bdb-6d22635e3092] received 2024-03-28T02:27:01.197693107Z [2024-03-28 02:27:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ad22bb9-62d1-4db4-9965-2c3cabf04268] received 2024-03-28T02:27:01.200426939Z [2024-03-28 02:27:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3af55dde-38cf-4345-a144-61443db1733f] received 2024-03-28T02:27:01.210432305Z [2024-03-28 02:27:01,210: INFO/ForkPoolWorker-15] [f433fd95-d44f-4a4b-8bdb-6d22635e3092] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:27:01.214143670Z [2024-03-28 02:27:01,213: INFO/ForkPoolWorker-1] [3af55dde-38cf-4345-a144-61443db1733f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:27:01.216053096Z [2024-03-28 02:27:01,215: INFO/ForkPoolWorker-16] [6ad22bb9-62d1-4db4-9965-2c3cabf04268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:27:01.544031785Z [2024-03-28 02:27:01,540: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:27:01.560281384Z [2024-03-28 02:27:01,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:27:01.704359689Z [2024-03-28 02:27:01,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:27:01.887114686Z [2024-03-28 02:27:01,886: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:27:01.892089666Z [2024-03-28 02:27:01,891: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:27:01.923125836Z [2024-03-28 02:27:01,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:27:01.924859317Z [2024-03-28 02:27:01,924: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:27:01.925144857Z [2024-03-28 02:27:01,924: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:27:01.925342589Z [2024-03-28 02:27:01,925: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:27:01.925782663Z [2024-03-28 02:27:01,925: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:27:02.027740856Z [2024-03-28 02:27:02,027: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:27:02.691958007Z [2024-03-28 02:27:02,691: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3af55dde-38cf-4345-a144-61443db1733f] succeeded in 1.4842520199999854s: None 2024-03-28T02:27:02.799576006Z [2024-03-28 02:27:02,799: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:27:02.803539918Z [2024-03-28 02:27:02,803: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:27:02.826821067Z [2024-03-28 02:27:02,826: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:27:02.828461304Z [2024-03-28 02:27:02,828: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:27:02.828685563Z [2024-03-28 02:27:02,828: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:27:02.828958902Z [2024-03-28 02:27:02,828: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:27:02.829113715Z [2024-03-28 02:27:02,828: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:27:02.829438653Z [2024-03-28 02:27:02,829: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:27:02.829670000Z [2024-03-28 02:27:02,829: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:27:02.904332319Z [2024-03-28 02:27:02,903: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:27:02.908032734Z [2024-03-28 02:27:02,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:27:02.916269015Z [2024-03-28 02:27:02,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:27:02.942279542Z [2024-03-28 02:27:02,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:27:02.946396051Z [2024-03-28 02:27:02,946: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:27:02.946491212Z [2024-03-28 02:27:02,946: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:27:02.946672912Z [2024-03-28 02:27:02,946: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:27:02.946872413Z [2024-03-28 02:27:02,946: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:27:02.947194059Z [2024-03-28 02:27:02,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:27:02.947661527Z [2024-03-28 02:27:02,947: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:27:03.057021672Z [2024-03-28 02:27:03,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:27:04.900978278Z [2024-03-28 02:27:04,900: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ad22bb9-62d1-4db4-9965-2c3cabf04268] succeeded in 3.701067101999797s: None 2024-03-28T02:27:05.206334683Z [2024-03-28 02:27:05,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f433fd95-d44f-4a4b-8bdb-6d22635e3092] succeeded in 4.009797017000892s: None 2024-03-28T02:28:01.154862964Z [2024-03-28 02:28:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6584eabd-6a6c-4b8c-978a-3f2d08f3ff91] received 2024-03-28T02:28:01.160318407Z [2024-03-28 02:28:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9acbbb95-df5f-421e-83ab-0b33c0a6bfc8] received 2024-03-28T02:28:01.166431050Z [2024-03-28 02:28:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05829921-9466-48c0-90f3-917d9f1b3fce] received 2024-03-28T02:28:01.166927407Z [2024-03-28 02:28:01,166: INFO/ForkPoolWorker-15] [6584eabd-6a6c-4b8c-978a-3f2d08f3ff91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:28:01.169683221Z [2024-03-28 02:28:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be8d24e-68cb-4f2d-a283-c3dc5244e773] received 2024-03-28T02:28:01.177472918Z [2024-03-28 02:28:01,175: INFO/ForkPoolWorker-16] [9acbbb95-df5f-421e-83ab-0b33c0a6bfc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:28:01.184569832Z [2024-03-28 02:28:01,183: INFO/ForkPoolWorker-2] [7be8d24e-68cb-4f2d-a283-c3dc5244e773] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:28:01.185029988Z [2024-03-28 02:28:01,184: INFO/ForkPoolWorker-1] [05829921-9466-48c0-90f3-917d9f1b3fce] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:28:01.670510580Z [2024-03-28 02:28:01,666: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:28:01.686149239Z [2024-03-28 02:28:01,682: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:28:01.759956989Z [2024-03-28 02:28:01,755: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:28:01.795311742Z [2024-03-28 02:28:01,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:28:01.993531449Z [2024-03-28 02:28:01,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:28:02.002893475Z [2024-03-28 02:28:02,002: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:28:02.007853724Z [2024-03-28 02:28:02,007: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:28:02.064828504Z [2024-03-28 02:28:02,064: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:28:02.072491667Z [2024-03-28 02:28:02,072: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:28:02.074614008Z [2024-03-28 02:28:02,074: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:28:02.074644166Z [2024-03-28 02:28:02,074: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:28:02.075116554Z [2024-03-28 02:28:02,074: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:28:02.208615246Z [2024-03-28 02:28:02,208: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:28:02.814174842Z [2024-03-28 02:28:02,813: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9acbbb95-df5f-421e-83ab-0b33c0a6bfc8] succeeded in 1.6510286379998433s: None 2024-03-28T02:28:03.006780072Z [2024-03-28 02:28:03,006: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05829921-9466-48c0-90f3-917d9f1b3fce] succeeded in 1.8374555680002231s: None 2024-03-28T02:28:03.427682117Z [2024-03-28 02:28:03,427: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:28:03.431307968Z [2024-03-28 02:28:03,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:28:03.453427092Z [2024-03-28 02:28:03,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:28:03.456519373Z [2024-03-28 02:28:03,456: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:28:03.457007708Z [2024-03-28 02:28:03,456: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:28:03.457214907Z [2024-03-28 02:28:03,456: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:28:03.457333790Z [2024-03-28 02:28:03,457: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:28:03.458406976Z [2024-03-28 02:28:03,457: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:28:03.459298376Z [2024-03-28 02:28:03,459: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:28:03.551701730Z [2024-03-28 02:28:03,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:28:03.563903276Z [2024-03-28 02:28:03,561: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:28:03.567989582Z [2024-03-28 02:28:03,567: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:28:03.597029625Z [2024-03-28 02:28:03,596: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:28:03.603374626Z [2024-03-28 02:28:03,602: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:28:03.603623841Z [2024-03-28 02:28:03,602: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:28:03.603668575Z [2024-03-28 02:28:03,602: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:28:03.603673683Z [2024-03-28 02:28:03,602: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:28:03.603677150Z [2024-03-28 02:28:03,603: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:28:03.603685203Z [2024-03-28 02:28:03,603: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:28:03.716849274Z [2024-03-28 02:28:03,716: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:28:06.153761818Z [2024-03-28 02:28:06,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7be8d24e-68cb-4f2d-a283-c3dc5244e773] succeeded in 4.98163821000162s: None 2024-03-28T02:28:06.375954352Z [2024-03-28 02:28:06,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6584eabd-6a6c-4b8c-978a-3f2d08f3ff91] succeeded in 5.217242563001491s: None 2024-03-28T02:29:01.128353733Z [2024-03-28 02:29:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e0bcf13-ae57-4fd3-8399-7ff1a0425f50] received 2024-03-28T02:29:01.133874380Z [2024-03-28 02:29:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b093484d-334e-4c0a-b1f1-ed546e1bb9c1] received 2024-03-28T02:29:01.135825080Z [2024-03-28 02:29:01,135: INFO/ForkPoolWorker-15] [7e0bcf13-ae57-4fd3-8399-7ff1a0425f50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:29:01.146840649Z [2024-03-28 02:29:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdc207ce-3808-4968-9d81-9c6b462c9731] received 2024-03-28T02:29:01.147557401Z [2024-03-28 02:29:01,145: INFO/ForkPoolWorker-16] [b093484d-334e-4c0a-b1f1-ed546e1bb9c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:29:01.154860823Z [2024-03-28 02:29:01,154: INFO/ForkPoolWorker-1] [bdc207ce-3808-4968-9d81-9c6b462c9731] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:29:01.569365340Z [2024-03-28 02:29:01,566: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:29:01.672772337Z [2024-03-28 02:29:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:29:01.733881157Z [2024-03-28 02:29:01,733: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:29:01.737901717Z [2024-03-28 02:29:01,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:29:01.759940971Z [2024-03-28 02:29:01,759: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:29:01.761701680Z [2024-03-28 02:29:01,761: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:29:01.761930824Z [2024-03-28 02:29:01,761: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:29:01.762048493Z [2024-03-28 02:29:01,761: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:29:01.762650364Z [2024-03-28 02:29:01,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:29:01.762659169Z [2024-03-28 02:29:01,762: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:29:01.870849094Z [2024-03-28 02:29:01,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:29:02.522659401Z [2024-03-28 02:29:02,522: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdc207ce-3808-4968-9d81-9c6b462c9731] succeeded in 1.3731043850002607s: None 2024-03-28T02:29:03.083710142Z [2024-03-28 02:29:03,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:29:03.087384648Z [2024-03-28 02:29:03,086: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:29:03.110432076Z [2024-03-28 02:29:03,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:29:03.112136890Z [2024-03-28 02:29:03,111: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:29:03.112269550Z [2024-03-28 02:29:03,112: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:29:03.112453952Z [2024-03-28 02:29:03,112: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:29:03.112573762Z [2024-03-28 02:29:03,112: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:29:03.113029880Z [2024-03-28 02:29:03,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:29:03.113058538Z [2024-03-28 02:29:03,112: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:29:03.202370197Z [2024-03-28 02:29:03,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:29:03.295552277Z [2024-03-28 02:29:03,295: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:29:03.299062709Z [2024-03-28 02:29:03,298: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:29:03.324015451Z [2024-03-28 02:29:03,323: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:29:03.325661958Z [2024-03-28 02:29:03,325: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:29:03.325834873Z [2024-03-28 02:29:03,325: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:29:03.326205905Z [2024-03-28 02:29:03,325: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:29:03.326409909Z [2024-03-28 02:29:03,326: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:29:03.327067087Z [2024-03-28 02:29:03,326: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:29:03.327339906Z [2024-03-28 02:29:03,327: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:29:03.425597023Z [2024-03-28 02:29:03,421: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:29:05.146616681Z [2024-03-28 02:29:05,146: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b093484d-334e-4c0a-b1f1-ed546e1bb9c1] succeeded in 4.0105882009993366s: None 2024-03-28T02:29:05.496941011Z [2024-03-28 02:29:05,496: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e0bcf13-ae57-4fd3-8399-7ff1a0425f50] succeeded in 4.3667970599999535s: None 2024-03-28T02:30:00.980705364Z [2024-03-28 02:30:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2264ec07-ce58-44af-8017-3a572069070b] received 2024-03-28T02:30:00.985733540Z [2024-03-28 02:30:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[902ccfa4-edd7-4161-952d-69730b4f9d1f] received 2024-03-28T02:30:00.986503869Z [2024-03-28 02:30:00,986: INFO/ForkPoolWorker-15] [2264ec07-ce58-44af-8017-3a572069070b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:30:00.991686155Z [2024-03-28 02:30:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43b49239-91d6-4cfb-acac-2e1d5ca9040f] received 2024-03-28T02:30:00.994210729Z [2024-03-28 02:30:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6f41f44-0545-4ddc-ae0f-9cbba35282e4] received 2024-03-28T02:30:00.998272269Z [2024-03-28 02:30:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1035fc43-fc81-4d74-a25c-110f97ce3a58] received 2024-03-28T02:30:01.009047878Z [2024-03-28 02:30:01,008: INFO/ForkPoolWorker-2] [f6f41f44-0545-4ddc-ae0f-9cbba35282e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:30:01.010084879Z [2024-03-28 02:30:01,009: INFO/ForkPoolWorker-1] [43b49239-91d6-4cfb-acac-2e1d5ca9040f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:30:01.011378041Z [2024-03-28 02:30:01,009: INFO/ForkPoolWorker-16] [902ccfa4-edd7-4161-952d-69730b4f9d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:30:01.024520296Z [2024-03-28 02:30:01,024: INFO/ForkPoolWorker-3] [1035fc43-fc81-4d74-a25c-110f97ce3a58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:30:01.372056209Z [2024-03-28 02:30:01,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:30:01.479815717Z [2024-03-28 02:30:01,473: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:30:01.513057815Z [2024-03-28 02:30:01,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:30:01.526528133Z [2024-03-28 02:30:01,516: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:30:01.656901120Z [2024-03-28 02:30:01,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:30:01.878690590Z [2024-03-28 02:30:01,878: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:01.959473817Z [2024-03-28 02:30:01,958: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:30:01.971058461Z [2024-03-28 02:30:01,970: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:02.025671037Z [2024-03-28 02:30:02,025: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:30:02.030568239Z [2024-03-28 02:30:02,030: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:30:02.030885627Z [2024-03-28 02:30:02,030: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:30:02.030915410Z [2024-03-28 02:30:02,030: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:30:02.031503205Z [2024-03-28 02:30:02,031: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:30:02.195284672Z [2024-03-28 02:30:02,194: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:02.676981842Z [2024-03-28 02:30:02,676: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1035fc43-fc81-4d74-a25c-110f97ce3a58] succeeded in 1.6701623780008958s: None 2024-03-28T02:30:03.117853318Z [2024-03-28 02:30:03,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43b49239-91d6-4cfb-acac-2e1d5ca9040f] succeeded in 2.1233018490001996s: None 2024-03-28T02:30:03.338562991Z [2024-03-28 02:30:03,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:30:03.342467475Z [2024-03-28 02:30:03,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:03.381275229Z [2024-03-28 02:30:03,381: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:30:03.383166808Z [2024-03-28 02:30:03,382: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:03.383253646Z [2024-03-28 02:30:03,383: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:03.383435378Z [2024-03-28 02:30:03,383: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:03.383523306Z [2024-03-28 02:30:03,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:30:03.383872562Z [2024-03-28 02:30:03,383: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:30:03.383957679Z [2024-03-28 02:30:03,383: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:03.395188578Z [2024-03-28 02:30:03,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:30:03.401064063Z [2024-03-28 02:30:03,400: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:03.415971206Z [2024-03-28 02:30:03,415: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:30:03.419613993Z [2024-03-28 02:30:03,419: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:03.432332920Z [2024-03-28 02:30:03,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:30:03.433885068Z [2024-03-28 02:30:03,433: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:03.434192234Z [2024-03-28 02:30:03,434: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:03.434432142Z [2024-03-28 02:30:03,434: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:03.434586853Z [2024-03-28 02:30:03,434: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:30:03.435223333Z [2024-03-28 02:30:03,435: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:30:03.435397744Z [2024-03-28 02:30:03,435: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:03.447355669Z [2024-03-28 02:30:03,447: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:30:03.448588312Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:03.448603920Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:03.448720488Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:03.448758465Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:30:03.448996705Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:30:03.449053770Z [2024-03-28 02:30:03,448: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:03.508262585Z [2024-03-28 02:30:03,507: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:03.551101787Z [2024-03-28 02:30:03,550: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:03.572549890Z [2024-03-28 02:30:03,572: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:04.182558062Z [2024-03-28 02:30:04,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c8b5de3-7b9d-41d7-a3d1-f34437676f26] received 2024-03-28T02:30:04.198185908Z [2024-03-28 02:30:04,197: INFO/ForkPoolWorker-1] [1c8b5de3-7b9d-41d7-a3d1-f34437676f26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:30:04.352707733Z [2024-03-28 02:30:04,352: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f6f41f44-0545-4ddc-ae0f-9cbba35282e4] succeeded in 3.356005343999641s: None 2024-03-28T02:30:04.619601529Z [2024-03-28 02:30:04,615: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:30:05.237701409Z [2024-03-28 02:30:05,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[902ccfa4-edd7-4161-952d-69730b4f9d1f] succeeded in 4.244372306000514s: None 2024-03-28T02:30:05.620552836Z [2024-03-28 02:30:05,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2264ec07-ce58-44af-8017-3a572069070b] succeeded in 4.638560549999966s: None 2024-03-28T02:30:05.924350511Z [2024-03-28 02:30:05,923: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:30:05.927740101Z [2024-03-28 02:30:05,927: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:05.955204832Z [2024-03-28 02:30:05,954: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:30:05.956733418Z [2024-03-28 02:30:05,956: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:05.956750497Z [2024-03-28 02:30:05,956: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:05.956921192Z [2024-03-28 02:30:05,956: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:05.956933955Z [2024-03-28 02:30:05,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:30:05.957318482Z [2024-03-28 02:30:05,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:30:05.957341437Z [2024-03-28 02:30:05,957: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:06.049905787Z [2024-03-28 02:30:06,049: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:06.704004033Z [2024-03-28 02:30:06,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c8b5de3-7b9d-41d7-a3d1-f34437676f26] succeeded in 2.514922585000022s: None 2024-03-28T02:30:07.615824430Z [2024-03-28 02:30:07,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2b3bf64-bea4-44e0-9601-75e3f76b65b3] received 2024-03-28T02:30:07.625832857Z [2024-03-28 02:30:07,625: INFO/ForkPoolWorker-15] [d2b3bf64-bea4-44e0-9601-75e3f76b65b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:30:08.006725651Z [2024-03-28 02:30:08,002: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:30:09.823665402Z [2024-03-28 02:30:09,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:30:09.827280781Z [2024-03-28 02:30:09,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:09.861648381Z [2024-03-28 02:30:09,861: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:30:09.862935534Z [2024-03-28 02:30:09,862: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:09.862949376Z [2024-03-28 02:30:09,862: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:09.863080312Z [2024-03-28 02:30:09,862: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:09.863095060Z [2024-03-28 02:30:09,863: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:30:09.863404163Z [2024-03-28 02:30:09,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:30:09.863521065Z [2024-03-28 02:30:09,863: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:10.003254620Z [2024-03-28 02:30:10,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:10.687554852Z [2024-03-28 02:30:10,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2b3bf64-bea4-44e0-9601-75e3f76b65b3] succeeded in 3.0695619759990223s: None 2024-03-28T02:30:11.106547397Z [2024-03-28 02:30:11,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63b3ab62-63a9-47c1-8b6c-f00f89a11237] received 2024-03-28T02:30:11.121120187Z [2024-03-28 02:30:11,120: INFO/ForkPoolWorker-15] [63b3ab62-63a9-47c1-8b6c-f00f89a11237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:30:11.510011041Z [2024-03-28 02:30:11,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:30:12.939379654Z [2024-03-28 02:30:12,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:30:12.942752185Z [2024-03-28 02:30:12,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:30:12.964052079Z [2024-03-28 02:30:12,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:30:12.965304747Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:30:12.965319429Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:30:12.965449730Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:30:12.965456990Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:30:12.965800112Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:30:12.965813747Z [2024-03-28 02:30:12,965: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:30:13.060308570Z [2024-03-28 02:30:13,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:30:13.599420909Z [2024-03-28 02:30:13,597: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63b3ab62-63a9-47c1-8b6c-f00f89a11237] succeeded in 2.4863334779984143s: None 2024-03-28T02:31:00.213247156Z [2024-03-28 02:31:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ceb5bc4-458d-4e6e-a087-23a3c3e67392] received 2024-03-28T02:31:00.220318406Z [2024-03-28 02:31:00,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6d98467-2c54-49d9-aa38-82f3a425d553] received 2024-03-28T02:31:00.222994455Z [2024-03-28 02:31:00,222: INFO/ForkPoolWorker-15] [7ceb5bc4-458d-4e6e-a087-23a3c3e67392] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:31:00.224343627Z [2024-03-28 02:31:00,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78abe5ee-3cdf-4556-8385-8b109765eac1] received 2024-03-28T02:31:00.228395609Z [2024-03-28 02:31:00,228: INFO/ForkPoolWorker-16] [b6d98467-2c54-49d9-aa38-82f3a425d553] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:31:00.230467543Z [2024-03-28 02:31:00,230: INFO/ForkPoolWorker-1] [78abe5ee-3cdf-4556-8385-8b109765eac1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:31:00.523631083Z [2024-03-28 02:31:00,520: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:31:00.556221772Z [2024-03-28 02:31:00,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:31:00.575582121Z [2024-03-28 02:31:00,572: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:31:00.707829336Z [2024-03-28 02:31:00,707: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:31:00.712383624Z [2024-03-28 02:31:00,711: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:31:00.735246204Z [2024-03-28 02:31:00,735: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:31:00.736264089Z [2024-03-28 02:31:00,736: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:31:00.736293177Z [2024-03-28 02:31:00,736: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:31:00.736441767Z [2024-03-28 02:31:00,736: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:31:00.736630502Z [2024-03-28 02:31:00,736: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:31:00.840599188Z [2024-03-28 02:31:00,840: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:31:01.402961462Z [2024-03-28 02:31:01,402: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78abe5ee-3cdf-4556-8385-8b109765eac1] succeeded in 1.177046610000616s: None 2024-03-28T02:31:01.756777726Z [2024-03-28 02:31:01,756: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:31:01.760068100Z [2024-03-28 02:31:01,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:31:01.760506537Z [2024-03-28 02:31:01,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:31:01.764101343Z [2024-03-28 02:31:01,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:31:01.787187127Z [2024-03-28 02:31:01,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:31:01.787579521Z [2024-03-28 02:31:01,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:31:01.789115969Z [2024-03-28 02:31:01,788: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:31:01.789298109Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:31:01.789517875Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:31:01.789688449Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:31:01.789933441Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:31:01.790171294Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:31:01.790184362Z [2024-03-28 02:31:01,789: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:31:01.790362822Z [2024-03-28 02:31:01,790: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:31:01.790594686Z [2024-03-28 02:31:01,790: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:31:01.790794294Z [2024-03-28 02:31:01,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:31:01.791233074Z [2024-03-28 02:31:01,791: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:31:01.791436540Z [2024-03-28 02:31:01,791: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:31:01.892043872Z [2024-03-28 02:31:01,891: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:31:01.894172683Z [2024-03-28 02:31:01,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:31:03.502473699Z [2024-03-28 02:31:03,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ceb5bc4-458d-4e6e-a087-23a3c3e67392] succeeded in 3.2870324380000966s: None 2024-03-28T02:31:04.609373427Z [2024-03-28 02:31:04,608: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6d98467-2c54-49d9-aa38-82f3a425d553] succeeded in 4.3871368800009805s: None 2024-03-28T02:32:00.562045961Z [2024-03-28 02:32:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3aebfb5-36f1-44cc-a06f-d6580d32b3a3] received 2024-03-28T02:32:00.564546802Z [2024-03-28 02:32:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8785419-f7b5-4e15-9ad8-b03e1513ea86] received 2024-03-28T02:32:00.565973393Z [2024-03-28 02:32:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[737355cf-5a2a-43a1-8e71-4c786786be8a] received 2024-03-28T02:32:00.569620117Z [2024-03-28 02:32:00,569: INFO/ForkPoolWorker-15] [a3aebfb5-36f1-44cc-a06f-d6580d32b3a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:32:00.573395376Z [2024-03-28 02:32:00,572: INFO/ForkPoolWorker-16] [d8785419-f7b5-4e15-9ad8-b03e1513ea86] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:32:00.586173280Z [2024-03-28 02:32:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[210189bd-2459-4016-b572-3da8f30bed48] received 2024-03-28T02:32:00.586544511Z [2024-03-28 02:32:00,586: INFO/ForkPoolWorker-1] [737355cf-5a2a-43a1-8e71-4c786786be8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:32:00.594161082Z [2024-03-28 02:32:00,593: INFO/ForkPoolWorker-2] [210189bd-2459-4016-b572-3da8f30bed48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:32:00.990606883Z [2024-03-28 02:32:00,986: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:32:01.033083934Z [2024-03-28 02:32:01,030: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:32:01.099743969Z [2024-03-28 02:32:01,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:32:01.151517922Z [2024-03-28 02:32:01,147: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:32:01.311076700Z [2024-03-28 02:32:01,310: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:32:01.321057343Z [2024-03-28 02:32:01,320: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:32:01.354246000Z [2024-03-28 02:32:01,353: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:32:01.355658071Z [2024-03-28 02:32:01,355: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:32:01.355734696Z [2024-03-28 02:32:01,355: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:32:01.355777365Z [2024-03-28 02:32:01,355: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:32:01.355973395Z [2024-03-28 02:32:01,355: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:32:01.466793481Z [2024-03-28 02:32:01,466: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:32:01.534501510Z [2024-03-28 02:32:01,534: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:32:02.262395348Z [2024-03-28 02:32:02,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8785419-f7b5-4e15-9ad8-b03e1513ea86] succeeded in 1.695088845999635s: None 2024-03-28T02:32:02.372214859Z [2024-03-28 02:32:02,371: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[737355cf-5a2a-43a1-8e71-4c786786be8a] succeeded in 1.7905358730004082s: None 2024-03-28T02:32:02.516150833Z [2024-03-28 02:32:02,515: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:32:02.520091119Z [2024-03-28 02:32:02,519: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:32:02.540914426Z [2024-03-28 02:32:02,540: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:32:02.542498417Z [2024-03-28 02:32:02,542: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:32:02.542687927Z [2024-03-28 02:32:02,542: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:32:02.542902787Z [2024-03-28 02:32:02,542: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:32:02.543077342Z [2024-03-28 02:32:02,542: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:32:02.543501674Z [2024-03-28 02:32:02,543: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:32:02.543641377Z [2024-03-28 02:32:02,543: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:32:02.634043117Z [2024-03-28 02:32:02,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:32:02.830898707Z [2024-03-28 02:32:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:32:02.834663228Z [2024-03-28 02:32:02,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:32:02.863569551Z [2024-03-28 02:32:02,863: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:32:02.865856145Z [2024-03-28 02:32:02,865: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:32:02.865993432Z [2024-03-28 02:32:02,865: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:32:02.866317567Z [2024-03-28 02:32:02,866: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:32:02.866434419Z [2024-03-28 02:32:02,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:32:02.866851625Z [2024-03-28 02:32:02,866: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:32:02.867338402Z [2024-03-28 02:32:02,866: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:32:02.993039198Z [2024-03-28 02:32:02,992: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:32:05.236333760Z [2024-03-28 02:32:05,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3aebfb5-36f1-44cc-a06f-d6580d32b3a3] succeeded in 4.670493722998799s: None 2024-03-28T02:32:05.262911943Z [2024-03-28 02:32:05,262: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[210189bd-2459-4016-b572-3da8f30bed48] succeeded in 4.674986088000878s: None 2024-03-28T02:33:01.320500945Z [2024-03-28 02:33:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aae619c-16ac-4a07-822d-f18526764efb] received 2024-03-28T02:33:01.322728067Z [2024-03-28 02:33:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d483d86-c251-4d68-8616-bfe531c0bcf4] received 2024-03-28T02:33:01.324609915Z [2024-03-28 02:33:01,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8708d52-b503-4418-acdb-2bf4f49fb5db] received 2024-03-28T02:33:01.346818463Z [2024-03-28 02:33:01,346: INFO/ForkPoolWorker-16] [4d483d86-c251-4d68-8616-bfe531c0bcf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:33:01.350728511Z [2024-03-28 02:33:01,350: INFO/ForkPoolWorker-15] [2aae619c-16ac-4a07-822d-f18526764efb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:33:01.351558775Z [2024-03-28 02:33:01,351: INFO/ForkPoolWorker-1] [f8708d52-b503-4418-acdb-2bf4f49fb5db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:33:01.731518609Z [2024-03-28 02:33:01,728: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:33:01.809729226Z [2024-03-28 02:33:01,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:33:01.929171428Z [2024-03-28 02:33:01,925: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:33:01.974315889Z [2024-03-28 02:33:01,973: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:33:01.979577276Z [2024-03-28 02:33:01,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:33:02.007200709Z [2024-03-28 02:33:02,006: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:33:02.008430849Z [2024-03-28 02:33:02,008: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:33:02.008645052Z [2024-03-28 02:33:02,008: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:33:02.008799879Z [2024-03-28 02:33:02,008: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:33:02.009145866Z [2024-03-28 02:33:02,008: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:33:02.143418282Z [2024-03-28 02:33:02,143: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:33:02.899601175Z [2024-03-28 02:33:02,899: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f8708d52-b503-4418-acdb-2bf4f49fb5db] succeeded in 1.571807844000432s: None 2024-03-28T02:33:03.303429465Z [2024-03-28 02:33:03,303: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:33:03.307322220Z [2024-03-28 02:33:03,306: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:33:03.318235823Z [2024-03-28 02:33:03,317: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:33:03.321961370Z [2024-03-28 02:33:03,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:33:03.327360143Z [2024-03-28 02:33:03,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:33:03.329195687Z [2024-03-28 02:33:03,328: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:33:03.329383672Z [2024-03-28 02:33:03,329: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:33:03.329652545Z [2024-03-28 02:33:03,329: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:33:03.329815428Z [2024-03-28 02:33:03,329: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:33:03.330287213Z [2024-03-28 02:33:03,330: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:33:03.330451275Z [2024-03-28 02:33:03,330: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:33:03.352840919Z [2024-03-28 02:33:03,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:33:03.359671409Z [2024-03-28 02:33:03,358: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:33:03.359693755Z [2024-03-28 02:33:03,358: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:33:03.359699091Z [2024-03-28 02:33:03,358: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:33:03.359704230Z [2024-03-28 02:33:03,359: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:33:03.359707631Z [2024-03-28 02:33:03,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:33:03.359711053Z [2024-03-28 02:33:03,359: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:33:03.427921907Z [2024-03-28 02:33:03,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:33:03.448397310Z [2024-03-28 02:33:03,447: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:33:05.333623033Z [2024-03-28 02:33:05,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d483d86-c251-4d68-8616-bfe531c0bcf4] succeeded in 4.008453267000732s: None 2024-03-28T02:33:05.857802540Z [2024-03-28 02:33:05,857: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2aae619c-16ac-4a07-822d-f18526764efb] succeeded in 4.535269861000415s: None 2024-03-28T02:33:38.344165982Z [2024-03-28 02:33:38,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad93fddd-d1f2-4bad-9a51-dc78659bfa89] received 2024-03-28T02:33:38.351659559Z [2024-03-28 02:33:38,351: INFO/ForkPoolWorker-15] [ad93fddd-d1f2-4bad-9a51-dc78659bfa89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240328023337_690720', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-28T02:33:38.645842015Z [2024-03-28 02:33:38,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-03-28T02:33:38.942269042Z [2024-03-28 02:33:38,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:33:39.498458299Z [2024-03-28 02:33:39,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad93fddd-d1f2-4bad-9a51-dc78659bfa89] succeeded in 1.1529739239995251s: None 2024-03-28T02:34:00.946655326Z [2024-03-28 02:34:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[886a6377-8412-4670-a693-899216d4e40d] received 2024-03-28T02:34:00.950616720Z [2024-03-28 02:34:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97fa8b98-d8fd-4b63-86ac-bb3dba2311fd] received 2024-03-28T02:34:00.954600312Z [2024-03-28 02:34:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca602d18-9763-4775-9681-af7ee03ff4e3] received 2024-03-28T02:34:00.954820214Z [2024-03-28 02:34:00,954: INFO/ForkPoolWorker-15] [886a6377-8412-4670-a693-899216d4e40d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:34:00.957710023Z [2024-03-28 02:34:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa02ed6d-2440-4f1c-8ebe-8224c8cd1cfa] received 2024-03-28T02:34:00.969751007Z [2024-03-28 02:34:00,968: INFO/ForkPoolWorker-2] [fa02ed6d-2440-4f1c-8ebe-8224c8cd1cfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:34:00.980877585Z [2024-03-28 02:34:00,980: INFO/ForkPoolWorker-1] [ca602d18-9763-4775-9681-af7ee03ff4e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:34:00.981119951Z [2024-03-28 02:34:00,980: INFO/ForkPoolWorker-16] [97fa8b98-d8fd-4b63-86ac-bb3dba2311fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:34:01.327028391Z [2024-03-28 02:34:01,323: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:34:01.461098056Z [2024-03-28 02:34:01,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:34:01.560166039Z [2024-03-28 02:34:01,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:34:01.583366797Z [2024-03-28 02:34:01,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:34:01.820306399Z [2024-03-28 02:34:01,819: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:34:01.946350415Z [2024-03-28 02:34:01,945: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:34:01.951098402Z [2024-03-28 02:34:01,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:34:01.996427490Z [2024-03-28 02:34:01,996: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:34:02.005771175Z [2024-03-28 02:34:02,005: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:34:02.006182147Z [2024-03-28 02:34:02,005: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:34:02.006398887Z [2024-03-28 02:34:02,006: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:34:02.006776211Z [2024-03-28 02:34:02,006: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:34:02.141196684Z [2024-03-28 02:34:02,140: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:34:02.779150132Z [2024-03-28 02:34:02,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[886a6377-8412-4670-a693-899216d4e40d] succeeded in 1.8286980600005336s: None 2024-03-28T02:34:02.936164853Z [2024-03-28 02:34:02,935: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca602d18-9763-4775-9681-af7ee03ff4e3] succeeded in 1.9773979109995707s: None 2024-03-28T02:34:03.124826329Z [2024-03-28 02:34:03,124: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:34:03.128529574Z [2024-03-28 02:34:03,127: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:34:03.150745731Z [2024-03-28 02:34:03,150: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:34:03.152460347Z [2024-03-28 02:34:03,152: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:34:03.152927445Z [2024-03-28 02:34:03,152: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:34:03.153058427Z [2024-03-28 02:34:03,152: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:34:03.153103622Z [2024-03-28 02:34:03,153: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:34:03.153411022Z [2024-03-28 02:34:03,153: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:34:03.154021675Z [2024-03-28 02:34:03,153: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:34:03.176131988Z [2024-03-28 02:34:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:34:03.180061151Z [2024-03-28 02:34:03,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:34:03.226425428Z [2024-03-28 02:34:03,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:34:03.229947520Z [2024-03-28 02:34:03,229: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:34:03.234165315Z [2024-03-28 02:34:03,229: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:34:03.234220077Z [2024-03-28 02:34:03,233: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:34:03.234275096Z [2024-03-28 02:34:03,234: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:34:03.234744250Z [2024-03-28 02:34:03,234: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:34:03.235035481Z [2024-03-28 02:34:03,234: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:34:03.263247692Z [2024-03-28 02:34:03,262: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:34:03.416991940Z [2024-03-28 02:34:03,413: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:34:05.183620954Z [2024-03-28 02:34:05,183: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97fa8b98-d8fd-4b63-86ac-bb3dba2311fd] succeeded in 4.2258909859992855s: None 2024-03-28T02:34:05.535984088Z [2024-03-28 02:34:05,535: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa02ed6d-2440-4f1c-8ebe-8224c8cd1cfa] succeeded in 4.5754131710000365s: None 2024-03-28T02:35:00.611011825Z [2024-03-28 02:35:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9d729c5-8bb3-45e4-b57c-314482d1df04] received 2024-03-28T02:35:00.614903489Z [2024-03-28 02:35:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5498efb7-98fc-4a8b-8961-1f9b7381f24b] received 2024-03-28T02:35:00.619539013Z [2024-03-28 02:35:00,619: INFO/ForkPoolWorker-15] [a9d729c5-8bb3-45e4-b57c-314482d1df04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:00.636706936Z [2024-03-28 02:35:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2266481-201a-4ce3-9389-b00729f90907] received 2024-03-28T02:35:00.641654067Z [2024-03-28 02:35:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ae3f1bf-d924-436c-9d21-da7bb04a80bb] received 2024-03-28T02:35:00.656954124Z [2024-03-28 02:35:00,656: INFO/ForkPoolWorker-2] [7ae3f1bf-d924-436c-9d21-da7bb04a80bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:35:00.673961600Z [2024-03-28 02:35:00,673: INFO/ForkPoolWorker-1] [a2266481-201a-4ce3-9389-b00729f90907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:35:00.674693706Z [2024-03-28 02:35:00,674: INFO/ForkPoolWorker-16] [5498efb7-98fc-4a8b-8961-1f9b7381f24b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:35:01.148385640Z [2024-03-28 02:35:01,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:01.408728442Z [2024-03-28 02:35:01,404: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:35:01.499311141Z [2024-03-28 02:35:01,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:35:01.520698923Z [2024-03-28 02:35:01,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:35:01.861603700Z [2024-03-28 02:35:01,861: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:35:01.884715125Z [2024-03-28 02:35:01,877: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:02.054717782Z [2024-03-28 02:35:02,054: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:35:02.058539771Z [2024-03-28 02:35:02,058: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:35:02.058692303Z [2024-03-28 02:35:02,058: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:35:02.058812130Z [2024-03-28 02:35:02,058: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:35:02.059132604Z [2024-03-28 02:35:02,058: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:35:02.301127233Z [2024-03-28 02:35:02,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:04.121015319Z [2024-03-28 02:35:04,120: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ae3f1bf-d924-436c-9d21-da7bb04a80bb] succeeded in 3.4775615950002248s: None 2024-03-28T02:35:04.441406737Z [2024-03-28 02:35:04,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:04.448393719Z [2024-03-28 02:35:04,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:04.488541405Z [2024-03-28 02:35:04,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:04.490669727Z [2024-03-28 02:35:04,490: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:04.490809224Z [2024-03-28 02:35:04,490: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:04.491075281Z [2024-03-28 02:35:04,490: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:04.491418933Z [2024-03-28 02:35:04,491: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:04.491574632Z [2024-03-28 02:35:04,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:04.492054445Z [2024-03-28 02:35:04,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:04.492619053Z [2024-03-28 02:35:04,491: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:04.518354206Z [2024-03-28 02:35:04,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:04.690572072Z [2024-03-28 02:35:04,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:05.267605233Z [2024-03-28 02:35:05,267: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:35:05.271298312Z [2024-03-28 02:35:05,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:05.298987085Z [2024-03-28 02:35:05,298: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:35:05.303301518Z [2024-03-28 02:35:05,303: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:05.303511207Z [2024-03-28 02:35:05,303: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:05.303653598Z [2024-03-28 02:35:05,303: INFO/ForkPoolWorker-1] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:05.303889271Z [2024-03-28 02:35:05,303: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:05.303973701Z [2024-03-28 02:35:05,303: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:35:05.304343249Z [2024-03-28 02:35:05,304: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:35:05.304852056Z [2024-03-28 02:35:05,304: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:05.314641774Z [2024-03-28 02:35:05,314: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:05.413424911Z [2024-03-28 02:35:05,413: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:35:05.418027423Z [2024-03-28 02:35:05,417: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:05.429254211Z [2024-03-28 02:35:05,428: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:05.452141713Z [2024-03-28 02:35:05,451: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:35:05.457960304Z [2024-03-28 02:35:05,457: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:05.458471715Z [2024-03-28 02:35:05,457: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:05.458760590Z [2024-03-28 02:35:05,458: INFO/ForkPoolWorker-16] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:05.459590405Z [2024-03-28 02:35:05,458: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:05.459908418Z [2024-03-28 02:35:05,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:35:05.460375434Z [2024-03-28 02:35:05,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:35:05.460549494Z [2024-03-28 02:35:05,460: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:05.468456100Z [2024-03-28 02:35:05,468: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:05.552103692Z [2024-03-28 02:35:05,551: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9d729c5-8bb3-45e4-b57c-314482d1df04] succeeded in 4.93963787499888s: None 2024-03-28T02:35:05.588866565Z [2024-03-28 02:35:05,588: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:06.428199602Z [2024-03-28 02:35:06,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db6a4042-10ef-4f6a-a351-04044093878d] received 2024-03-28T02:35:06.433015132Z [2024-03-28 02:35:06,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8af4fcea-ae14-41b0-bc2b-2078330ef443] received 2024-03-28T02:35:06.436083969Z [2024-03-28 02:35:06,435: INFO/ForkPoolWorker-15] [db6a4042-10ef-4f6a-a351-04044093878d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:06.442273442Z [2024-03-28 02:35:06,441: INFO/ForkPoolWorker-2] [8af4fcea-ae14-41b0-bc2b-2078330ef443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:35:06.742348553Z [2024-03-28 02:35:06,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:06.775271641Z [2024-03-28 02:35:06,772: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:35:07.254209894Z [2024-03-28 02:35:07,253: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2266481-201a-4ce3-9389-b00729f90907] succeeded in 6.615746192001097s: None 2024-03-28T02:35:07.604018095Z [2024-03-28 02:35:07,603: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5498efb7-98fc-4a8b-8961-1f9b7381f24b] succeeded in 6.985497989000578s: None 2024-03-28T02:35:08.161579584Z [2024-03-28 02:35:08,158: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:08.165587904Z [2024-03-28 02:35:08,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:08.230558743Z [2024-03-28 02:35:08,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:08.239834810Z [2024-03-28 02:35:08,238: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:08.239963920Z [2024-03-28 02:35:08,239: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:08.240063181Z [2024-03-28 02:35:08,239: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:08.240263156Z [2024-03-28 02:35:08,240: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:08.240352954Z [2024-03-28 02:35:08,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:08.240768263Z [2024-03-28 02:35:08,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:08.240809486Z [2024-03-28 02:35:08,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:08.253857507Z [2024-03-28 02:35:08,253: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:08.279000407Z [2024-03-28 02:35:08,278: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:35:08.289224616Z [2024-03-28 02:35:08,288: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:08.344483905Z [2024-03-28 02:35:08,344: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:35:08.347455378Z [2024-03-28 02:35:08,347: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:08.348244831Z [2024-03-28 02:35:08,347: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:08.348422694Z [2024-03-28 02:35:08,348: INFO/ForkPoolWorker-2] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:08.348641388Z [2024-03-28 02:35:08,348: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:08.348747236Z [2024-03-28 02:35:08,348: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:35:08.349196131Z [2024-03-28 02:35:08,349: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:35:08.349308786Z [2024-03-28 02:35:08,349: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:08.356352112Z [2024-03-28 02:35:08,356: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:08.367868278Z [2024-03-28 02:35:08,367: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:08.489585999Z [2024-03-28 02:35:08,487: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:09.103184845Z [2024-03-28 02:35:09,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fd2bdf0-f970-4df0-910a-2c42e037073a] received 2024-03-28T02:35:09.129066533Z [2024-03-28 02:35:09,128: INFO/ForkPoolWorker-16] [3fd2bdf0-f970-4df0-910a-2c42e037073a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:35:09.245900854Z [2024-03-28 02:35:09,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db6a4042-10ef-4f6a-a351-04044093878d] succeeded in 2.8160766850014625s: None 2024-03-28T02:35:09.302227123Z [2024-03-28 02:35:09,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a55fe731-903f-4ee5-b563-e24c202695e9] received 2024-03-28T02:35:09.332002462Z [2024-03-28 02:35:09,331: INFO/ForkPoolWorker-15] [a55fe731-903f-4ee5-b563-e24c202695e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:35:09.559272027Z [2024-03-28 02:35:09,556: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:35:09.685039494Z [2024-03-28 02:35:09,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:10.152051901Z [2024-03-28 02:35:10,151: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8af4fcea-ae14-41b0-bc2b-2078330ef443] succeeded in 3.716300564999983s: None 2024-03-28T02:35:11.069100402Z [2024-03-28 02:35:11,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:35:11.086370149Z [2024-03-28 02:35:11,085: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:11.122061977Z [2024-03-28 02:35:11,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:11.132762319Z [2024-03-28 02:35:11,131: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:11.150339509Z [2024-03-28 02:35:11,150: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:35:11.153165682Z [2024-03-28 02:35:11,152: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:11.153184164Z [2024-03-28 02:35:11,152: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:11.153187702Z [2024-03-28 02:35:11,153: INFO/ForkPoolWorker-16] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:11.153244481Z [2024-03-28 02:35:11,153: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:11.153249663Z [2024-03-28 02:35:11,153: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:35:11.154068247Z [2024-03-28 02:35:11,153: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:35:11.154169155Z [2024-03-28 02:35:11,153: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:11.163926174Z [2024-03-28 02:35:11,158: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:11.169964629Z [2024-03-28 02:35:11,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:11.171594301Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:11.171614996Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:11.171618162Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:11.171802283Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:11.171809525Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:11.172191656Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:11.172197305Z [2024-03-28 02:35:11,171: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:11.181054256Z [2024-03-28 02:35:11,178: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:11.304899009Z [2024-03-28 02:35:11,304: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:11.328172328Z [2024-03-28 02:35:11,327: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:12.080981861Z [2024-03-28 02:35:12,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a55fe731-903f-4ee5-b563-e24c202695e9] succeeded in 2.7769034249995457s: None 2024-03-28T02:35:12.874446486Z [2024-03-28 02:35:12,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[699a808d-f467-4dc0-bb98-9aee0b622cf5] received 2024-03-28T02:35:12.885236622Z [2024-03-28 02:35:12,884: INFO/ForkPoolWorker-15] [699a808d-f467-4dc0-bb98-9aee0b622cf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:13.222017003Z [2024-03-28 02:35:13,218: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:13.355690688Z [2024-03-28 02:35:13,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fd2bdf0-f970-4df0-910a-2c42e037073a] succeeded in 4.247690706999492s: None 2024-03-28T02:35:14.300860304Z [2024-03-28 02:35:14,300: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:14.303957558Z [2024-03-28 02:35:14,303: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:14.324019577Z [2024-03-28 02:35:14,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:14.325285417Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:14.325375039Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:14.325440729Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:14.325698623Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:14.325756390Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:14.326152605Z [2024-03-28 02:35:14,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:14.326277906Z [2024-03-28 02:35:14,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:14.333993578Z [2024-03-28 02:35:14,333: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:14.408751598Z [2024-03-28 02:35:14,408: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:14.973724159Z [2024-03-28 02:35:14,973: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[699a808d-f467-4dc0-bb98-9aee0b622cf5] succeeded in 2.0954982110015408s: None 2024-03-28T02:35:23.008377453Z [2024-03-28 02:35:23,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48e94d98-d85c-4402-9479-4f3c7773d8aa] received 2024-03-28T02:35:23.013981954Z [2024-03-28 02:35:23,013: INFO/ForkPoolWorker-15] [48e94d98-d85c-4402-9479-4f3c7773d8aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:23.273878422Z [2024-03-28 02:35:23,270: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:24.395705669Z [2024-03-28 02:35:24,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:24.398901619Z [2024-03-28 02:35:24,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:24.415949086Z [2024-03-28 02:35:24,415: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:24.417055466Z [2024-03-28 02:35:24,416: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:24.417115208Z [2024-03-28 02:35:24,416: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:24.417148975Z [2024-03-28 02:35:24,417: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:24.417319624Z [2024-03-28 02:35:24,417: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:24.417344679Z [2024-03-28 02:35:24,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:24.417580535Z [2024-03-28 02:35:24,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:24.417742523Z [2024-03-28 02:35:24,417: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:24.423751883Z [2024-03-28 02:35:24,423: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:24.497514075Z [2024-03-28 02:35:24,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:24.982404620Z [2024-03-28 02:35:24,982: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48e94d98-d85c-4402-9479-4f3c7773d8aa] succeeded in 1.9721282680002332s: None 2024-03-28T02:35:25.290911629Z [2024-03-28 02:35:25,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2010591f-d477-41f8-b20d-da39fcdb5617] received 2024-03-28T02:35:25.296991024Z [2024-03-28 02:35:25,296: INFO/ForkPoolWorker-15] [2010591f-d477-41f8-b20d-da39fcdb5617] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'split_metrics', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:25.575561901Z [2024-03-28 02:35:25,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:26.649517638Z [2024-03-28 02:35:26,649: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:26.652585620Z [2024-03-28 02:35:26,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:26.669048807Z [2024-03-28 02:35:26,668: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:26.670207422Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:26.670254993Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:26.670259244Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:26.670383071Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:26.670465030Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:26.670662283Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:26.670711418Z [2024-03-28 02:35:26,670: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:26.677728842Z [2024-03-28 02:35:26,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:26.743838866Z [2024-03-28 02:35:26,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:27.316937709Z [2024-03-28 02:35:27,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2010591f-d477-41f8-b20d-da39fcdb5617] succeeded in 2.0229814630001783s: None 2024-03-28T02:35:28.049685384Z [2024-03-28 02:35:28,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c78565d-1487-4157-80b9-e51aba9a3b3f] received 2024-03-28T02:35:28.057823861Z [2024-03-28 02:35:28,057: INFO/ForkPoolWorker-15] [9c78565d-1487-4157-80b9-e51aba9a3b3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'collect_metrics', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:35:28.334583971Z [2024-03-28 02:35:28,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:29.497252444Z [2024-03-28 02:35:29,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:29.500495328Z [2024-03-28 02:35:29,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:29.518432234Z [2024-03-28 02:35:29,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:29.519684127Z [2024-03-28 02:35:29,519: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:29.519696346Z [2024-03-28 02:35:29,519: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:29.519785225Z [2024-03-28 02:35:29,519: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:29.520008380Z [2024-03-28 02:35:29,519: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:29.520014104Z [2024-03-28 02:35:29,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:29.520257699Z [2024-03-28 02:35:29,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:29.520350359Z [2024-03-28 02:35:29,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:29.526411471Z [2024-03-28 02:35:29,526: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:29.597831624Z [2024-03-28 02:35:29,597: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:30.097600986Z [2024-03-28 02:35:30,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c78565d-1487-4157-80b9-e51aba9a3b3f] succeeded in 2.0452233039995917s: None 2024-03-28T02:35:30.592293580Z [2024-03-28 02:35:30,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f41e2f34-5929-40f3-a7e5-200d4a20958b] received 2024-03-28T02:35:30.599069445Z [2024-03-28 02:35:30,598: INFO/ForkPoolWorker-15] [f41e2f34-5929-40f3-a7e5-200d4a20958b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'send_prometheus', 'scheduled__2024-03-28T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:35:30.869647498Z [2024-03-28 02:35:30,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:35:32.017844442Z [2024-03-28 02:35:32,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:35:32.021303289Z [2024-03-28 02:35:32,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:35:32.043473277Z [2024-03-28 02:35:32,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:35:32.047276774Z [2024-03-28 02:35:32,046: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:35:32.047326616Z [2024-03-28 02:35:32,047: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:35:32.047429569Z [2024-03-28 02:35:32,047: INFO/ForkPoolWorker-15] Read VIM fdc1706e-fdf9-41b7-8f2a-d034db461edf (basic01_390378) 2024-03-28T02:35:32.047789170Z [2024-03-28 02:35:32,047: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'name': 'basic01_390378', 'vim_type': 'openstack'}] 2024-03-28T02:35:32.047825476Z [2024-03-28 02:35:32,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:35:32.048266295Z [2024-03-28 02:35:32,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:35:32.048280544Z [2024-03-28 02:35:32,048: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:35:32.057385037Z [2024-03-28 02:35:32,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf 2024-03-28T02:35:32.132725818Z [2024-03-28 02:35:32,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:32.593108135Z [2024-03-28 02:35:32,592: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f41e2f34-5929-40f3-a7e5-200d4a20958b] succeeded in 1.9990291079993767s: None 2024-03-28T02:35:39.415548654Z [2024-03-28 02:35:39,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[570bd04a-90fa-40bb-bb30-481d4ba99ed3] received 2024-03-28T02:35:39.424709204Z [2024-03-28 02:35:39,424: INFO/ForkPoolWorker-15] [570bd04a-90fa-40bb-bb30-481d4ba99ed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240328023537_308455', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-28T02:35:39.719925947Z [2024-03-28 02:35:39,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-03-28T02:35:40.038236444Z [2024-03-28 02:35:40,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:35:40.551836184Z [2024-03-28 02:35:40,551: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[570bd04a-90fa-40bb-bb30-481d4ba99ed3] succeeded in 1.133587496000473s: None 2024-03-28T02:36:01.065179517Z [2024-03-28 02:36:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6a8e4a4-04c6-4bb2-8b89-62c10cb410b0] received 2024-03-28T02:36:01.075943097Z [2024-03-28 02:36:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa702f89-9ede-4980-a4b1-7535de36f330] received 2024-03-28T02:36:01.079118777Z [2024-03-28 02:36:01,078: INFO/ForkPoolWorker-15] [e6a8e4a4-04c6-4bb2-8b89-62c10cb410b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:36:01.088637489Z [2024-03-28 02:36:01,088: INFO/ForkPoolWorker-16] [aa702f89-9ede-4980-a4b1-7535de36f330] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:36:01.088937365Z [2024-03-28 02:36:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56a7254c-96ce-421b-8b3a-f906835c4956] received 2024-03-28T02:36:01.091855803Z [2024-03-28 02:36:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cfc501a-8b09-4438-b92c-cbfb1a6fd872] received 2024-03-28T02:36:01.094592802Z [2024-03-28 02:36:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1836569a-be68-42e8-8bed-e44fd540bea0] received 2024-03-28T02:36:01.102265382Z [2024-03-28 02:36:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a90c18b1-74a0-4f4e-bfe3-05b37fa5d83c] received 2024-03-28T02:36:01.113250192Z [2024-03-28 02:36:01,112: INFO/ForkPoolWorker-2] [9cfc501a-8b09-4438-b92c-cbfb1a6fd872] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:36:01.117799376Z [2024-03-28 02:36:01,117: INFO/ForkPoolWorker-1] [56a7254c-96ce-421b-8b3a-f906835c4956] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:36:01.129333938Z [2024-03-28 02:36:01,128: INFO/ForkPoolWorker-4] [a90c18b1-74a0-4f4e-bfe3-05b37fa5d83c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:36:01.130406387Z [2024-03-28 02:36:01,130: INFO/ForkPoolWorker-3] [1836569a-be68-42e8-8bed-e44fd540bea0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:36:01.616468763Z [2024-03-28 02:36:01,611: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:01.715023255Z [2024-03-28 02:36:01,710: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:36:01.799965307Z [2024-03-28 02:36:01,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:01.882476649Z [2024-03-28 02:36:01,878: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:02.119597061Z [2024-03-28 02:36:02,118: INFO/ForkPoolWorker-4] Getting SDNC list 2024-03-28T02:36:02.123960989Z [2024-03-28 02:36:02,123: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:02.128219365Z [2024-03-28 02:36:02,122: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:02.137987910Z [2024-03-28 02:36:02,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:36:02.225364309Z [2024-03-28 02:36:02,225: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-03-28T02:36:02.229499022Z [2024-03-28 02:36:02,229: INFO/ForkPoolWorker-4] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:36:02.229724326Z [2024-03-28 02:36:02,229: INFO/ForkPoolWorker-4] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:36:02.230012732Z [2024-03-28 02:36:02,229: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-03-28T02:36:02.230344806Z [2024-03-28 02:36:02,230: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:36:02.380036307Z [2024-03-28 02:36:02,379: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:36:02.909287947Z [2024-03-28 02:36:02,908: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:36:03.501253195Z [2024-03-28 02:36:03,500: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a90c18b1-74a0-4f4e-bfe3-05b37fa5d83c] succeeded in 2.392947104999621s: None 2024-03-28T02:36:04.118127599Z [2024-03-28 02:36:04,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56a7254c-96ce-421b-8b3a-f906835c4956] succeeded in 3.026467114999832s: None 2024-03-28T02:36:04.453188096Z [2024-03-28 02:36:04,452: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:36:04.457034261Z [2024-03-28 02:36:04,456: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.486635970Z [2024-03-28 02:36:04,486: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:36:04.490700523Z [2024-03-28 02:36:04,490: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.490930055Z [2024-03-28 02:36:04,490: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.491159330Z [2024-03-28 02:36:04,490: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.491309844Z [2024-03-28 02:36:04,491: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:36:04.491658128Z [2024-03-28 02:36:04,491: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:36:04.491827437Z [2024-03-28 02:36:04,491: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.498438247Z [2024-03-28 02:36:04,498: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:04.499579784Z [2024-03-28 02:36:04,498: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:04.500701240Z [2024-03-28 02:36:04,500: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:36:04.508427674Z [2024-03-28 02:36:04,507: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.542615735Z [2024-03-28 02:36:04,542: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:36:04.544032080Z [2024-03-28 02:36:04,543: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.544178561Z [2024-03-28 02:36:04,543: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.544478722Z [2024-03-28 02:36:04,544: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.544644251Z [2024-03-28 02:36:04,544: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:36:04.545091220Z [2024-03-28 02:36:04,544: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:36:04.545433568Z [2024-03-28 02:36:04,545: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.549793508Z [2024-03-28 02:36:04,549: ERROR/ForkPoolWorker-2] [9cfc501a-8b09-4438-b92c-cbfb1a6fd872] Failed to execute task Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:36:04.549821837Z Traceback (most recent call last): 2024-03-28T02:36:04.549841755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:36:04.549846112Z args.func(args) 2024-03-28T02:36:04.549849981Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:36:04.549854703Z return func(*args, **kwargs) 2024-03-28T02:36:04.549857962Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:36:04.549861332Z return f(*args, **kwargs) 2024-03-28T02:36:04.549864694Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:36:04.549867897Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:36:04.549871060Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:36:04.549874265Z raise AirflowException( 2024-03-28T02:36:04.549878281Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:36:04.584057562Z [2024-03-28 02:36:04,583: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9cfc501a-8b09-4438-b92c-cbfb1a6fd872] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9cfc501a-8b09-4438-b92c-cbfb1a6fd872') 2024-03-28T02:36:04.584079345Z Traceback (most recent call last): 2024-03-28T02:36:04.584083732Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:36:04.584103772Z R = retval = fun(*args, **kwargs) 2024-03-28T02:36:04.584107238Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:36:04.584110804Z return self.run(*args, **kwargs) 2024-03-28T02:36:04.584132926Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:36:04.584137220Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:36:04.584140588Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:36:04.584144342Z raise AirflowException(msg) 2024-03-28T02:36:04.584148310Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9cfc501a-8b09-4438-b92c-cbfb1a6fd872 2024-03-28T02:36:04.610391830Z [2024-03-28 02:36:04,610: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:36:04.614083384Z [2024-03-28 02:36:04,613: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.650835947Z [2024-03-28 02:36:04,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:36:04.655277060Z [2024-03-28 02:36:04,654: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.655474498Z [2024-03-28 02:36:04,655: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.655635979Z [2024-03-28 02:36:04,655: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.655668635Z [2024-03-28 02:36:04,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:36:04.656221832Z [2024-03-28 02:36:04,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:36:04.656236579Z [2024-03-28 02:36:04,655: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:36:04.656240610Z [2024-03-28 02:36:04,656: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.660462907Z [2024-03-28 02:36:04,659: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.687185069Z [2024-03-28 02:36:04,686: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:36:04.688537069Z [2024-03-28 02:36:04,688: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.688894963Z [2024-03-28 02:36:04,688: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.689292611Z [2024-03-28 02:36:04,688: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.689530382Z [2024-03-28 02:36:04,689: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:36:04.690272375Z [2024-03-28 02:36:04,689: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:36:04.690351801Z [2024-03-28 02:36:04,690: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.700188323Z [2024-03-28 02:36:04,697: WARNING/ForkPoolWorker-16] Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:04.701176611Z [2024-03-28 02:36:04,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:04.702210286Z [2024-03-28 02:36:04,701: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:36:04.705384433Z [2024-03-28 02:36:04,705: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.736596483Z [2024-03-28 02:36:04,736: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:36:04.739022480Z [2024-03-28 02:36:04,738: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.739380048Z [2024-03-28 02:36:04,738: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.739734372Z [2024-03-28 02:36:04,739: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.739916400Z [2024-03-28 02:36:04,739: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:36:04.740387857Z [2024-03-28 02:36:04,740: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:36:04.741111898Z [2024-03-28 02:36:04,740: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.748424532Z [2024-03-28 02:36:04,747: ERROR/ForkPoolWorker-16] [aa702f89-9ede-4980-a4b1-7535de36f330] Failed to execute task Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:36:04.748451738Z Traceback (most recent call last): 2024-03-28T02:36:04.748456130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:36:04.748460021Z args.func(args) 2024-03-28T02:36:04.748463800Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:36:04.748467613Z return func(*args, **kwargs) 2024-03-28T02:36:04.748471812Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:36:04.748475500Z return f(*args, **kwargs) 2024-03-28T02:36:04.748478988Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:36:04.748482130Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:36:04.748485192Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:36:04.748488294Z raise AirflowException( 2024-03-28T02:36:04.748498490Z airflow.exceptions.AirflowException: Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:36:04.767928456Z [2024-03-28 02:36:04,767: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:36:04.781201441Z [2024-03-28 02:36:04,780: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T02:36:04.784757186Z [2024-03-28 02:36:04,784: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:04.803359366Z [2024-03-28 02:36:04,802: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa702f89-9ede-4980-a4b1-7535de36f330] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa702f89-9ede-4980-a4b1-7535de36f330') 2024-03-28T02:36:04.803391879Z Traceback (most recent call last): 2024-03-28T02:36:04.803397204Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:36:04.803400533Z R = retval = fun(*args, **kwargs) 2024-03-28T02:36:04.803403743Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:36:04.803407094Z return self.run(*args, **kwargs) 2024-03-28T02:36:04.803411608Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:36:04.803417296Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:36:04.803420488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:36:04.803425651Z raise AirflowException(msg) 2024-03-28T02:36:04.803430366Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa702f89-9ede-4980-a4b1-7535de36f330 2024-03-28T02:36:04.826039722Z [2024-03-28 02:36:04,825: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:36:04.827584936Z [2024-03-28 02:36:04,827: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:04.827715667Z [2024-03-28 02:36:04,827: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:04.827928837Z [2024-03-28 02:36:04,827: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:04.828009391Z [2024-03-28 02:36:04,827: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T02:36:04.828295007Z [2024-03-28 02:36:04,828: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:36:04.828336204Z [2024-03-28 02:36:04,828: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:04.934856865Z [2024-03-28 02:36:04,934: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:36:06.674719183Z [2024-03-28 02:36:06,674: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1836569a-be68-42e8-8bed-e44fd540bea0] succeeded in 5.577011915000185s: None 2024-03-28T02:36:07.015357487Z [2024-03-28 02:36:07,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6a8e4a4-04c6-4bb2-8b89-62c10cb410b0] succeeded in 5.946286455999143s: None 2024-03-28T02:36:16.439349779Z [2024-03-28 02:36:16,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baa5df37-15c3-40ef-bf40-b89c1f1a9de9] received 2024-03-28T02:36:16.455891156Z [2024-03-28 02:36:16,455: INFO/ForkPoolWorker-15] [baa5df37-15c3-40ef-bf40-b89c1f1a9de9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:36:16.470642384Z [2024-03-28 02:36:16,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fb3889b-9131-43b9-a3b8-d91f968c561c] received 2024-03-28T02:36:16.477804076Z [2024-03-28 02:36:16,477: INFO/ForkPoolWorker-16] [7fb3889b-9131-43b9-a3b8-d91f968c561c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:36:16.811916257Z [2024-03-28 02:36:16,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:16.867105545Z [2024-03-28 02:36:16,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:18.157837939Z [2024-03-28 02:36:18,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:36:18.175707030Z [2024-03-28 02:36:18,171: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:18.247774847Z [2024-03-28 02:36:18,245: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:36:18.247796601Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:18.247801867Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:18.247806723Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:18.247811490Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:36:18.248991087Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:36:18.249030310Z [2024-03-28 02:36:18,247: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:18.258573835Z [2024-03-28 02:36:18,258: WARNING/ForkPoolWorker-16] Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:18.259386069Z [2024-03-28 02:36:18,258: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:36:18.260166930Z [2024-03-28 02:36:18,260: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:36:18.262779128Z [2024-03-28 02:36:18,262: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:18.275223466Z [2024-03-28 02:36:18,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:36:18.276769300Z [2024-03-28 02:36:18,276: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:18.276998479Z [2024-03-28 02:36:18,276: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:18.277260419Z [2024-03-28 02:36:18,276: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:18.277508485Z [2024-03-28 02:36:18,277: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:36:18.277876674Z [2024-03-28 02:36:18,277: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:36:18.278112179Z [2024-03-28 02:36:18,277: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:18.282011551Z [2024-03-28 02:36:18,281: ERROR/ForkPoolWorker-16] [7fb3889b-9131-43b9-a3b8-d91f968c561c] Failed to execute task Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:36:18.282030202Z Traceback (most recent call last): 2024-03-28T02:36:18.282035825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:36:18.282041456Z args.func(args) 2024-03-28T02:36:18.282046312Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:36:18.282065660Z return func(*args, **kwargs) 2024-03-28T02:36:18.282070453Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:36:18.282074615Z return f(*args, **kwargs) 2024-03-28T02:36:18.282078635Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:36:18.282082752Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:36:18.282086914Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:36:18.282090949Z raise AirflowException( 2024-03-28T02:36:18.282097267Z airflow.exceptions.AirflowException: Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:36:18.314236853Z [2024-03-28 02:36:18,313: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7fb3889b-9131-43b9-a3b8-d91f968c561c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7fb3889b-9131-43b9-a3b8-d91f968c561c') 2024-03-28T02:36:18.314301109Z Traceback (most recent call last): 2024-03-28T02:36:18.314308177Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:36:18.314313339Z R = retval = fun(*args, **kwargs) 2024-03-28T02:36:18.314318489Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:36:18.314323447Z return self.run(*args, **kwargs) 2024-03-28T02:36:18.314328931Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:36:18.314363723Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:36:18.314378814Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:36:18.314391600Z raise AirflowException(msg) 2024-03-28T02:36:18.314402421Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7fb3889b-9131-43b9-a3b8-d91f968c561c 2024-03-28T02:36:18.391762567Z [2024-03-28 02:36:18,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:36:18.395608948Z [2024-03-28 02:36:18,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:18.411739652Z [2024-03-28 02:36:18,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:36:18.413337952Z [2024-03-28 02:36:18,412: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:18.413353485Z [2024-03-28 02:36:18,412: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:18.413357892Z [2024-03-28 02:36:18,413: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:18.413361986Z [2024-03-28 02:36:18,413: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:36:18.417496893Z [2024-03-28 02:36:18,414: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:36:18.420281604Z [2024-03-28 02:36:18,414: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:18.426878991Z [2024-03-28 02:36:18,425: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:18.426903002Z [2024-03-28 02:36:18,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:36:18.428247797Z [2024-03-28 02:36:18,427: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:36:18.430293717Z [2024-03-28 02:36:18,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:36:18.471229869Z [2024-03-28 02:36:18,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:36:18.476731643Z [2024-03-28 02:36:18,476: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:36:18.476897312Z [2024-03-28 02:36:18,476: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:36:18.477141828Z [2024-03-28 02:36:18,476: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:36:18.477281395Z [2024-03-28 02:36:18,477: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:36:18.477684172Z [2024-03-28 02:36:18,477: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:36:18.478009967Z [2024-03-28 02:36:18,477: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:36:18.483151493Z [2024-03-28 02:36:18,482: ERROR/ForkPoolWorker-15] [baa5df37-15c3-40ef-bf40-b89c1f1a9de9] Failed to execute task Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:36:18.483170762Z Traceback (most recent call last): 2024-03-28T02:36:18.483177872Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:36:18.483203248Z args.func(args) 2024-03-28T02:36:18.483208985Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:36:18.483215193Z return func(*args, **kwargs) 2024-03-28T02:36:18.483219893Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:36:18.483225021Z return f(*args, **kwargs) 2024-03-28T02:36:18.483229770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:36:18.483234400Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:36:18.483239187Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:36:18.483243708Z raise AirflowException( 2024-03-28T02:36:18.483249167Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:36:18.519218296Z [2024-03-28 02:36:18,518: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[baa5df37-15c3-40ef-bf40-b89c1f1a9de9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id baa5df37-15c3-40ef-bf40-b89c1f1a9de9') 2024-03-28T02:36:18.519241988Z Traceback (most recent call last): 2024-03-28T02:36:18.519246580Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:36:18.519250061Z R = retval = fun(*args, **kwargs) 2024-03-28T02:36:18.519253287Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:36:18.519257014Z return self.run(*args, **kwargs) 2024-03-28T02:36:18.519260836Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:36:18.519265312Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:36:18.519268488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:36:18.519272598Z raise AirflowException(msg) 2024-03-28T02:36:18.519276580Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id baa5df37-15c3-40ef-bf40-b89c1f1a9de9 2024-03-28T02:37:00.288648794Z [2024-03-28 02:37:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8bae141-68dc-4e4b-ba76-241afd975a8a] received 2024-03-28T02:37:00.290913134Z [2024-03-28 02:37:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdc082bb-488b-45be-97d4-204493dcd790] received 2024-03-28T02:37:00.293097741Z [2024-03-28 02:37:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff261be7-0ff5-477f-b732-8703bfe7c21c] received 2024-03-28T02:37:00.294292306Z [2024-03-28 02:37:00,294: INFO/ForkPoolWorker-15] [f8bae141-68dc-4e4b-ba76-241afd975a8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:37:00.300492981Z [2024-03-28 02:37:00,300: INFO/ForkPoolWorker-16] [bdc082bb-488b-45be-97d4-204493dcd790] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:37:00.304430590Z [2024-03-28 02:37:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b9a75d6-4c0f-4697-b935-eae067a83689] received 2024-03-28T02:37:00.310536086Z [2024-03-28 02:37:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46af94e3-e50c-4f63-95c3-00d67b4bce66] received 2024-03-28T02:37:00.310730812Z [2024-03-28 02:37:00,310: INFO/ForkPoolWorker-1] [ff261be7-0ff5-477f-b732-8703bfe7c21c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:37:00.313587581Z [2024-03-28 02:37:00,313: INFO/ForkPoolWorker-2] [0b9a75d6-4c0f-4697-b935-eae067a83689] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:37:00.318869761Z [2024-03-28 02:37:00,318: INFO/ForkPoolWorker-3] [46af94e3-e50c-4f63-95c3-00d67b4bce66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:37:00.614778116Z [2024-03-28 02:37:00,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:00.658601601Z [2024-03-28 02:37:00,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:00.710162721Z [2024-03-28 02:37:00,706: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:00.871578640Z [2024-03-28 02:37:00,867: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:37:00.945565601Z [2024-03-28 02:37:00,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:01.110138759Z [2024-03-28 02:37:01,109: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T02:37:01.114482932Z [2024-03-28 02:37:01,114: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:01.145596877Z [2024-03-28 02:37:01,145: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:37:01.149067355Z [2024-03-28 02:37:01,148: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:37:01.149268734Z [2024-03-28 02:37:01,148: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:37:01.149409077Z [2024-03-28 02:37:01,149: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T02:37:01.149981341Z [2024-03-28 02:37:01,149: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:37:01.269267740Z [2024-03-28 02:37:01,269: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:37:01.876876393Z [2024-03-28 02:37:01,876: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[46af94e3-e50c-4f63-95c3-00d67b4bce66] succeeded in 1.5640990369993233s: None 2024-03-28T02:37:02.074601377Z [2024-03-28 02:37:02,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:37:02.078507669Z [2024-03-28 02:37:02,078: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.126492689Z [2024-03-28 02:37:02,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:37:02.130286779Z [2024-03-28 02:37:02,130: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.130448259Z [2024-03-28 02:37:02,130: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.130656598Z [2024-03-28 02:37:02,130: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.130815086Z [2024-03-28 02:37:02,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:37:02.131134236Z [2024-03-28 02:37:02,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:37:02.131584912Z [2024-03-28 02:37:02,131: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.138035850Z [2024-03-28 02:37:02,137: WARNING/ForkPoolWorker-15] Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:02.139121684Z [2024-03-28 02:37:02,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:02.140032048Z [2024-03-28 02:37:02,139: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:37:02.144471007Z [2024-03-28 02:37:02,144: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.183031774Z [2024-03-28 02:37:02,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:37:02.186767472Z [2024-03-28 02:37:02,186: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.186979143Z [2024-03-28 02:37:02,186: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.187185435Z [2024-03-28 02:37:02,186: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.187254930Z [2024-03-28 02:37:02,187: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:37:02.187583752Z [2024-03-28 02:37:02,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:37:02.187771991Z [2024-03-28 02:37:02,187: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.191557094Z [2024-03-28 02:37:02,190: ERROR/ForkPoolWorker-15] [f8bae141-68dc-4e4b-ba76-241afd975a8a] Failed to execute task Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:37:02.191595548Z Traceback (most recent call last): 2024-03-28T02:37:02.191601010Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:37:02.191610434Z args.func(args) 2024-03-28T02:37:02.191615537Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:37:02.191620215Z return func(*args, **kwargs) 2024-03-28T02:37:02.191624532Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:37:02.191629894Z return f(*args, **kwargs) 2024-03-28T02:37:02.191634188Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:37:02.191638192Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:37:02.191642124Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:37:02.191646284Z raise AirflowException( 2024-03-28T02:37:02.191650934Z airflow.exceptions.AirflowException: Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:37:02.226480110Z [2024-03-28 02:37:02,225: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8bae141-68dc-4e4b-ba76-241afd975a8a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8bae141-68dc-4e4b-ba76-241afd975a8a') 2024-03-28T02:37:02.226510110Z Traceback (most recent call last): 2024-03-28T02:37:02.226514493Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:37:02.226517931Z R = retval = fun(*args, **kwargs) 2024-03-28T02:37:02.226521194Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:37:02.226524867Z return self.run(*args, **kwargs) 2024-03-28T02:37:02.226528808Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:37:02.226532507Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:37:02.226536095Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:37:02.226539976Z raise AirflowException(msg) 2024-03-28T02:37:02.226544134Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8bae141-68dc-4e4b-ba76-241afd975a8a 2024-03-28T02:37:02.259085228Z [2024-03-28 02:37:02,258: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:37:02.264833515Z [2024-03-28 02:37:02,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.288129950Z [2024-03-28 02:37:02,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:37:02.289439495Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.289467810Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.289634959Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.289683638Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:37:02.289953864Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:37:02.289971084Z [2024-03-28 02:37:02,289: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.297042034Z [2024-03-28 02:37:02,296: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:02.297894403Z [2024-03-28 02:37:02,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:02.298794099Z [2024-03-28 02:37:02,298: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:37:02.301931872Z [2024-03-28 02:37:02,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.323534933Z [2024-03-28 02:37:02,323: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:37:02.328454080Z [2024-03-28 02:37:02,328: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.328478117Z [2024-03-28 02:37:02,328: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.328618798Z [2024-03-28 02:37:02,328: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.328737927Z [2024-03-28 02:37:02,328: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:37:02.329063728Z [2024-03-28 02:37:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:37:02.329122545Z [2024-03-28 02:37:02,329: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.332773548Z [2024-03-28 02:37:02,332: ERROR/ForkPoolWorker-16] [bdc082bb-488b-45be-97d4-204493dcd790] Failed to execute task Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:37:02.332810722Z Traceback (most recent call last): 2024-03-28T02:37:02.332816357Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:37:02.332820685Z args.func(args) 2024-03-28T02:37:02.332824967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:37:02.332829544Z return func(*args, **kwargs) 2024-03-28T02:37:02.332832924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:37:02.332836295Z return f(*args, **kwargs) 2024-03-28T02:37:02.332839587Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:37:02.332843021Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:37:02.332846389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:37:02.332868588Z raise AirflowException( 2024-03-28T02:37:02.332873032Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:37:02.371117406Z [2024-03-28 02:37:02,370: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bdc082bb-488b-45be-97d4-204493dcd790] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdc082bb-488b-45be-97d4-204493dcd790') 2024-03-28T02:37:02.371147949Z Traceback (most recent call last): 2024-03-28T02:37:02.371154393Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:37:02.371159945Z R = retval = fun(*args, **kwargs) 2024-03-28T02:37:02.371164662Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:37:02.371169330Z return self.run(*args, **kwargs) 2024-03-28T02:37:02.371175116Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:37:02.371180706Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:37:02.371185966Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:37:02.371191463Z raise AirflowException(msg) 2024-03-28T02:37:02.371197265Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdc082bb-488b-45be-97d4-204493dcd790 2024-03-28T02:37:02.445592710Z [2024-03-28 02:37:02,445: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:37:02.449127902Z [2024-03-28 02:37:02,448: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.468295500Z [2024-03-28 02:37:02,468: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:37:02.469538093Z [2024-03-28 02:37:02,469: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.469551893Z [2024-03-28 02:37:02,469: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.469749751Z [2024-03-28 02:37:02,469: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.469789341Z [2024-03-28 02:37:02,469: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:37:02.470135693Z [2024-03-28 02:37:02,469: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:37:02.470248378Z [2024-03-28 02:37:02,470: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.554270284Z [2024-03-28 02:37:02,553: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:37:02.557712760Z [2024-03-28 02:37:02,557: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:02.568996314Z [2024-03-28 02:37:02,568: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:37:02.581056365Z [2024-03-28 02:37:02,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:37:02.582677519Z [2024-03-28 02:37:02,582: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:02.582803248Z [2024-03-28 02:37:02,582: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:02.582974187Z [2024-03-28 02:37:02,582: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:02.583116228Z [2024-03-28 02:37:02,582: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:37:02.583392023Z [2024-03-28 02:37:02,583: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:37:02.583520368Z [2024-03-28 02:37:02,583: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:02.673980341Z [2024-03-28 02:37:02,673: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:37:04.129961474Z [2024-03-28 02:37:04,129: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff261be7-0ff5-477f-b732-8703bfe7c21c] succeeded in 3.833676351001486s: None 2024-03-28T02:37:04.658587598Z [2024-03-28 02:37:04,658: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b9a75d6-4c0f-4697-b935-eae067a83689] succeeded in 4.351464614999713s: None 2024-03-28T02:37:14.147052871Z [2024-03-28 02:37:14,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9ecf0e3-5c4b-4150-b337-f2abfd77559d] received 2024-03-28T02:37:14.149726286Z [2024-03-28 02:37:14,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[360e8810-4f5b-4dc7-a58c-a8db9e473985] received 2024-03-28T02:37:14.156569060Z [2024-03-28 02:37:14,156: INFO/ForkPoolWorker-15] [e9ecf0e3-5c4b-4150-b337-f2abfd77559d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:37:14.158238802Z [2024-03-28 02:37:14,157: INFO/ForkPoolWorker-16] [360e8810-4f5b-4dc7-a58c-a8db9e473985] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:37:14.439855089Z [2024-03-28 02:37:14,436: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:14.478362380Z [2024-03-28 02:37:14,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:15.586971084Z [2024-03-28 02:37:15,586: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:37:15.590111779Z [2024-03-28 02:37:15,589: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:15.601972934Z [2024-03-28 02:37:15,599: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:37:15.606724188Z [2024-03-28 02:37:15,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:15.614941133Z [2024-03-28 02:37:15,614: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:37:15.616147879Z [2024-03-28 02:37:15,615: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:15.616353688Z [2024-03-28 02:37:15,616: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:15.616561907Z [2024-03-28 02:37:15,616: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:15.616985235Z [2024-03-28 02:37:15,616: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:37:15.617268483Z [2024-03-28 02:37:15,617: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:37:15.617395773Z [2024-03-28 02:37:15,617: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:15.624591415Z [2024-03-28 02:37:15,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:37:15.625828159Z [2024-03-28 02:37:15,625: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:15.625905828Z [2024-03-28 02:37:15,625: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:15.626065758Z [2024-03-28 02:37:15,625: WARNING/ForkPoolWorker-16] Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:15.626171429Z [2024-03-28 02:37:15,625: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:15.626287712Z [2024-03-28 02:37:15,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:37:15.626573917Z [2024-03-28 02:37:15,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:37:15.626695818Z [2024-03-28 02:37:15,626: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:15.627102735Z [2024-03-28 02:37:15,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:37:15.628091430Z [2024-03-28 02:37:15,627: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:37:15.631132901Z [2024-03-28 02:37:15,630: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:15.634065007Z [2024-03-28 02:37:15,633: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:15.635217633Z [2024-03-28 02:37:15,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:37:15.636351153Z [2024-03-28 02:37:15,636: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:37:15.640862075Z [2024-03-28 02:37:15,640: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:37:15.642256496Z [2024-03-28 02:37:15,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:37:15.644060637Z [2024-03-28 02:37:15,643: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:15.644265029Z [2024-03-28 02:37:15,644: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:15.644469365Z [2024-03-28 02:37:15,644: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:15.644597610Z [2024-03-28 02:37:15,644: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:37:15.645215369Z [2024-03-28 02:37:15,644: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:37:15.645370176Z [2024-03-28 02:37:15,645: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:15.650215473Z [2024-03-28 02:37:15,649: ERROR/ForkPoolWorker-16] [360e8810-4f5b-4dc7-a58c-a8db9e473985] Failed to execute task Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:37:15.650228255Z Traceback (most recent call last): 2024-03-28T02:37:15.650232156Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:37:15.650235876Z args.func(args) 2024-03-28T02:37:15.650240048Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:37:15.650243990Z return func(*args, **kwargs) 2024-03-28T02:37:15.650247086Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:37:15.650258268Z return f(*args, **kwargs) 2024-03-28T02:37:15.650261793Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:37:15.650264931Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:37:15.650267991Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:37:15.650270970Z raise AirflowException( 2024-03-28T02:37:15.650274533Z airflow.exceptions.AirflowException: Dag 'vim_status_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:37:15.655147690Z [2024-03-28 02:37:15,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:37:15.656211305Z [2024-03-28 02:37:15,656: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:37:15.656412563Z [2024-03-28 02:37:15,656: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:37:15.656635910Z [2024-03-28 02:37:15,656: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:37:15.656766457Z [2024-03-28 02:37:15,656: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:37:15.657077344Z [2024-03-28 02:37:15,656: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:37:15.657165088Z [2024-03-28 02:37:15,657: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:37:15.660241479Z [2024-03-28 02:37:15,659: ERROR/ForkPoolWorker-15] [e9ecf0e3-5c4b-4150-b337-f2abfd77559d] Failed to execute task Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse.. 2024-03-28T02:37:15.660252331Z Traceback (most recent call last): 2024-03-28T02:37:15.660256033Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-03-28T02:37:15.660259781Z args.func(args) 2024-03-28T02:37:15.660263489Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-03-28T02:37:15.660267277Z return func(*args, **kwargs) 2024-03-28T02:37:15.660270401Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-03-28T02:37:15.660273487Z return f(*args, **kwargs) 2024-03-28T02:37:15.660276607Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-03-28T02:37:15.660280083Z dag = get_dag(args.subdir, args.dag_id) 2024-03-28T02:37:15.660291641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-03-28T02:37:15.660294833Z raise AirflowException( 2024-03-28T02:37:15.660298344Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fdc1706e-fdf9-41b7-8f2a-d034db461edf' could not be found; either it does not exist or it failed to parse. 2024-03-28T02:37:15.682088222Z [2024-03-28 02:37:15,681: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[360e8810-4f5b-4dc7-a58c-a8db9e473985] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 360e8810-4f5b-4dc7-a58c-a8db9e473985') 2024-03-28T02:37:15.682117622Z Traceback (most recent call last): 2024-03-28T02:37:15.682125996Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:37:15.682132618Z R = retval = fun(*args, **kwargs) 2024-03-28T02:37:15.682138767Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:37:15.682145128Z return self.run(*args, **kwargs) 2024-03-28T02:37:15.682152019Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:37:15.682158384Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:37:15.682164091Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:37:15.682170854Z raise AirflowException(msg) 2024-03-28T02:37:15.682177104Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 360e8810-4f5b-4dc7-a58c-a8db9e473985 2024-03-28T02:37:15.697434342Z [2024-03-28 02:37:15,696: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9ecf0e3-5c4b-4150-b337-f2abfd77559d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e9ecf0e3-5c4b-4150-b337-f2abfd77559d') 2024-03-28T02:37:15.697467911Z Traceback (most recent call last): 2024-03-28T02:37:15.697495632Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-03-28T02:37:15.697529606Z R = retval = fun(*args, **kwargs) 2024-03-28T02:37:15.697536639Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-03-28T02:37:15.697543491Z return self.run(*args, **kwargs) 2024-03-28T02:37:15.697551042Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-03-28T02:37:15.697558728Z _execute_in_fork(command_to_exec, celery_task_id) 2024-03-28T02:37:15.697565525Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-03-28T02:37:15.697573377Z raise AirflowException(msg) 2024-03-28T02:37:15.697581401Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e9ecf0e3-5c4b-4150-b337-f2abfd77559d 2024-03-28T02:38:01.050341253Z [2024-03-28 02:38:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5b51f98-a059-4551-9658-f9652a3ddd76] received 2024-03-28T02:38:01.055382317Z [2024-03-28 02:38:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbde6b9f-cb59-4eed-8d14-212bf1bc8ea7] received 2024-03-28T02:38:01.061016544Z [2024-03-28 02:38:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33d10ddd-7839-44d5-a65c-41133d9c07f0] received 2024-03-28T02:38:01.061235704Z [2024-03-28 02:38:01,060: INFO/ForkPoolWorker-15] [b5b51f98-a059-4551-9658-f9652a3ddd76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:38:01.066534796Z [2024-03-28 02:38:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e70b4f6-a88c-4c1f-8c2c-d56abe29a97a] received 2024-03-28T02:38:01.074518705Z [2024-03-28 02:38:01,074: INFO/ForkPoolWorker-16] [cbde6b9f-cb59-4eed-8d14-212bf1bc8ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:38:01.076290249Z [2024-03-28 02:38:01,076: INFO/ForkPoolWorker-2] [0e70b4f6-a88c-4c1f-8c2c-d56abe29a97a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:38:01.092264231Z [2024-03-28 02:38:01,091: INFO/ForkPoolWorker-1] [33d10ddd-7839-44d5-a65c-41133d9c07f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:38:01.507572091Z [2024-03-28 02:38:01,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:38:01.523465550Z [2024-03-28 02:38:01,519: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:38:01.595516066Z [2024-03-28 02:38:01,591: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:38:01.716440381Z [2024-03-28 02:38:01,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:38:01.844703196Z [2024-03-28 02:38:01,844: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:38:01.882466239Z [2024-03-28 02:38:01,881: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:38:01.887033075Z [2024-03-28 02:38:01,886: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:38:01.917267849Z [2024-03-28 02:38:01,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:38:01.924100593Z [2024-03-28 02:38:01,923: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:38:01.924520815Z [2024-03-28 02:38:01,924: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:38:01.924657083Z [2024-03-28 02:38:01,924: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:38:01.925197418Z [2024-03-28 02:38:01,925: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:38:02.024996630Z [2024-03-28 02:38:02,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:38:02.566757963Z [2024-03-28 02:38:02,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33d10ddd-7839-44d5-a65c-41133d9c07f0] succeeded in 1.5034791509988281s: None 2024-03-28T02:38:02.708794754Z [2024-03-28 02:38:02,708: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbde6b9f-cb59-4eed-8d14-212bf1bc8ea7] succeeded in 1.650967629000661s: None 2024-03-28T02:38:03.224452196Z [2024-03-28 02:38:03,223: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:38:03.229775296Z [2024-03-28 02:38:03,228: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:38:03.241904151Z [2024-03-28 02:38:03,241: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:38:03.248574318Z [2024-03-28 02:38:03,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:38:03.260411116Z [2024-03-28 02:38:03,260: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:38:03.261804246Z [2024-03-28 02:38:03,261: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:38:03.262297413Z [2024-03-28 02:38:03,261: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:38:03.262483782Z [2024-03-28 02:38:03,262: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:38:03.262607483Z [2024-03-28 02:38:03,262: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:38:03.262885472Z [2024-03-28 02:38:03,262: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:38:03.263012617Z [2024-03-28 02:38:03,262: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:38:03.276495714Z [2024-03-28 02:38:03,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:38:03.280332167Z [2024-03-28 02:38:03,280: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:38:03.280462862Z [2024-03-28 02:38:03,280: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:38:03.280640654Z [2024-03-28 02:38:03,280: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:38:03.280728825Z [2024-03-28 02:38:03,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:38:03.281084567Z [2024-03-28 02:38:03,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:38:03.281136294Z [2024-03-28 02:38:03,281: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:38:03.357446704Z [2024-03-28 02:38:03,354: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:38:03.406234335Z [2024-03-28 02:38:03,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:38:04.946819635Z [2024-03-28 02:38:04,946: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5b51f98-a059-4551-9658-f9652a3ddd76] succeeded in 3.8947587790007674s: None 2024-03-28T02:38:05.383579984Z [2024-03-28 02:38:05,382: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e70b4f6-a88c-4c1f-8c2c-d56abe29a97a] succeeded in 4.3144630169990705s: None 2024-03-28T02:39:00.813757091Z [2024-03-28 02:39:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72014b71-3884-4825-9a02-de9d1e11d812] received 2024-03-28T02:39:00.819667076Z [2024-03-28 02:39:00,819: INFO/ForkPoolWorker-15] [72014b71-3884-4825-9a02-de9d1e11d812] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:39:00.825214245Z [2024-03-28 02:39:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0e1a597-6983-468f-8171-357119020d50] received 2024-03-28T02:39:00.828288537Z [2024-03-28 02:39:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2cd8a3f-34bd-43f1-837a-8ba012cafed3] received 2024-03-28T02:39:00.838074909Z [2024-03-28 02:39:00,837: INFO/ForkPoolWorker-16] [e0e1a597-6983-468f-8171-357119020d50] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:39:00.842160728Z [2024-03-28 02:39:00,841: INFO/ForkPoolWorker-1] [a2cd8a3f-34bd-43f1-837a-8ba012cafed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:39:01.173252044Z [2024-03-28 02:39:01,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:39:01.315192391Z [2024-03-28 02:39:01,310: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:39:01.422112903Z [2024-03-28 02:39:01,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:39:01.616374668Z [2024-03-28 02:39:01,615: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:39:01.620619081Z [2024-03-28 02:39:01,620: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:39:01.655936341Z [2024-03-28 02:39:01,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:39:01.657689397Z [2024-03-28 02:39:01,657: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:39:01.657742911Z [2024-03-28 02:39:01,657: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:39:01.658100321Z [2024-03-28 02:39:01,657: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:39:01.658416086Z [2024-03-28 02:39:01,658: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:39:01.826259948Z [2024-03-28 02:39:01,825: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:39:02.491912577Z [2024-03-28 02:39:02,491: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0e1a597-6983-468f-8171-357119020d50] succeeded in 1.6605503049995605s: None 2024-03-28T02:39:02.792797635Z [2024-03-28 02:39:02,792: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:39:02.799788650Z [2024-03-28 02:39:02,799: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:39:02.828303533Z [2024-03-28 02:39:02,827: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:39:02.830337499Z [2024-03-28 02:39:02,829: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:39:02.830415492Z [2024-03-28 02:39:02,830: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:39:02.830631502Z [2024-03-28 02:39:02,830: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:39:02.830699644Z [2024-03-28 02:39:02,830: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:39:02.831230995Z [2024-03-28 02:39:02,830: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:39:02.831365243Z [2024-03-28 02:39:02,831: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:39:02.930991457Z [2024-03-28 02:39:02,930: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:39:02.934793939Z [2024-03-28 02:39:02,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:39:02.946770191Z [2024-03-28 02:39:02,946: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:39:02.956780456Z [2024-03-28 02:39:02,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:39:02.961380939Z [2024-03-28 02:39:02,961: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:39:02.961693288Z [2024-03-28 02:39:02,961: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:39:02.962080182Z [2024-03-28 02:39:02,961: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:39:02.962304496Z [2024-03-28 02:39:02,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:39:02.962861403Z [2024-03-28 02:39:02,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:39:02.963104101Z [2024-03-28 02:39:02,962: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:39:03.076094349Z [2024-03-28 02:39:03,075: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:39:04.666394851Z [2024-03-28 02:39:04,665: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2cd8a3f-34bd-43f1-837a-8ba012cafed3] succeeded in 3.8366516520000005s: None 2024-03-28T02:39:05.149828909Z [2024-03-28 02:39:05,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72014b71-3884-4825-9a02-de9d1e11d812] succeeded in 4.334459457000776s: None 2024-03-28T02:40:01.247287999Z [2024-03-28 02:40:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da68cde1-2ff5-4f2c-bd06-19ee6b8a02c2] received 2024-03-28T02:40:01.251015016Z [2024-03-28 02:40:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f724a8a7-6db7-45e9-9d36-c8be128853ae] received 2024-03-28T02:40:01.253294620Z [2024-03-28 02:40:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[226f2652-c10e-477c-95f1-4660a1389aba] received 2024-03-28T02:40:01.256830439Z [2024-03-28 02:40:01,256: INFO/ForkPoolWorker-15] [da68cde1-2ff5-4f2c-bd06-19ee6b8a02c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:40:01.262104760Z [2024-03-28 02:40:01,261: INFO/ForkPoolWorker-16] [f724a8a7-6db7-45e9-9d36-c8be128853ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:40:01.262625949Z [2024-03-28 02:40:01,262: INFO/ForkPoolWorker-1] [226f2652-c10e-477c-95f1-4660a1389aba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:40:01.270742180Z [2024-03-28 02:40:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cccea41-731d-4ea7-af97-a79472a4b1cf] received 2024-03-28T02:40:01.276833671Z [2024-03-28 02:40:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48830838-784d-4cfe-9d4c-ffdcb62dac92] received 2024-03-28T02:40:01.280087331Z [2024-03-28 02:40:01,279: INFO/ForkPoolWorker-2] [1cccea41-731d-4ea7-af97-a79472a4b1cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:40:01.286252907Z [2024-03-28 02:40:01,285: INFO/ForkPoolWorker-3] [48830838-784d-4cfe-9d4c-ffdcb62dac92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:40:01.691967238Z [2024-03-28 02:40:01,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:40:01.959561735Z [2024-03-28 02:40:01,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:40:01.975712071Z [2024-03-28 02:40:01,970: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:40:01.990175729Z [2024-03-28 02:40:01,989: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:02.018560976Z [2024-03-28 02:40:02,010: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:40:02.213311931Z [2024-03-28 02:40:02,210: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:40:02.430985546Z [2024-03-28 02:40:02,430: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:40:02.438889810Z [2024-03-28 02:40:02,438: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:02.485348426Z [2024-03-28 02:40:02,485: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:40:02.489831915Z [2024-03-28 02:40:02,489: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:40:02.490266371Z [2024-03-28 02:40:02,489: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:40:02.490431474Z [2024-03-28 02:40:02,490: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:40:02.490800237Z [2024-03-28 02:40:02,490: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:40:02.700853128Z [2024-03-28 02:40:02,700: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:02.880481705Z [2024-03-28 02:40:02,879: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f724a8a7-6db7-45e9-9d36-c8be128853ae] succeeded in 1.6278865519998362s: None 2024-03-28T02:40:03.505123043Z [2024-03-28 02:40:03,504: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[226f2652-c10e-477c-95f1-4660a1389aba] succeeded in 2.2480604780012072s: None 2024-03-28T02:40:03.781640685Z [2024-03-28 02:40:03,775: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:40:03.781666933Z [2024-03-28 02:40:03,779: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:03.804172630Z [2024-03-28 02:40:03,803: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:40:03.805345464Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:03.805384093Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:03.805571408Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:03.805636994Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:40:03.805942633Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:40:03.805952230Z [2024-03-28 02:40:03,805: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:03.893578971Z [2024-03-28 02:40:03,893: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:03.974023900Z [2024-03-28 02:40:03,973: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:40:03.978444910Z [2024-03-28 02:40:03,977: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:04.013002272Z [2024-03-28 02:40:04,012: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:40:04.014489357Z [2024-03-28 02:40:04,014: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:04.014515939Z [2024-03-28 02:40:04,014: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:04.014755930Z [2024-03-28 02:40:04,014: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:04.014847639Z [2024-03-28 02:40:04,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:40:04.015270668Z [2024-03-28 02:40:04,014: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:40:04.015355798Z [2024-03-28 02:40:04,015: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:04.111716587Z [2024-03-28 02:40:04,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:04.162715201Z [2024-03-28 02:40:04,162: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T02:40:04.166189852Z [2024-03-28 02:40:04,165: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:04.187068605Z [2024-03-28 02:40:04,186: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:40:04.188640486Z [2024-03-28 02:40:04,188: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:04.188743948Z [2024-03-28 02:40:04,188: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:04.188916011Z [2024-03-28 02:40:04,188: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:04.188979779Z [2024-03-28 02:40:04,188: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T02:40:04.189232455Z [2024-03-28 02:40:04,189: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:40:04.189719902Z [2024-03-28 02:40:04,189: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:04.283874020Z [2024-03-28 02:40:04,283: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:04.751994388Z [2024-03-28 02:40:04,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da68cde1-2ff5-4f2c-bd06-19ee6b8a02c2] succeeded in 3.5032312570001523s: None 2024-03-28T02:40:05.032755100Z [2024-03-28 02:40:05,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ce603eb-a405-4d29-a221-1dd2c55f25b0] received 2024-03-28T02:40:05.042002409Z [2024-03-28 02:40:05,041: INFO/ForkPoolWorker-15] [6ce603eb-a405-4d29-a221-1dd2c55f25b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:40:05.334027790Z [2024-03-28 02:40:05,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:40:05.850892509Z [2024-03-28 02:40:05,850: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[48830838-784d-4cfe-9d4c-ffdcb62dac92] succeeded in 4.572258778000105s: None 2024-03-28T02:40:05.952634808Z [2024-03-28 02:40:05,951: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1cccea41-731d-4ea7-af97-a79472a4b1cf] succeeded in 4.680150023999886s: None 2024-03-28T02:40:06.497138924Z [2024-03-28 02:40:06,496: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:40:06.500593218Z [2024-03-28 02:40:06,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:06.519725813Z [2024-03-28 02:40:06,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:40:06.521713521Z [2024-03-28 02:40:06,521: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:06.521750942Z [2024-03-28 02:40:06,521: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:06.521888107Z [2024-03-28 02:40:06,521: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:06.521920058Z [2024-03-28 02:40:06,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:40:06.522210294Z [2024-03-28 02:40:06,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:40:06.522225529Z [2024-03-28 02:40:06,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:06.608645468Z [2024-03-28 02:40:06,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:07.285414220Z [2024-03-28 02:40:07,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ce603eb-a405-4d29-a221-1dd2c55f25b0] succeeded in 2.2494577880006545s: None 2024-03-28T02:40:07.944627061Z [2024-03-28 02:40:07,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed4dfff6-eb7d-4ee4-a6be-0a472eff2f31] received 2024-03-28T02:40:07.956088178Z [2024-03-28 02:40:07,955: INFO/ForkPoolWorker-15] [ed4dfff6-eb7d-4ee4-a6be-0a472eff2f31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:40:08.291771236Z [2024-03-28 02:40:08,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:40:09.520621428Z [2024-03-28 02:40:09,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:40:09.527944244Z [2024-03-28 02:40:09,527: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:09.549593458Z [2024-03-28 02:40:09,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:40:09.551074364Z [2024-03-28 02:40:09,550: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:09.551114676Z [2024-03-28 02:40:09,550: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:09.551167279Z [2024-03-28 02:40:09,551: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:09.551231113Z [2024-03-28 02:40:09,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:40:09.551419837Z [2024-03-28 02:40:09,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:40:09.551461472Z [2024-03-28 02:40:09,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:09.665635657Z [2024-03-28 02:40:09,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:10.218014137Z [2024-03-28 02:40:10,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed4dfff6-eb7d-4ee4-a6be-0a472eff2f31] succeeded in 2.2713670850007475s: None 2024-03-28T02:40:10.376079311Z [2024-03-28 02:40:10,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfb0bbbc-4ab8-40a5-8b0f-9467d4bb4433] received 2024-03-28T02:40:10.392773348Z [2024-03-28 02:40:10,392: INFO/ForkPoolWorker-15] [bfb0bbbc-4ab8-40a5-8b0f-9467d4bb4433] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:40:10.780258516Z [2024-03-28 02:40:10,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:40:12.181182102Z [2024-03-28 02:40:12,180: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:40:12.184572817Z [2024-03-28 02:40:12,184: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:40:12.208823161Z [2024-03-28 02:40:12,208: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:40:12.210638272Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:40:12.210649965Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:40:12.214135386Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:40:12.214157098Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:40:12.214164037Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:40:12.214169123Z [2024-03-28 02:40:12,210: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:40:12.322753012Z [2024-03-28 02:40:12,322: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:40:12.909355902Z [2024-03-28 02:40:12,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfb0bbbc-4ab8-40a5-8b0f-9467d4bb4433] succeeded in 2.5299532009994437s: None 2024-03-28T02:41:01.118041592Z [2024-03-28 02:41:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1bd61cc-cee3-414b-b465-4bf47bbeced7] received 2024-03-28T02:41:01.121456022Z [2024-03-28 02:41:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a88b4457-d27e-450c-a341-e38af41c2aba] received 2024-03-28T02:41:01.124961223Z [2024-03-28 02:41:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52c5a36f-ab6a-4f62-ae95-4f2b6616db10] received 2024-03-28T02:41:01.125576319Z [2024-03-28 02:41:01,125: INFO/ForkPoolWorker-15] [d1bd61cc-cee3-414b-b465-4bf47bbeced7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:41:01.132312080Z [2024-03-28 02:41:01,132: INFO/ForkPoolWorker-16] [a88b4457-d27e-450c-a341-e38af41c2aba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:41:01.135912448Z [2024-03-28 02:41:01,135: INFO/ForkPoolWorker-1] [52c5a36f-ab6a-4f62-ae95-4f2b6616db10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:41:01.425823118Z [2024-03-28 02:41:01,422: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:41:01.471563707Z [2024-03-28 02:41:01,468: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:41:01.476517838Z [2024-03-28 02:41:01,472: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:41:01.642080491Z [2024-03-28 02:41:01,641: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T02:41:01.646170954Z [2024-03-28 02:41:01,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:41:01.672327806Z [2024-03-28 02:41:01,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:41:01.673922816Z [2024-03-28 02:41:01,673: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:41:01.674123414Z [2024-03-28 02:41:01,673: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:41:01.674276987Z [2024-03-28 02:41:01,674: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T02:41:01.674513290Z [2024-03-28 02:41:01,674: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:41:01.773295034Z [2024-03-28 02:41:01,772: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:41:02.595736560Z [2024-03-28 02:41:02,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1bd61cc-cee3-414b-b465-4bf47bbeced7] succeeded in 1.4754205209992506s: None 2024-03-28T02:41:02.885588407Z [2024-03-28 02:41:02,885: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:41:02.888914802Z [2024-03-28 02:41:02,888: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:41:02.910869944Z [2024-03-28 02:41:02,910: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:41:02.912084428Z [2024-03-28 02:41:02,911: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:41:02.912098865Z [2024-03-28 02:41:02,911: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:41:02.912176490Z [2024-03-28 02:41:02,912: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:41:02.912246219Z [2024-03-28 02:41:02,912: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:41:02.912513711Z [2024-03-28 02:41:02,912: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:41:02.912566656Z [2024-03-28 02:41:02,912: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:41:03.013391184Z [2024-03-28 02:41:03,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:41:03.023313392Z [2024-03-28 02:41:03,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:41:03.027103761Z [2024-03-28 02:41:03,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:41:03.049539122Z [2024-03-28 02:41:03,049: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:41:03.055198210Z [2024-03-28 02:41:03,054: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:41:03.055292027Z [2024-03-28 02:41:03,055: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:41:03.055341210Z [2024-03-28 02:41:03,055: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:41:03.055346427Z [2024-03-28 02:41:03,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:41:03.055589105Z [2024-03-28 02:41:03,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:41:03.055598070Z [2024-03-28 02:41:03,055: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:41:03.171659590Z [2024-03-28 02:41:03,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:41:05.094280670Z [2024-03-28 02:41:05,093: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52c5a36f-ab6a-4f62-ae95-4f2b6616db10] succeeded in 3.966535613000815s: None 2024-03-28T02:41:05.964579673Z [2024-03-28 02:41:05,964: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a88b4457-d27e-450c-a341-e38af41c2aba] succeeded in 4.837746479999623s: None 2024-03-28T02:42:00.878212365Z [2024-03-28 02:42:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[881f2c2a-56e6-496d-a077-53c2f0ab55a7] received 2024-03-28T02:42:00.881758204Z [2024-03-28 02:42:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e49c4781-cebf-4dc8-96fb-05165f69870b] received 2024-03-28T02:42:00.884553846Z [2024-03-28 02:42:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48ec5ca3-ab32-4e42-81d0-970a627aa761] received 2024-03-28T02:42:00.885145571Z [2024-03-28 02:42:00,884: INFO/ForkPoolWorker-15] [881f2c2a-56e6-496d-a077-53c2f0ab55a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:42:00.886254643Z [2024-03-28 02:42:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba459738-acac-4101-a678-90bc655a0d10] received 2024-03-28T02:42:00.894539129Z [2024-03-28 02:42:00,894: INFO/ForkPoolWorker-1] [48ec5ca3-ab32-4e42-81d0-970a627aa761] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:42:00.894703904Z [2024-03-28 02:42:00,893: INFO/ForkPoolWorker-16] [e49c4781-cebf-4dc8-96fb-05165f69870b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:42:00.898049095Z [2024-03-28 02:42:00,897: INFO/ForkPoolWorker-2] [ba459738-acac-4101-a678-90bc655a0d10] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:42:01.241560065Z [2024-03-28 02:42:01,238: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:42:01.251742191Z [2024-03-28 02:42:01,248: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:42:01.369004486Z [2024-03-28 02:42:01,365: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:42:01.421775242Z [2024-03-28 02:42:01,420: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:42:01.426330420Z [2024-03-28 02:42:01,425: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:42:01.453049054Z [2024-03-28 02:42:01,452: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:42:01.455971169Z [2024-03-28 02:42:01,455: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:42:01.456166333Z [2024-03-28 02:42:01,455: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:42:01.456275677Z [2024-03-28 02:42:01,456: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:42:01.457100755Z [2024-03-28 02:42:01,456: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:42:01.515769352Z [2024-03-28 02:42:01,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:42:01.590323402Z [2024-03-28 02:42:01,589: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:42:01.626300155Z [2024-03-28 02:42:01,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:42:02.347512189Z [2024-03-28 02:42:02,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[881f2c2a-56e6-496d-a077-53c2f0ab55a7] succeeded in 1.467677642000126s: None 2024-03-28T02:42:02.402492058Z [2024-03-28 02:42:02,402: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba459738-acac-4101-a678-90bc655a0d10] succeeded in 1.5148226550008985s: None 2024-03-28T02:42:02.811688262Z [2024-03-28 02:42:02,811: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:42:02.819095555Z [2024-03-28 02:42:02,818: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:42:02.840417315Z [2024-03-28 02:42:02,840: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:42:02.842085835Z [2024-03-28 02:42:02,841: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:42:02.842292804Z [2024-03-28 02:42:02,841: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:42:02.842548047Z [2024-03-28 02:42:02,842: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:42:02.842737670Z [2024-03-28 02:42:02,842: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:42:02.843280277Z [2024-03-28 02:42:02,843: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:42:02.843468315Z [2024-03-28 02:42:02,843: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:42:02.957354475Z [2024-03-28 02:42:02,956: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:42:03.158172781Z [2024-03-28 02:42:03,156: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:42:03.160525753Z [2024-03-28 02:42:03,159: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:42:03.197241208Z [2024-03-28 02:42:03,196: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:42:03.199256095Z [2024-03-28 02:42:03,198: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:42:03.199311118Z [2024-03-28 02:42:03,199: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:42:03.199462441Z [2024-03-28 02:42:03,199: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:42:03.199535414Z [2024-03-28 02:42:03,199: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:42:03.200109190Z [2024-03-28 02:42:03,199: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:42:03.200191783Z [2024-03-28 02:42:03,200: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:42:03.317266265Z [2024-03-28 02:42:03,316: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:42:04.876787432Z [2024-03-28 02:42:04,876: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e49c4781-cebf-4dc8-96fb-05165f69870b] succeeded in 3.9929734769993956s: None 2024-03-28T02:42:05.547498582Z [2024-03-28 02:42:05,546: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48ec5ca3-ab32-4e42-81d0-970a627aa761] succeeded in 4.661056260998521s: None 2024-03-28T02:43:00.717307651Z [2024-03-28 02:43:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4427aa70-92cf-4b7d-a81a-a21f88fbd182] received 2024-03-28T02:43:00.723749061Z [2024-03-28 02:43:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32d4d334-a18c-45ae-9166-5a79997bb4c7] received 2024-03-28T02:43:00.729818375Z [2024-03-28 02:43:00,729: INFO/ForkPoolWorker-15] [4427aa70-92cf-4b7d-a81a-a21f88fbd182] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:43:00.733794745Z [2024-03-28 02:43:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5a0f2f4-db2b-42c4-92de-f5f8ea99d670] received 2024-03-28T02:43:00.751742495Z [2024-03-28 02:43:00,751: INFO/ForkPoolWorker-1] [c5a0f2f4-db2b-42c4-92de-f5f8ea99d670] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:43:00.761835977Z [2024-03-28 02:43:00,761: INFO/ForkPoolWorker-16] [32d4d334-a18c-45ae-9166-5a79997bb4c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:43:01.328271110Z [2024-03-28 02:43:01,322: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:43:01.476649481Z [2024-03-28 02:43:01,463: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:43:01.595000010Z [2024-03-28 02:43:01,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:43:01.779369172Z [2024-03-28 02:43:01,778: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:43:01.808995172Z [2024-03-28 02:43:01,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:43:01.904962654Z [2024-03-28 02:43:01,904: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:43:01.915202311Z [2024-03-28 02:43:01,914: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:43:01.915504513Z [2024-03-28 02:43:01,915: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:43:01.915682973Z [2024-03-28 02:43:01,915: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:43:01.916013540Z [2024-03-28 02:43:01,915: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:43:02.274574845Z [2024-03-28 02:43:02,274: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:43:04.009131439Z [2024-03-28 02:43:04,008: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:43:04.013115640Z [2024-03-28 02:43:04,012: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:43:04.078450008Z [2024-03-28 02:43:04,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:43:04.084901319Z [2024-03-28 02:43:04,084: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:43:04.085129672Z [2024-03-28 02:43:04,084: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:43:04.085397371Z [2024-03-28 02:43:04,085: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:43:04.085914125Z [2024-03-28 02:43:04,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:43:04.086535053Z [2024-03-28 02:43:04,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:43:04.087699326Z [2024-03-28 02:43:04,087: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:43:04.341953720Z [2024-03-28 02:43:04,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:43:04.357245718Z [2024-03-28 02:43:04,356: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5a0f2f4-db2b-42c4-92de-f5f8ea99d670] succeeded in 3.6214359639998293s: None 2024-03-28T02:43:04.803640129Z [2024-03-28 02:43:04,803: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:43:04.807004887Z [2024-03-28 02:43:04,806: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:43:04.861180268Z [2024-03-28 02:43:04,860: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:43:04.863881511Z [2024-03-28 02:43:04,863: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:43:04.863905971Z [2024-03-28 02:43:04,863: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:43:04.863965871Z [2024-03-28 02:43:04,863: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:43:04.864130379Z [2024-03-28 02:43:04,863: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:43:04.864638295Z [2024-03-28 02:43:04,864: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:43:04.864766679Z [2024-03-28 02:43:04,864: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:43:05.001924464Z [2024-03-28 02:43:05,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:43:06.449372624Z [2024-03-28 02:43:06,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4427aa70-92cf-4b7d-a81a-a21f88fbd182] succeeded in 5.729793507000068s: None 2024-03-28T02:43:08.990936357Z [2024-03-28 02:43:08,990: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32d4d334-a18c-45ae-9166-5a79997bb4c7] succeeded in 8.25989950299845s: None 2024-03-28T02:44:00.733772764Z [2024-03-28 02:44:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6d639cf-0bf0-4ea1-a82a-87f990c6652b] received 2024-03-28T02:44:00.738368898Z [2024-03-28 02:44:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dfc70e8-8555-4cc3-ade6-a146dc427248] received 2024-03-28T02:44:00.748075443Z [2024-03-28 02:44:00,747: INFO/ForkPoolWorker-15] [b6d639cf-0bf0-4ea1-a82a-87f990c6652b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:44:00.749516257Z [2024-03-28 02:44:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc317e3f-1f01-4121-beb3-ed0208f54918] received 2024-03-28T02:44:00.751249314Z [2024-03-28 02:44:00,750: INFO/ForkPoolWorker-16] [1dfc70e8-8555-4cc3-ade6-a146dc427248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:44:00.752850739Z [2024-03-28 02:44:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb954852-6cfa-439a-b1e8-28d8019bf41b] received 2024-03-28T02:44:00.762795910Z [2024-03-28 02:44:00,762: INFO/ForkPoolWorker-1] [cc317e3f-1f01-4121-beb3-ed0208f54918] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:44:00.769150230Z [2024-03-28 02:44:00,768: INFO/ForkPoolWorker-2] [fb954852-6cfa-439a-b1e8-28d8019bf41b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:44:01.043829292Z [2024-03-28 02:44:01,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:44:01.138020970Z [2024-03-28 02:44:01,134: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:44:01.318200055Z [2024-03-28 02:44:01,315: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:44:01.331056743Z [2024-03-28 02:44:01,327: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:44:01.550201053Z [2024-03-28 02:44:01,549: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:44:01.565970610Z [2024-03-28 02:44:01,565: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:44:01.570389246Z [2024-03-28 02:44:01,569: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:44:01.618562243Z [2024-03-28 02:44:01,618: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:44:01.625612559Z [2024-03-28 02:44:01,625: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:44:01.625655178Z [2024-03-28 02:44:01,625: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:44:01.625689933Z [2024-03-28 02:44:01,625: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:44:01.625909420Z [2024-03-28 02:44:01,625: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:44:01.759000954Z [2024-03-28 02:44:01,758: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:44:02.538881964Z [2024-03-28 02:44:02,538: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6d639cf-0bf0-4ea1-a82a-87f990c6652b] succeeded in 1.8026361869997345s: None 2024-03-28T02:44:02.545037519Z [2024-03-28 02:44:02,544: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb954852-6cfa-439a-b1e8-28d8019bf41b] succeeded in 1.7820869979987037s: None 2024-03-28T02:44:02.693574839Z [2024-03-28 02:44:02,693: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:44:02.697628156Z [2024-03-28 02:44:02,697: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:44:02.723064779Z [2024-03-28 02:44:02,722: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:44:02.724959293Z [2024-03-28 02:44:02,724: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:44:02.725230102Z [2024-03-28 02:44:02,725: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:44:02.725564796Z [2024-03-28 02:44:02,725: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:44:02.725759771Z [2024-03-28 02:44:02,725: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:44:02.726297984Z [2024-03-28 02:44:02,726: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:44:02.726851391Z [2024-03-28 02:44:02,726: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:44:02.779474067Z [2024-03-28 02:44:02,779: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:44:02.783013595Z [2024-03-28 02:44:02,782: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:44:02.804020052Z [2024-03-28 02:44:02,803: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:44:02.805384498Z [2024-03-28 02:44:02,805: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:44:02.805408375Z [2024-03-28 02:44:02,805: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:44:02.805681897Z [2024-03-28 02:44:02,805: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:44:02.805743036Z [2024-03-28 02:44:02,805: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:44:02.806096129Z [2024-03-28 02:44:02,805: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:44:02.806127359Z [2024-03-28 02:44:02,806: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:44:02.880592852Z [2024-03-28 02:44:02,880: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:44:02.892884324Z [2024-03-28 02:44:02,892: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:44:04.853035151Z [2024-03-28 02:44:04,852: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc317e3f-1f01-4121-beb3-ed0208f54918] succeeded in 4.0971491589989455s: None 2024-03-28T02:44:05.419947971Z [2024-03-28 02:44:05,419: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1dfc70e8-8555-4cc3-ade6-a146dc427248] succeeded in 4.677180100999976s: None 2024-03-28T02:45:01.277246916Z [2024-03-28 02:45:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aa7008a-2c94-44b2-8cd2-2b73fc762b2f] received 2024-03-28T02:45:01.281695910Z [2024-03-28 02:45:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[546e99eb-7042-4ac7-be67-7aa21928e9d8] received 2024-03-28T02:45:01.284777847Z [2024-03-28 02:45:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90c23685-c5f2-4cee-a638-bae77b068dd9] received 2024-03-28T02:45:01.285451356Z [2024-03-28 02:45:01,284: INFO/ForkPoolWorker-15] [7aa7008a-2c94-44b2-8cd2-2b73fc762b2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:45:01.292513167Z [2024-03-28 02:45:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f7e3dab-05c3-48b8-a273-cf9e8b30d9a8] received 2024-03-28T02:45:01.297972882Z [2024-03-28 02:45:01,297: INFO/ForkPoolWorker-1] [90c23685-c5f2-4cee-a638-bae77b068dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:45:01.301404279Z [2024-03-28 02:45:01,301: INFO/ForkPoolWorker-16] [546e99eb-7042-4ac7-be67-7aa21928e9d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:45:01.306296630Z [2024-03-28 02:45:01,305: INFO/ForkPoolWorker-2] [5f7e3dab-05c3-48b8-a273-cf9e8b30d9a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:45:01.614097883Z [2024-03-28 02:45:01,609: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:45:01.722512974Z [2024-03-28 02:45:01,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:45:01.722687884Z [2024-03-28 02:45:01,718: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:45:01.755251941Z [2024-03-28 02:45:01,751: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:45:01.995177053Z [2024-03-28 02:45:01,994: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:45:01.999516518Z [2024-03-28 02:45:01,999: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:02.031338680Z [2024-03-28 02:45:02,031: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:45:02.032435701Z [2024-03-28 02:45:02,032: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:45:02.032698976Z [2024-03-28 02:45:02,032: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:45:02.032967591Z [2024-03-28 02:45:02,032: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:45:02.033222661Z [2024-03-28 02:45:02,033: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:45:02.128436481Z [2024-03-28 02:45:02,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:02.806529928Z [2024-03-28 02:45:02,806: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90c23685-c5f2-4cee-a638-bae77b068dd9] succeeded in 1.5154098210005031s: None 2024-03-28T02:45:03.153123592Z [2024-03-28 02:45:03,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:45:03.156851899Z [2024-03-28 02:45:03,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:03.186522675Z [2024-03-28 02:45:03,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:45:03.188865388Z [2024-03-28 02:45:03,188: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:03.188950589Z [2024-03-28 02:45:03,188: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:03.189116675Z [2024-03-28 02:45:03,188: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:03.189218267Z [2024-03-28 02:45:03,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:45:03.189495078Z [2024-03-28 02:45:03,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:45:03.190962296Z [2024-03-28 02:45:03,189: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:03.246433819Z [2024-03-28 02:45:03,245: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:45:03.250554385Z [2024-03-28 02:45:03,250: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:03.292082931Z [2024-03-28 02:45:03,291: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:45:03.297219741Z [2024-03-28 02:45:03,296: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:03.298296446Z [2024-03-28 02:45:03,298: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:03.298498716Z [2024-03-28 02:45:03,298: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:03.298679641Z [2024-03-28 02:45:03,298: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:45:03.299028252Z [2024-03-28 02:45:03,298: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:45:03.312984207Z [2024-03-28 02:45:03,299: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:03.343144669Z [2024-03-28 02:45:03,340: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:03.448578763Z [2024-03-28 02:45:03,448: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:45:03.461521342Z [2024-03-28 02:45:03,457: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:03.531907799Z [2024-03-28 02:45:03,531: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:45:03.535342752Z [2024-03-28 02:45:03,535: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:03.540512060Z [2024-03-28 02:45:03,540: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:03.540602453Z [2024-03-28 02:45:03,540: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:03.540811579Z [2024-03-28 02:45:03,540: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:03.540938637Z [2024-03-28 02:45:03,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:45:03.541406243Z [2024-03-28 02:45:03,541: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:45:03.541550634Z [2024-03-28 02:45:03,541: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:03.777661984Z [2024-03-28 02:45:03,774: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:04.636075525Z [2024-03-28 02:45:04,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[546e99eb-7042-4ac7-be67-7aa21928e9d8] succeeded in 3.350118520000251s: None 2024-03-28T02:45:05.084721963Z [2024-03-28 02:45:05,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7aa7008a-2c94-44b2-8cd2-2b73fc762b2f] succeeded in 3.8054741230007494s: None 2024-03-28T02:45:05.457856137Z [2024-03-28 02:45:05,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9a57fa5-8aa5-43f2-8656-b9c817c8a838] received 2024-03-28T02:45:05.470650539Z [2024-03-28 02:45:05,470: INFO/ForkPoolWorker-15] [d9a57fa5-8aa5-43f2-8656-b9c817c8a838] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:45:05.757605233Z [2024-03-28 02:45:05,756: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5f7e3dab-05c3-48b8-a273-cf9e8b30d9a8] succeeded in 4.461018531001173s: None 2024-03-28T02:45:05.822774839Z [2024-03-28 02:45:05,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:45:07.020527980Z [2024-03-28 02:45:07,020: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:45:07.023928474Z [2024-03-28 02:45:07,023: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:07.041941880Z [2024-03-28 02:45:07,041: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:45:07.043576829Z [2024-03-28 02:45:07,043: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:07.043680086Z [2024-03-28 02:45:07,043: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:07.043824725Z [2024-03-28 02:45:07,043: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:07.043897051Z [2024-03-28 02:45:07,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:45:07.044188075Z [2024-03-28 02:45:07,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:45:07.044257146Z [2024-03-28 02:45:07,044: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:07.158446272Z [2024-03-28 02:45:07,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:07.773918541Z [2024-03-28 02:45:07,773: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9a57fa5-8aa5-43f2-8656-b9c817c8a838] succeeded in 2.3124951910012896s: None 2024-03-28T02:45:08.173300228Z [2024-03-28 02:45:08,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90eb1da8-f1b6-4585-8cf2-d2196f4d1f62] received 2024-03-28T02:45:08.177145418Z [2024-03-28 02:45:08,174: INFO/ForkPoolWorker-15] [90eb1da8-f1b6-4585-8cf2-d2196f4d1f62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:45:08.739320088Z [2024-03-28 02:45:08,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:45:09.965535648Z [2024-03-28 02:45:09,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:45:09.969187216Z [2024-03-28 02:45:09,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:10.001127730Z [2024-03-28 02:45:10,000: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:45:10.003628897Z [2024-03-28 02:45:10,003: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:10.003904838Z [2024-03-28 02:45:10,003: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:10.004288253Z [2024-03-28 02:45:10,004: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:10.004480763Z [2024-03-28 02:45:10,004: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:45:10.004912967Z [2024-03-28 02:45:10,004: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:45:10.005583699Z [2024-03-28 02:45:10,005: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:10.102852623Z [2024-03-28 02:45:10,102: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:10.702323084Z [2024-03-28 02:45:10,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90eb1da8-f1b6-4585-8cf2-d2196f4d1f62] succeeded in 2.5326449169988337s: None 2024-03-28T02:45:11.592045024Z [2024-03-28 02:45:11,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7423881a-508a-406a-8249-de23422a320b] received 2024-03-28T02:45:11.606159035Z [2024-03-28 02:45:11,605: INFO/ForkPoolWorker-15] [7423881a-508a-406a-8249-de23422a320b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:45:11.934927194Z [2024-03-28 02:45:11,931: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:45:13.098342966Z [2024-03-28 02:45:13,097: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:45:13.102085912Z [2024-03-28 02:45:13,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:45:13.122638184Z [2024-03-28 02:45:13,122: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:45:13.124146694Z [2024-03-28 02:45:13,123: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:45:13.124274297Z [2024-03-28 02:45:13,124: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:45:13.124489685Z [2024-03-28 02:45:13,124: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:45:13.124641056Z [2024-03-28 02:45:13,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:45:13.125349428Z [2024-03-28 02:45:13,125: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:45:13.125460844Z [2024-03-28 02:45:13,125: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:45:13.213153880Z [2024-03-28 02:45:13,212: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:45:13.775614072Z [2024-03-28 02:45:13,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7423881a-508a-406a-8249-de23422a320b] succeeded in 2.177034107000509s: None 2024-03-28T02:46:01.071272104Z [2024-03-28 02:46:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87895cd7-3350-4597-b9b1-fe0dd4e2949c] received 2024-03-28T02:46:01.076378394Z [2024-03-28 02:46:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c804d99-5550-4ed9-8b5e-cb356d6feee8] received 2024-03-28T02:46:01.078266493Z [2024-03-28 02:46:01,077: INFO/ForkPoolWorker-15] [87895cd7-3350-4597-b9b1-fe0dd4e2949c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:46:01.079399253Z [2024-03-28 02:46:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44009c26-2719-40cb-8d69-b45c0b6e93c4] received 2024-03-28T02:46:01.085553735Z [2024-03-28 02:46:01,085: INFO/ForkPoolWorker-16] [2c804d99-5550-4ed9-8b5e-cb356d6feee8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:46:01.092393100Z [2024-03-28 02:46:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd93b32-0ebf-4590-a7fb-a4ee5297f1b7] received 2024-03-28T02:46:01.094643958Z [2024-03-28 02:46:01,094: INFO/ForkPoolWorker-1] [44009c26-2719-40cb-8d69-b45c0b6e93c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:46:01.100752279Z [2024-03-28 02:46:01,100: INFO/ForkPoolWorker-2] [6bd93b32-0ebf-4590-a7fb-a4ee5297f1b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:46:01.451624675Z [2024-03-28 02:46:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:46:01.562712922Z [2024-03-28 02:46:01,553: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:46:01.637615492Z [2024-03-28 02:46:01,633: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:46:01.738699817Z [2024-03-28 02:46:01,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:46:01.908915793Z [2024-03-28 02:46:01,908: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:46:01.918160143Z [2024-03-28 02:46:01,917: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:46:01.966849521Z [2024-03-28 02:46:01,966: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:46:01.968713057Z [2024-03-28 02:46:01,968: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:46:01.968850199Z [2024-03-28 02:46:01,968: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:46:01.968913432Z [2024-03-28 02:46:01,968: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:46:01.969234727Z [2024-03-28 02:46:01,969: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:46:02.158907655Z [2024-03-28 02:46:02,158: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:46:02.225786715Z [2024-03-28 02:46:02,225: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:46:02.858971047Z [2024-03-28 02:46:02,858: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44009c26-2719-40cb-8d69-b45c0b6e93c4] succeeded in 1.7722382820011262s: None 2024-03-28T02:46:03.027582537Z [2024-03-28 02:46:03,027: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c804d99-5550-4ed9-8b5e-cb356d6feee8] succeeded in 1.9469619119990966s: None 2024-03-28T02:46:03.258422278Z [2024-03-28 02:46:03,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:46:03.264412910Z [2024-03-28 02:46:03,263: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:46:03.287268446Z [2024-03-28 02:46:03,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:46:03.289097954Z [2024-03-28 02:46:03,288: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:46:03.289274639Z [2024-03-28 02:46:03,289: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:46:03.289624016Z [2024-03-28 02:46:03,289: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:46:03.289804716Z [2024-03-28 02:46:03,289: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:46:03.290262375Z [2024-03-28 02:46:03,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:46:03.290436928Z [2024-03-28 02:46:03,290: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:46:03.379015248Z [2024-03-28 02:46:03,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:46:03.594850691Z [2024-03-28 02:46:03,594: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:46:03.602996889Z [2024-03-28 02:46:03,602: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:46:03.665365428Z [2024-03-28 02:46:03,665: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:46:03.668109883Z [2024-03-28 02:46:03,667: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:46:03.668198533Z [2024-03-28 02:46:03,668: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:46:03.668373629Z [2024-03-28 02:46:03,668: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:46:03.668500203Z [2024-03-28 02:46:03,668: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:46:03.668781051Z [2024-03-28 02:46:03,668: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:46:03.668925681Z [2024-03-28 02:46:03,668: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:46:03.805624832Z [2024-03-28 02:46:03,799: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:46:04.963211345Z [2024-03-28 02:46:04,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87895cd7-3350-4597-b9b1-fe0dd4e2949c] succeeded in 3.8901985149987013s: None 2024-03-28T02:46:05.657996652Z [2024-03-28 02:46:05,657: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6bd93b32-0ebf-4590-a7fb-a4ee5297f1b7] succeeded in 4.562761298000623s: None 2024-03-28T02:47:00.938507684Z [2024-03-28 02:47:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bccc6fe-5e19-4cdb-a8ca-37db3603adb7] received 2024-03-28T02:47:00.940300393Z [2024-03-28 02:47:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8deb4fb-c5c2-4c03-89da-05973e2d6bfb] received 2024-03-28T02:47:00.948656040Z [2024-03-28 02:47:00,948: INFO/ForkPoolWorker-16] [b8deb4fb-c5c2-4c03-89da-05973e2d6bfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:47:00.949032510Z [2024-03-28 02:47:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e6b9dba-ccc3-4166-a2ce-b5b7506ef106] received 2024-03-28T02:47:00.951586815Z [2024-03-28 02:47:00,951: INFO/ForkPoolWorker-15] [4bccc6fe-5e19-4cdb-a8ca-37db3603adb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:47:00.961098931Z [2024-03-28 02:47:00,960: INFO/ForkPoolWorker-1] [4e6b9dba-ccc3-4166-a2ce-b5b7506ef106] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:47:01.289437432Z [2024-03-28 02:47:01,285: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:47:01.353292532Z [2024-03-28 02:47:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:47:01.541540498Z [2024-03-28 02:47:01,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:47:01.831078639Z [2024-03-28 02:47:01,830: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:47:01.839255857Z [2024-03-28 02:47:01,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:47:01.890916798Z [2024-03-28 02:47:01,890: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:47:01.894508504Z [2024-03-28 02:47:01,894: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:47:01.894947516Z [2024-03-28 02:47:01,894: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:47:01.895216615Z [2024-03-28 02:47:01,895: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:47:01.895710680Z [2024-03-28 02:47:01,895: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:47:02.030790608Z [2024-03-28 02:47:02,030: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:47:02.584055771Z [2024-03-28 02:47:02,583: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:47:02.588079829Z [2024-03-28 02:47:02,587: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:47:02.607092599Z [2024-03-28 02:47:02,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:47:02.608756415Z [2024-03-28 02:47:02,608: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:47:02.608919776Z [2024-03-28 02:47:02,608: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:47:02.609067238Z [2024-03-28 02:47:02,608: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:47:02.609187752Z [2024-03-28 02:47:02,609: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:47:02.609576129Z [2024-03-28 02:47:02,609: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:47:02.609987809Z [2024-03-28 02:47:02,609: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:47:02.625119822Z [2024-03-28 02:47:02,624: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:47:02.629153622Z [2024-03-28 02:47:02,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:47:02.667523987Z [2024-03-28 02:47:02,667: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:47:02.669120725Z [2024-03-28 02:47:02,668: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:47:02.669179900Z [2024-03-28 02:47:02,669: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:47:02.669339672Z [2024-03-28 02:47:02,669: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:47:02.669412667Z [2024-03-28 02:47:02,669: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:47:02.669822481Z [2024-03-28 02:47:02,669: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:47:02.669842110Z [2024-03-28 02:47:02,669: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:47:02.714469352Z [2024-03-28 02:47:02,713: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:47:02.717386622Z [2024-03-28 02:47:02,716: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e6b9dba-ccc3-4166-a2ce-b5b7506ef106] succeeded in 1.7655745319989364s: None 2024-03-28T02:47:02.756930430Z [2024-03-28 02:47:02,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:47:04.416991868Z [2024-03-28 02:47:04,416: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8deb4fb-c5c2-4c03-89da-05973e2d6bfb] succeeded in 3.473646884000118s: None 2024-03-28T02:47:05.023758414Z [2024-03-28 02:47:05,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bccc6fe-5e19-4cdb-a8ca-37db3603adb7] succeeded in 4.081688067000869s: None 2024-03-28T02:48:00.748163778Z [2024-03-28 02:48:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66f579e5-a599-4fcb-8d2d-ee26346740ee] received 2024-03-28T02:48:00.754568374Z [2024-03-28 02:48:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bccc49b9-bf87-4321-814d-a0655deaca4d] received 2024-03-28T02:48:00.773771071Z [2024-03-28 02:48:00,773: INFO/ForkPoolWorker-16] [bccc49b9-bf87-4321-814d-a0655deaca4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:48:00.778263511Z [2024-03-28 02:48:00,777: INFO/ForkPoolWorker-15] [66f579e5-a599-4fcb-8d2d-ee26346740ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:48:00.787007094Z [2024-03-28 02:48:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbfb8340-e768-4dc6-80d6-1eaee836b78a] received 2024-03-28T02:48:00.791489886Z [2024-03-28 02:48:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4404f577-3c01-4593-83a7-93632f48250c] received 2024-03-28T02:48:00.797556502Z [2024-03-28 02:48:00,797: INFO/ForkPoolWorker-1] [bbfb8340-e768-4dc6-80d6-1eaee836b78a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:48:00.803388359Z [2024-03-28 02:48:00,801: INFO/ForkPoolWorker-2] [4404f577-3c01-4593-83a7-93632f48250c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:48:01.321026053Z [2024-03-28 02:48:01,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:48:01.348461351Z [2024-03-28 02:48:01,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:48:01.358525143Z [2024-03-28 02:48:01,352: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:48:01.403264283Z [2024-03-28 02:48:01,399: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:48:01.635019979Z [2024-03-28 02:48:01,634: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:48:01.647869644Z [2024-03-28 02:48:01,647: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:48:01.703143230Z [2024-03-28 02:48:01,702: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:48:01.705399461Z [2024-03-28 02:48:01,705: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:48:01.706654376Z [2024-03-28 02:48:01,706: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:48:01.706733392Z [2024-03-28 02:48:01,706: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:48:01.706983629Z [2024-03-28 02:48:01,706: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:48:01.788120952Z [2024-03-28 02:48:01,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:48:01.902723785Z [2024-03-28 02:48:01,902: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:48:02.971297632Z [2024-03-28 02:48:02,970: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4404f577-3c01-4593-83a7-93632f48250c] succeeded in 2.1767798620003305s: None 2024-03-28T02:48:03.062616449Z [2024-03-28 02:48:03,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66f579e5-a599-4fcb-8d2d-ee26346740ee] succeeded in 2.304745270999774s: None 2024-03-28T02:48:03.222759252Z [2024-03-28 02:48:03,222: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:48:03.229400943Z [2024-03-28 02:48:03,228: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:48:03.268879778Z [2024-03-28 02:48:03,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:48:03.270938186Z [2024-03-28 02:48:03,270: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:48:03.271248041Z [2024-03-28 02:48:03,270: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:48:03.271599946Z [2024-03-28 02:48:03,271: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:48:03.271771202Z [2024-03-28 02:48:03,271: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:48:03.272272395Z [2024-03-28 02:48:03,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:48:03.272510002Z [2024-03-28 02:48:03,272: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:48:03.422681202Z [2024-03-28 02:48:03,422: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:48:03.512014671Z [2024-03-28 02:48:03,511: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:48:03.519461828Z [2024-03-28 02:48:03,518: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:48:03.557584039Z [2024-03-28 02:48:03,556: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:48:03.560311856Z [2024-03-28 02:48:03,559: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:48:03.560579867Z [2024-03-28 02:48:03,560: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:48:03.561250641Z [2024-03-28 02:48:03,560: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:48:03.561515767Z [2024-03-28 02:48:03,561: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:48:03.562012583Z [2024-03-28 02:48:03,561: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:48:03.562530644Z [2024-03-28 02:48:03,562: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:48:03.703667644Z [2024-03-28 02:48:03,703: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:48:05.872522157Z [2024-03-28 02:48:05,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbfb8340-e768-4dc6-80d6-1eaee836b78a] succeeded in 5.082724290001352s: None 2024-03-28T02:48:06.477834948Z [2024-03-28 02:48:06,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bccc49b9-bf87-4321-814d-a0655deaca4d] succeeded in 5.713401846000124s: None 2024-03-28T02:49:00.272290034Z [2024-03-28 02:49:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bf04bf0-4f4c-4f11-a353-81145e013a9f] received 2024-03-28T02:49:00.277794619Z [2024-03-28 02:49:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1342538-4713-4840-b272-0af38ce1cc92] received 2024-03-28T02:49:00.279192810Z [2024-03-28 02:49:00,278: INFO/ForkPoolWorker-15] [1bf04bf0-4f4c-4f11-a353-81145e013a9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:49:00.280394841Z [2024-03-28 02:49:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[274e42b9-daed-4939-b5c3-0dc324dbc126] received 2024-03-28T02:49:00.286867356Z [2024-03-28 02:49:00,286: INFO/ForkPoolWorker-1] [274e42b9-daed-4939-b5c3-0dc324dbc126] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:49:00.290199893Z [2024-03-28 02:49:00,289: INFO/ForkPoolWorker-16] [d1342538-4713-4840-b272-0af38ce1cc92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:49:00.583674197Z [2024-03-28 02:49:00,580: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:49:00.603359038Z [2024-03-28 02:49:00,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:49:00.612845595Z [2024-03-28 02:49:00,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:49:00.797497227Z [2024-03-28 02:49:00,796: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:49:00.802499568Z [2024-03-28 02:49:00,802: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:49:00.827112367Z [2024-03-28 02:49:00,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:49:00.828397434Z [2024-03-28 02:49:00,828: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:49:00.828591765Z [2024-03-28 02:49:00,828: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:49:00.828751013Z [2024-03-28 02:49:00,828: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:49:00.829030812Z [2024-03-28 02:49:00,828: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:49:00.924043978Z [2024-03-28 02:49:00,923: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:49:01.487257196Z [2024-03-28 02:49:01,486: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[274e42b9-daed-4939-b5c3-0dc324dbc126] succeeded in 1.2047584470001311s: None 2024-03-28T02:49:01.868600990Z [2024-03-28 02:49:01,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:49:01.872471733Z [2024-03-28 02:49:01,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:49:01.898287246Z [2024-03-28 02:49:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:49:01.899912657Z [2024-03-28 02:49:01,899: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:49:01.899961045Z [2024-03-28 02:49:01,899: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:49:01.900153714Z [2024-03-28 02:49:01,899: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:49:01.900414453Z [2024-03-28 02:49:01,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:49:01.900720614Z [2024-03-28 02:49:01,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:49:01.900881094Z [2024-03-28 02:49:01,900: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:49:01.969707330Z [2024-03-28 02:49:01,969: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:49:01.973376301Z [2024-03-28 02:49:01,972: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:49:01.983123282Z [2024-03-28 02:49:01,982: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:49:01.996298739Z [2024-03-28 02:49:01,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:49:01.997561397Z [2024-03-28 02:49:01,997: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:49:01.997583952Z [2024-03-28 02:49:01,997: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:49:01.997684441Z [2024-03-28 02:49:01,997: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:49:01.997699641Z [2024-03-28 02:49:01,997: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:49:01.998007509Z [2024-03-28 02:49:01,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:49:01.998205687Z [2024-03-28 02:49:01,998: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:49:02.081896926Z [2024-03-28 02:49:02,081: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:49:03.892264531Z [2024-03-28 02:49:03,891: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1342538-4713-4840-b272-0af38ce1cc92] succeeded in 3.6127860769993276s: None 2024-03-28T02:49:04.446684314Z [2024-03-28 02:49:04,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bf04bf0-4f4c-4f11-a353-81145e013a9f] succeeded in 4.171875743000783s: None 2024-03-28T02:50:00.783009109Z [2024-03-28 02:50:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28831a5d-837f-4f41-836a-22dbf6d99c6d] received 2024-03-28T02:50:00.786300341Z [2024-03-28 02:50:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d54b4c-75b6-4bdb-be77-2a23ced85527] received 2024-03-28T02:50:00.788095783Z [2024-03-28 02:50:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ed645ee-3977-4c26-9f97-23edc10d383d] received 2024-03-28T02:50:00.790002511Z [2024-03-28 02:50:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d9e08f0-306f-479f-82c3-53e95b1fed75] received 2024-03-28T02:50:00.791790554Z [2024-03-28 02:50:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7162a78a-665e-410f-b712-eca3ebfd33f0] received 2024-03-28T02:50:00.799916382Z [2024-03-28 02:50:00,799: INFO/ForkPoolWorker-16] [77d54b4c-75b6-4bdb-be77-2a23ced85527] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:50:00.800619067Z [2024-03-28 02:50:00,800: INFO/ForkPoolWorker-15] [28831a5d-837f-4f41-836a-22dbf6d99c6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:50:00.812549597Z [2024-03-28 02:50:00,811: INFO/ForkPoolWorker-3] [7162a78a-665e-410f-b712-eca3ebfd33f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:50:00.813135667Z [2024-03-28 02:50:00,812: INFO/ForkPoolWorker-1] [9ed645ee-3977-4c26-9f97-23edc10d383d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:50:00.813329788Z [2024-03-28 02:50:00,810: INFO/ForkPoolWorker-2] [8d9e08f0-306f-479f-82c3-53e95b1fed75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:50:01.190364995Z [2024-03-28 02:50:01,186: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:50:01.226243981Z [2024-03-28 02:50:01,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:50:01.233277619Z [2024-03-28 02:50:01,229: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:50:01.270370912Z [2024-03-28 02:50:01,266: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:50:01.321281972Z [2024-03-28 02:50:01,317: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:50:01.452437693Z [2024-03-28 02:50:01,451: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T02:50:01.456595967Z [2024-03-28 02:50:01,456: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:01.507818551Z [2024-03-28 02:50:01,507: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T02:50:01.510457273Z [2024-03-28 02:50:01,510: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:50:01.510646627Z [2024-03-28 02:50:01,510: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:50:01.510784369Z [2024-03-28 02:50:01,510: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T02:50:01.511313567Z [2024-03-28 02:50:01,511: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:50:01.652151359Z [2024-03-28 02:50:01,651: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:01.801627411Z [2024-03-28 02:50:01,795: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:02.399152460Z [2024-03-28 02:50:02,398: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7162a78a-665e-410f-b712-eca3ebfd33f0] succeeded in 1.6045638649993634s: None 2024-03-28T02:50:02.666135512Z [2024-03-28 02:50:02,665: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77d54b4c-75b6-4bdb-be77-2a23ced85527] succeeded in 1.8769962200003647s: None 2024-03-28T02:50:02.863679892Z [2024-03-28 02:50:02,863: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:50:02.872309356Z [2024-03-28 02:50:02,871: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:02.897381543Z [2024-03-28 02:50:02,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:50:02.900085290Z [2024-03-28 02:50:02,899: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:02.900511888Z [2024-03-28 02:50:02,900: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:02.901008678Z [2024-03-28 02:50:02,900: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:02.901195932Z [2024-03-28 02:50:02,901: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:50:02.903129337Z [2024-03-28 02:50:02,902: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:50:02.903521816Z [2024-03-28 02:50:02,903: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:03.045813841Z [2024-03-28 02:50:03,045: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:03.122970620Z [2024-03-28 02:50:03,122: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:50:03.126468581Z [2024-03-28 02:50:03,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:03.157678598Z [2024-03-28 02:50:03,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:50:03.162527315Z [2024-03-28 02:50:03,162: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:03.162553363Z [2024-03-28 02:50:03,162: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:03.165086222Z [2024-03-28 02:50:03,162: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:03.165265500Z [2024-03-28 02:50:03,164: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:50:03.165951392Z [2024-03-28 02:50:03,165: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:50:03.166037088Z [2024-03-28 02:50:03,165: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:03.271001680Z [2024-03-28 02:50:03,270: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:50:03.278851840Z [2024-03-28 02:50:03,278: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:03.287634822Z [2024-03-28 02:50:03,287: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:03.378964496Z [2024-03-28 02:50:03,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:50:03.386080726Z [2024-03-28 02:50:03,385: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:03.386113482Z [2024-03-28 02:50:03,385: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:03.386197453Z [2024-03-28 02:50:03,386: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:03.386212785Z [2024-03-28 02:50:03,386: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:50:03.386592505Z [2024-03-28 02:50:03,386: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:50:03.386670751Z [2024-03-28 02:50:03,386: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:03.619192663Z [2024-03-28 02:50:03,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:04.185221020Z [2024-03-28 02:50:04,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28831a5d-837f-4f41-836a-22dbf6d99c6d] succeeded in 3.4003863640009513s: None 2024-03-28T02:50:04.386627480Z [2024-03-28 02:50:04,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60faf851-a786-4464-ac7f-d202c5e080a3] received 2024-03-28T02:50:04.405912225Z [2024-03-28 02:50:04,405: INFO/ForkPoolWorker-15] [60faf851-a786-4464-ac7f-d202c5e080a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:50:04.700211487Z [2024-03-28 02:50:04,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:50:05.087543369Z [2024-03-28 02:50:05,086: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d9e08f0-306f-479f-82c3-53e95b1fed75] succeeded in 4.293723549999413s: None 2024-03-28T02:50:05.670631967Z [2024-03-28 02:50:05,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9ed645ee-3977-4c26-9f97-23edc10d383d] succeeded in 4.879300503000195s: None 2024-03-28T02:50:05.906530592Z [2024-03-28 02:50:05,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:50:05.909840667Z [2024-03-28 02:50:05,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:05.941579003Z [2024-03-28 02:50:05,941: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:50:05.943993058Z [2024-03-28 02:50:05,943: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:05.944302327Z [2024-03-28 02:50:05,943: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:05.945013570Z [2024-03-28 02:50:05,944: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:05.945576744Z [2024-03-28 02:50:05,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:50:05.946463468Z [2024-03-28 02:50:05,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:50:05.946716281Z [2024-03-28 02:50:05,946: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:06.033702362Z [2024-03-28 02:50:06,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:06.700693058Z [2024-03-28 02:50:06,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60faf851-a786-4464-ac7f-d202c5e080a3] succeeded in 2.3116810210012773s: None 2024-03-28T02:50:07.461381333Z [2024-03-28 02:50:07,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89318fa7-837d-416a-97c0-4824b5966237] received 2024-03-28T02:50:07.468159000Z [2024-03-28 02:50:07,467: INFO/ForkPoolWorker-15] [89318fa7-837d-416a-97c0-4824b5966237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:50:07.801374386Z [2024-03-28 02:50:07,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:50:09.101970103Z [2024-03-28 02:50:09,101: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:50:09.105574546Z [2024-03-28 02:50:09,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:09.126466273Z [2024-03-28 02:50:09,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:50:09.127873879Z [2024-03-28 02:50:09,127: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:09.127893836Z [2024-03-28 02:50:09,127: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:09.127950056Z [2024-03-28 02:50:09,127: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:09.127987926Z [2024-03-28 02:50:09,127: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:50:09.128283159Z [2024-03-28 02:50:09,128: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:50:09.128293085Z [2024-03-28 02:50:09,128: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:09.212660088Z [2024-03-28 02:50:09,212: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:09.775367802Z [2024-03-28 02:50:09,774: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89318fa7-837d-416a-97c0-4824b5966237] succeeded in 2.31221558100151s: None 2024-03-28T02:50:09.857102181Z [2024-03-28 02:50:09,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e6750ca-48b5-4f46-bedf-7de39ab80529] received 2024-03-28T02:50:09.874194693Z [2024-03-28 02:50:09,873: INFO/ForkPoolWorker-15] [8e6750ca-48b5-4f46-bedf-7de39ab80529] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:50:10.220920846Z [2024-03-28 02:50:10,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:50:11.480374784Z [2024-03-28 02:50:11,479: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:50:11.484276200Z [2024-03-28 02:50:11,483: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:50:11.503229600Z [2024-03-28 02:50:11,502: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:50:11.504683036Z [2024-03-28 02:50:11,504: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:50:11.504769615Z [2024-03-28 02:50:11,504: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:50:11.504925422Z [2024-03-28 02:50:11,504: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:50:11.505044594Z [2024-03-28 02:50:11,504: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:50:11.505363250Z [2024-03-28 02:50:11,505: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:50:11.505437336Z [2024-03-28 02:50:11,505: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:50:11.591555115Z [2024-03-28 02:50:11,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:50:12.249976406Z [2024-03-28 02:50:12,249: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e6750ca-48b5-4f46-bedf-7de39ab80529] succeeded in 2.3904755510011455s: None 2024-03-28T02:51:01.126683220Z [2024-03-28 02:51:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e39b7caa-a2e0-4dc6-864a-9eba586874b0] received 2024-03-28T02:51:01.130237333Z [2024-03-28 02:51:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b7ae697-d25d-469c-b9ea-b9f09be2e898] received 2024-03-28T02:51:01.136261572Z [2024-03-28 02:51:01,135: INFO/ForkPoolWorker-15] [e39b7caa-a2e0-4dc6-864a-9eba586874b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:51:01.140724878Z [2024-03-28 02:51:01,139: INFO/ForkPoolWorker-16] [9b7ae697-d25d-469c-b9ea-b9f09be2e898] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:51:01.149887985Z [2024-03-28 02:51:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e64b0b47-bc42-445d-8f94-75b376137c5b] received 2024-03-28T02:51:01.166370098Z [2024-03-28 02:51:01,166: INFO/ForkPoolWorker-1] [e64b0b47-bc42-445d-8f94-75b376137c5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:51:01.520367507Z [2024-03-28 02:51:01,517: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:51:01.576409804Z [2024-03-28 02:51:01,573: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:51:01.767511578Z [2024-03-28 02:51:01,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:51:01.779873075Z [2024-03-28 02:51:01,779: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T02:51:01.783975080Z [2024-03-28 02:51:01,783: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:51:01.813575936Z [2024-03-28 02:51:01,813: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:51:01.814941369Z [2024-03-28 02:51:01,814: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:51:01.815072154Z [2024-03-28 02:51:01,814: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:51:01.815163290Z [2024-03-28 02:51:01,815: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T02:51:01.815799743Z [2024-03-28 02:51:01,815: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:51:01.926778259Z [2024-03-28 02:51:01,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:51:02.492120544Z [2024-03-28 02:51:02,491: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e39b7caa-a2e0-4dc6-864a-9eba586874b0] succeeded in 1.3639239659987652s: None 2024-03-28T02:51:02.863265833Z [2024-03-28 02:51:02,862: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:51:02.866755078Z [2024-03-28 02:51:02,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:51:02.884675974Z [2024-03-28 02:51:02,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:51:02.886058696Z [2024-03-28 02:51:02,885: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:51:02.886085217Z [2024-03-28 02:51:02,885: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:51:02.886273046Z [2024-03-28 02:51:02,886: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:51:02.886286891Z [2024-03-28 02:51:02,886: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:51:02.886636243Z [2024-03-28 02:51:02,886: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:51:02.886971272Z [2024-03-28 02:51:02,886: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:51:02.971913648Z [2024-03-28 02:51:02,971: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:51:03.076871618Z [2024-03-28 02:51:03,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:51:03.080480503Z [2024-03-28 02:51:03,079: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:51:03.102253687Z [2024-03-28 02:51:03,102: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:51:03.103737178Z [2024-03-28 02:51:03,103: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:51:03.103839345Z [2024-03-28 02:51:03,103: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:51:03.104104373Z [2024-03-28 02:51:03,103: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:51:03.104356930Z [2024-03-28 02:51:03,104: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:51:03.104735769Z [2024-03-28 02:51:03,104: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:51:03.104851649Z [2024-03-28 02:51:03,104: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:51:03.196362602Z [2024-03-28 02:51:03,196: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:51:05.855256285Z [2024-03-28 02:51:05,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e64b0b47-bc42-445d-8f94-75b376137c5b] succeeded in 4.700658353000108s: None 2024-03-28T02:51:06.327194492Z [2024-03-28 02:51:06,325: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b7ae697-d25d-469c-b9ea-b9f09be2e898] succeeded in 5.194320771001003s: None 2024-03-28T02:52:00.513292092Z [2024-03-28 02:52:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ea0d058-21e4-4b03-a035-5c591322f45a] received 2024-03-28T02:52:00.516027276Z [2024-03-28 02:52:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9df19285-3e96-4160-9915-ac64ad2c74e3] received 2024-03-28T02:52:00.520672546Z [2024-03-28 02:52:00,520: INFO/ForkPoolWorker-15] [5ea0d058-21e4-4b03-a035-5c591322f45a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:52:00.525094696Z [2024-03-28 02:52:00,524: INFO/ForkPoolWorker-16] [9df19285-3e96-4160-9915-ac64ad2c74e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:52:00.530132361Z [2024-03-28 02:52:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df15aa7f-683e-4f53-bc9b-3da3ca90a456] received 2024-03-28T02:52:00.534039182Z [2024-03-28 02:52:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b5add6a-df12-4391-bf1c-eedbc6c3806a] received 2024-03-28T02:52:00.541694689Z [2024-03-28 02:52:00,541: INFO/ForkPoolWorker-1] [df15aa7f-683e-4f53-bc9b-3da3ca90a456] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:52:00.553333224Z [2024-03-28 02:52:00,553: INFO/ForkPoolWorker-2] [3b5add6a-df12-4391-bf1c-eedbc6c3806a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:52:00.894984354Z [2024-03-28 02:52:00,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:52:01.030737513Z [2024-03-28 02:52:01,027: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:52:01.087428770Z [2024-03-28 02:52:01,083: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:52:01.227017169Z [2024-03-28 02:52:01,217: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:52:01.493551754Z [2024-03-28 02:52:01,493: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:52:01.499940457Z [2024-03-28 02:52:01,499: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:52:01.551633230Z [2024-03-28 02:52:01,551: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:52:01.557185431Z [2024-03-28 02:52:01,556: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:52:01.557277814Z [2024-03-28 02:52:01,557: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:52:01.557418270Z [2024-03-28 02:52:01,557: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:52:01.557762707Z [2024-03-28 02:52:01,557: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:52:01.601290800Z [2024-03-28 02:52:01,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:52:01.772211657Z [2024-03-28 02:52:01,771: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:52:02.581086627Z [2024-03-28 02:52:02,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ea0d058-21e4-4b03-a035-5c591322f45a] succeeded in 2.0656140689989115s: None 2024-03-28T02:52:02.872219601Z [2024-03-28 02:52:02,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b5add6a-df12-4391-bf1c-eedbc6c3806a] succeeded in 2.334757762000663s: None 2024-03-28T02:52:03.317014443Z [2024-03-28 02:52:03,316: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:52:03.322197849Z [2024-03-28 02:52:03,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:52:03.361614542Z [2024-03-28 02:52:03,361: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:52:03.370854380Z [2024-03-28 02:52:03,370: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:52:03.371154348Z [2024-03-28 02:52:03,370: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:52:03.372382868Z [2024-03-28 02:52:03,371: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:52:03.372533428Z [2024-03-28 02:52:03,372: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:52:03.372906084Z [2024-03-28 02:52:03,372: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:52:03.373062656Z [2024-03-28 02:52:03,372: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:52:03.661588660Z [2024-03-28 02:52:03,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:52:03.909596874Z [2024-03-28 02:52:03,908: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:52:03.913763571Z [2024-03-28 02:52:03,912: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:52:03.979316510Z [2024-03-28 02:52:03,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:52:03.982162902Z [2024-03-28 02:52:03,981: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:52:03.982180716Z [2024-03-28 02:52:03,982: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:52:03.982275851Z [2024-03-28 02:52:03,982: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:52:03.982305172Z [2024-03-28 02:52:03,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:52:03.982638928Z [2024-03-28 02:52:03,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:52:03.982644979Z [2024-03-28 02:52:03,982: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:52:04.098699981Z [2024-03-28 02:52:04,098: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:52:05.432726143Z [2024-03-28 02:52:05,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df15aa7f-683e-4f53-bc9b-3da3ca90a456] succeeded in 4.900861263000479s: None 2024-03-28T02:52:06.319819922Z [2024-03-28 02:52:06,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9df19285-3e96-4160-9915-ac64ad2c74e3] succeeded in 5.802131150998321s: None 2024-03-28T02:53:00.501304448Z [2024-03-28 02:53:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6742e997-484e-4b5e-862b-31c3b0bf784a] received 2024-03-28T02:53:00.502796694Z [2024-03-28 02:53:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0692abe8-cc37-41b6-8e8f-4ebc4c865bf5] received 2024-03-28T02:53:00.508983973Z [2024-03-28 02:53:00,508: INFO/ForkPoolWorker-15] [6742e997-484e-4b5e-862b-31c3b0bf784a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:53:00.513056386Z [2024-03-28 02:53:00,512: INFO/ForkPoolWorker-16] [0692abe8-cc37-41b6-8e8f-4ebc4c865bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:53:00.515751919Z [2024-03-28 02:53:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b85115e0-6b14-4b16-94d0-ced30770c358] received 2024-03-28T02:53:00.529837196Z [2024-03-28 02:53:00,529: INFO/ForkPoolWorker-1] [b85115e0-6b14-4b16-94d0-ced30770c358] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:53:00.827542064Z [2024-03-28 02:53:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:53:00.849400684Z [2024-03-28 02:53:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:53:00.879040807Z [2024-03-28 02:53:00,874: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:53:01.050304137Z [2024-03-28 02:53:01,049: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:53:01.054877163Z [2024-03-28 02:53:01,054: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:53:01.080259521Z [2024-03-28 02:53:01,080: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:53:01.081761814Z [2024-03-28 02:53:01,081: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:53:01.081902687Z [2024-03-28 02:53:01,081: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:53:01.081984829Z [2024-03-28 02:53:01,081: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:53:01.082249045Z [2024-03-28 02:53:01,082: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:53:01.175420011Z [2024-03-28 02:53:01,175: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:53:01.882857996Z [2024-03-28 02:53:01,882: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b85115e0-6b14-4b16-94d0-ced30770c358] succeeded in 1.3593633110012888s: None 2024-03-28T02:53:02.231552729Z [2024-03-28 02:53:02,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:53:02.235405516Z [2024-03-28 02:53:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:53:02.263012501Z [2024-03-28 02:53:02,262: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:53:02.265041661Z [2024-03-28 02:53:02,264: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:53:02.265124814Z [2024-03-28 02:53:02,265: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:53:02.265239082Z [2024-03-28 02:53:02,265: INFO/ForkPoolWorker-15] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:53:02.265437235Z [2024-03-28 02:53:02,265: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:53:02.265603140Z [2024-03-28 02:53:02,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:53:02.265975976Z [2024-03-28 02:53:02,265: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:53:02.266501153Z [2024-03-28 02:53:02,266: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:53:02.272178346Z [2024-03-28 02:53:02,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:53:02.367119536Z [2024-03-28 02:53:02,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:53:02.377913819Z [2024-03-28 02:53:02,377: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:53:02.383662042Z [2024-03-28 02:53:02,383: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:53:02.418835211Z [2024-03-28 02:53:02,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:53:02.421175102Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:53:02.421200112Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:53:02.421207952Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:53:02.421224228Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:53:02.421264661Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:53:02.421270626Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:53:02.421276647Z [2024-03-28 02:53:02,420: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:53:02.427106555Z [2024-03-28 02:53:02,426: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:53:02.547129483Z [2024-03-28 02:53:02,546: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:53:04.511881490Z [2024-03-28 02:53:04,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6742e997-484e-4b5e-862b-31c3b0bf784a] succeeded in 4.007460490000085s: None 2024-03-28T02:53:05.457429051Z [2024-03-28 02:53:05,456: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0692abe8-cc37-41b6-8e8f-4ebc4c865bf5] succeeded in 4.951322507000441s: None 2024-03-28T02:54:00.293213019Z [2024-03-28 02:54:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97cde7d8-3f4d-457f-8214-075275ce3f5d] received 2024-03-28T02:54:00.304828039Z [2024-03-28 02:54:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d58a558b-eb74-43ed-befa-659887e30436] received 2024-03-28T02:54:00.306867341Z [2024-03-28 02:54:00,306: INFO/ForkPoolWorker-15] [97cde7d8-3f4d-457f-8214-075275ce3f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:54:00.310080225Z [2024-03-28 02:54:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d46a7a-d6a5-443c-8da7-b3427124a89f] received 2024-03-28T02:54:00.312259487Z [2024-03-28 02:54:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fb14ad8-1794-4cf7-8000-a2377cd41f36] received 2024-03-28T02:54:00.312372217Z [2024-03-28 02:54:00,312: INFO/ForkPoolWorker-16] [d58a558b-eb74-43ed-befa-659887e30436] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:54:00.328762242Z [2024-03-28 02:54:00,328: INFO/ForkPoolWorker-2] [6fb14ad8-1794-4cf7-8000-a2377cd41f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:54:00.330296449Z [2024-03-28 02:54:00,328: INFO/ForkPoolWorker-1] [43d46a7a-d6a5-443c-8da7-b3427124a89f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:54:00.640662574Z [2024-03-28 02:54:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:54:00.685358203Z [2024-03-28 02:54:00,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:54:00.703887179Z [2024-03-28 02:54:00,700: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:54:00.716666574Z [2024-03-28 02:54:00,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:54:00.992692384Z [2024-03-28 02:54:00,992: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:54:00.997225333Z [2024-03-28 02:54:00,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:54:01.028318792Z [2024-03-28 02:54:01,028: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:54:01.029831781Z [2024-03-28 02:54:01,029: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:54:01.029955514Z [2024-03-28 02:54:01,029: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:54:01.030033032Z [2024-03-28 02:54:01,029: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:54:01.030239494Z [2024-03-28 02:54:01,030: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:54:01.050294309Z [2024-03-28 02:54:01,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:54:01.153404999Z [2024-03-28 02:54:01,152: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:54:01.739470815Z [2024-03-28 02:54:01,739: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97cde7d8-3f4d-457f-8214-075275ce3f5d] succeeded in 1.4425568799997563s: None 2024-03-28T02:54:01.763045258Z [2024-03-28 02:54:01,762: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6fb14ad8-1794-4cf7-8000-a2377cd41f36] succeeded in 1.4468995529987296s: None 2024-03-28T02:54:02.203379886Z [2024-03-28 02:54:02,202: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:54:02.207104805Z [2024-03-28 02:54:02,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:54:02.236662403Z [2024-03-28 02:54:02,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:54:02.238465652Z [2024-03-28 02:54:02,238: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:54:02.238550431Z [2024-03-28 02:54:02,238: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:54:02.238744267Z [2024-03-28 02:54:02,238: INFO/ForkPoolWorker-16] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:54:02.239075877Z [2024-03-28 02:54:02,238: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:54:02.239286534Z [2024-03-28 02:54:02,239: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:54:02.240304219Z [2024-03-28 02:54:02,240: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:54:02.240375224Z [2024-03-28 02:54:02,240: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:54:02.246753539Z [2024-03-28 02:54:02,246: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:54:02.335870365Z [2024-03-28 02:54:02,335: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:54:02.439015371Z [2024-03-28 02:54:02,438: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:54:02.443089415Z [2024-03-28 02:54:02,442: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:54:02.469027191Z [2024-03-28 02:54:02,468: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:54:02.474484587Z [2024-03-28 02:54:02,474: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:54:02.474744563Z [2024-03-28 02:54:02,474: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:54:02.474986117Z [2024-03-28 02:54:02,474: INFO/ForkPoolWorker-1] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:54:02.475298112Z [2024-03-28 02:54:02,475: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:54:02.475536817Z [2024-03-28 02:54:02,475: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:54:02.476015984Z [2024-03-28 02:54:02,475: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:54:02.476781294Z [2024-03-28 02:54:02,476: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:54:02.484952156Z [2024-03-28 02:54:02,484: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:54:02.620426124Z [2024-03-28 02:54:02,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:54:04.032343292Z [2024-03-28 02:54:04,031: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43d46a7a-d6a5-443c-8da7-b3427124a89f] succeeded in 3.7190243799996097s: None 2024-03-28T02:54:04.152247021Z [2024-03-28 02:54:04,151: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d58a558b-eb74-43ed-befa-659887e30436] succeeded in 3.845192381999368s: None 2024-03-28T02:55:00.510529150Z [2024-03-28 02:55:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8b67c34-696a-494b-ba29-15a499df16a1] received 2024-03-28T02:55:00.516347391Z [2024-03-28 02:55:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b5f8ebc-2008-411e-80a6-03460a04e3fe] received 2024-03-28T02:55:00.523545291Z [2024-03-28 02:55:00,523: INFO/ForkPoolWorker-15] [c8b67c34-696a-494b-ba29-15a499df16a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:55:00.523659194Z [2024-03-28 02:55:00,523: INFO/ForkPoolWorker-16] [2b5f8ebc-2008-411e-80a6-03460a04e3fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:55:00.532669742Z [2024-03-28 02:55:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32a16c44-188c-4590-9efb-aeb66f389707] received 2024-03-28T02:55:00.540697920Z [2024-03-28 02:55:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b45c869c-eac3-4c79-a7be-9bec98695ccf] received 2024-03-28T02:55:00.547391794Z [2024-03-28 02:55:00,547: INFO/ForkPoolWorker-1] [32a16c44-188c-4590-9efb-aeb66f389707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:55:00.548713532Z [2024-03-28 02:55:00,548: INFO/ForkPoolWorker-2] [b45c869c-eac3-4c79-a7be-9bec98695ccf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:55:00.898700422Z [2024-03-28 02:55:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:55:00.904554103Z [2024-03-28 02:55:00,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:55:00.916742144Z [2024-03-28 02:55:00,913: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:55:00.945010009Z [2024-03-28 02:55:00,941: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:55:01.147970295Z [2024-03-28 02:55:01,147: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:55:01.152867918Z [2024-03-28 02:55:01,152: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:01.182727499Z [2024-03-28 02:55:01,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:55:01.183981345Z [2024-03-28 02:55:01,183: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:55:01.184091567Z [2024-03-28 02:55:01,183: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:55:01.184246859Z [2024-03-28 02:55:01,184: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:55:01.184684413Z [2024-03-28 02:55:01,184: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:55:01.314342487Z [2024-03-28 02:55:01,314: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:02.083744253Z [2024-03-28 02:55:02,083: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b45c869c-eac3-4c79-a7be-9bec98695ccf] succeeded in 1.53912030399988s: None 2024-03-28T02:55:02.473692203Z [2024-03-28 02:55:02,473: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:55:02.477391194Z [2024-03-28 02:55:02,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:02.511291714Z [2024-03-28 02:55:02,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:55:02.512977834Z [2024-03-28 02:55:02,512: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:02.513069154Z [2024-03-28 02:55:02,512: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:02.513204822Z [2024-03-28 02:55:02,513: INFO/ForkPoolWorker-16] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:02.513414684Z [2024-03-28 02:55:02,513: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:02.513532369Z [2024-03-28 02:55:02,513: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:55:02.514009538Z [2024-03-28 02:55:02,513: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:55:02.514167641Z [2024-03-28 02:55:02,514: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:02.520216288Z [2024-03-28 02:55:02,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:55:02.528923485Z [2024-03-28 02:55:02,528: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:55:02.532957182Z [2024-03-28 02:55:02,532: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:02.588637660Z [2024-03-28 02:55:02,588: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:55:02.595002038Z [2024-03-28 02:55:02,594: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:02.595067867Z [2024-03-28 02:55:02,594: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:02.595251890Z [2024-03-28 02:55:02,594: INFO/ForkPoolWorker-15] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:02.595426186Z [2024-03-28 02:55:02,595: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:02.595478489Z [2024-03-28 02:55:02,595: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:55:02.595870418Z [2024-03-28 02:55:02,595: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:02.596112943Z [2024-03-28 02:55:02,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:02.603333050Z [2024-03-28 02:55:02,603: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:02.637610894Z [2024-03-28 02:55:02,637: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:02.696652717Z [2024-03-28 02:55:02,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:03.012187543Z [2024-03-28 02:55:03,011: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:55:03.019346227Z [2024-03-28 02:55:03,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:03.067422516Z [2024-03-28 02:55:03,067: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:55:03.073075906Z [2024-03-28 02:55:03,072: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:03.073416038Z [2024-03-28 02:55:03,072: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:03.073731212Z [2024-03-28 02:55:03,073: INFO/ForkPoolWorker-1] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:03.074130472Z [2024-03-28 02:55:03,073: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:03.074375278Z [2024-03-28 02:55:03,074: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:55:03.075095338Z [2024-03-28 02:55:03,074: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:55:03.075379682Z [2024-03-28 02:55:03,075: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:03.085904486Z [2024-03-28 02:55:03,085: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:55:03.203928175Z [2024-03-28 02:55:03,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:03.587724192Z [2024-03-28 02:55:03,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8b67c34-696a-494b-ba29-15a499df16a1] succeeded in 3.0748052150011063s: None 2024-03-28T02:55:03.836423189Z [2024-03-28 02:55:03,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17bf5491-574c-4de6-8acc-14ffa1032d1b] received 2024-03-28T02:55:03.856192724Z [2024-03-28 02:55:03,855: INFO/ForkPoolWorker-15] [17bf5491-574c-4de6-8acc-14ffa1032d1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:55:04.182024937Z [2024-03-28 02:55:04,178: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:55:04.928031688Z [2024-03-28 02:55:04,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b5f8ebc-2008-411e-80a6-03460a04e3fe] succeeded in 4.409364819000984s: None 2024-03-28T02:55:05.045446187Z [2024-03-28 02:55:05,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32a16c44-188c-4590-9efb-aeb66f389707] succeeded in 4.503488841000944s: None 2024-03-28T02:55:05.492018358Z [2024-03-28 02:55:05,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:55:05.495594724Z [2024-03-28 02:55:05,495: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:05.518337743Z [2024-03-28 02:55:05,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:55:05.519533984Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:05.519597856Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:05.519610811Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:05.519726259Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:05.519795742Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:55:05.519985183Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:05.520038233Z [2024-03-28 02:55:05,519: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:05.528471831Z [2024-03-28 02:55:05,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:05.627388503Z [2024-03-28 02:55:05,627: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:06.297870705Z [2024-03-28 02:55:06,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17bf5491-574c-4de6-8acc-14ffa1032d1b] succeeded in 2.4576004370010196s: None 2024-03-28T02:55:06.342689336Z [2024-03-28 02:55:06,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[509fc003-f6c3-4f7b-94a1-730c822c7be5] received 2024-03-28T02:55:06.361306018Z [2024-03-28 02:55:06,361: INFO/ForkPoolWorker-15] [509fc003-f6c3-4f7b-94a1-730c822c7be5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T02:55:06.688163053Z [2024-03-28 02:55:06,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:55:07.853795306Z [2024-03-28 02:55:07,853: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:55:07.857153005Z [2024-03-28 02:55:07,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:07.880832621Z [2024-03-28 02:55:07,880: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:55:07.882318037Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:07.882378111Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:07.882522951Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:07.882701161Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:07.882747905Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:55:07.883320728Z [2024-03-28 02:55:07,882: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:07.883431688Z [2024-03-28 02:55:07,883: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:07.889662769Z [2024-03-28 02:55:07,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:07.964539717Z [2024-03-28 02:55:07,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:08.654561023Z [2024-03-28 02:55:08,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[509fc003-f6c3-4f7b-94a1-730c822c7be5] succeeded in 2.3100202509995142s: None 2024-03-28T02:55:08.841932266Z [2024-03-28 02:55:08,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c79c4d0a-fa68-4c68-8f37-2b826bf70d6d] received 2024-03-28T02:55:08.858857529Z [2024-03-28 02:55:08,858: INFO/ForkPoolWorker-15] [c79c4d0a-fa68-4c68-8f37-2b826bf70d6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T02:55:09.178834673Z [2024-03-28 02:55:09,175: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T02:55:10.402954735Z [2024-03-28 02:55:10,402: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:55:10.406414567Z [2024-03-28 02:55:10,405: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:55:10.431657693Z [2024-03-28 02:55:10,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:55:10.433015240Z [2024-03-28 02:55:10,432: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:55:10.433153175Z [2024-03-28 02:55:10,432: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:55:10.433261492Z [2024-03-28 02:55:10,433: INFO/ForkPoolWorker-15] Read VIM e87b79fd-b97e-4547-af7b-696d4eae89ca (k8s07_dummy) 2024-03-28T02:55:10.433549853Z [2024-03-28 02:55:10,433: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e87b79fd-b97e-4547-af7b-696d4eae89ca', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-03-28T02:55:10.433794087Z [2024-03-28 02:55:10,433: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:55:10.434454943Z [2024-03-28 02:55:10,434: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:10.434660133Z [2024-03-28 02:55:10,434: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:55:10.441190256Z [2024-03-28 02:55:10,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T02:55:10.514905063Z [2024-03-28 02:55:10,514: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:55:11.071123287Z [2024-03-28 02:55:11,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c79c4d0a-fa68-4c68-8f37-2b826bf70d6d] succeeded in 2.224514805000581s: None 2024-03-28T02:56:00.952371660Z [2024-03-28 02:56:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acaf8bf8-aeaf-4561-a831-adad611d5838] received 2024-03-28T02:56:00.958655545Z [2024-03-28 02:56:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0f55af9-5eb9-4b2e-aa83-0b88141b2a56] received 2024-03-28T02:56:00.970503055Z [2024-03-28 02:56:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27c57082-f571-4827-ab25-213415bdae21] received 2024-03-28T02:56:00.973574662Z [2024-03-28 02:56:00,973: INFO/ForkPoolWorker-16] [c0f55af9-5eb9-4b2e-aa83-0b88141b2a56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:56:00.976176735Z [2024-03-28 02:56:00,975: INFO/ForkPoolWorker-15] [acaf8bf8-aeaf-4561-a831-adad611d5838] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:56:00.982976712Z [2024-03-28 02:56:00,982: INFO/ForkPoolWorker-1] [27c57082-f571-4827-ab25-213415bdae21] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:56:00.993960198Z [2024-03-28 02:56:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[514760b9-4283-4598-a04e-0943ca0528f8] received 2024-03-28T02:56:01.011227909Z [2024-03-28 02:56:01,010: INFO/ForkPoolWorker-2] [514760b9-4283-4598-a04e-0943ca0528f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:56:01.461865124Z [2024-03-28 02:56:01,458: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:56:01.768482645Z [2024-03-28 02:56:01,762: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:56:01.849899119Z [2024-03-28 02:56:01,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:56:01.983990666Z [2024-03-28 02:56:01,983: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T02:56:01.990789406Z [2024-03-28 02:56:01,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:56:01.997168239Z [2024-03-28 02:56:01,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:56:02.069045158Z [2024-03-28 02:56:02,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:56:02.083289464Z [2024-03-28 02:56:02,082: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:56:02.085967758Z [2024-03-28 02:56:02,085: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:56:02.086194655Z [2024-03-28 02:56:02,086: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T02:56:02.090065581Z [2024-03-28 02:56:02,089: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:56:02.425953832Z [2024-03-28 02:56:02,425: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:56:02.519445106Z [2024-03-28 02:56:02,517: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:56:03.222910570Z [2024-03-28 02:56:03,222: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0f55af9-5eb9-4b2e-aa83-0b88141b2a56] succeeded in 2.259844181000517s: None 2024-03-28T02:56:03.504271866Z [2024-03-28 02:56:03,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27c57082-f571-4827-ab25-213415bdae21] succeeded in 2.5317995530003827s: None 2024-03-28T02:56:03.589642370Z [2024-03-28 02:56:03,589: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T02:56:03.593541381Z [2024-03-28 02:56:03,593: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:56:03.658486071Z [2024-03-28 02:56:03,658: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:56:03.660484538Z [2024-03-28 02:56:03,660: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:56:03.660502725Z [2024-03-28 02:56:03,660: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:56:03.660723518Z [2024-03-28 02:56:03,660: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:56:03.660786075Z [2024-03-28 02:56:03,660: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T02:56:03.661092108Z [2024-03-28 02:56:03,660: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:56:03.661213499Z [2024-03-28 02:56:03,661: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:56:03.797416495Z [2024-03-28 02:56:03,796: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:56:04.031274266Z [2024-03-28 02:56:04,030: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:56:04.034957120Z [2024-03-28 02:56:04,034: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:56:04.060647756Z [2024-03-28 02:56:04,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:56:04.062363408Z [2024-03-28 02:56:04,062: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:56:04.062777858Z [2024-03-28 02:56:04,062: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:56:04.063086286Z [2024-03-28 02:56:04,062: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:56:04.063317638Z [2024-03-28 02:56:04,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:56:04.063693905Z [2024-03-28 02:56:04,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:56:04.063864209Z [2024-03-28 02:56:04,063: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:56:04.160671741Z [2024-03-28 02:56:04,160: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:56:06.008473593Z [2024-03-28 02:56:06,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acaf8bf8-aeaf-4561-a831-adad611d5838] succeeded in 5.047565795000992s: None 2024-03-28T02:56:06.487311579Z [2024-03-28 02:56:06,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[514760b9-4283-4598-a04e-0943ca0528f8] succeeded in 5.487610268000935s: None 2024-03-28T02:57:01.270417044Z [2024-03-28 02:57:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2502d8a-9a59-4123-9148-f0ec42dd1e1e] received 2024-03-28T02:57:01.281452565Z [2024-03-28 02:57:01,281: INFO/ForkPoolWorker-15] [e2502d8a-9a59-4123-9148-f0ec42dd1e1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:57:01.298813209Z [2024-03-28 02:57:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[200ea22d-de13-4faa-91d1-77cb138834e0] received 2024-03-28T02:57:01.311848503Z [2024-03-28 02:57:01,311: INFO/ForkPoolWorker-16] [200ea22d-de13-4faa-91d1-77cb138834e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:57:01.313367668Z [2024-03-28 02:57:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63e174c7-3c3d-43b1-a57b-0a5f2e24105e] received 2024-03-28T02:57:01.366315272Z [2024-03-28 02:57:01,364: INFO/ForkPoolWorker-1] [63e174c7-3c3d-43b1-a57b-0a5f2e24105e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:57:01.653949196Z [2024-03-28 02:57:01,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:57:01.660615152Z [2024-03-28 02:57:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:57:01.763109630Z [2024-03-28 02:57:01,758: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:57:01.962624232Z [2024-03-28 02:57:01,961: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:57:01.967567879Z [2024-03-28 02:57:01,966: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:57:01.995758809Z [2024-03-28 02:57:01,995: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:57:01.997461297Z [2024-03-28 02:57:01,997: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:57:01.997858247Z [2024-03-28 02:57:01,997: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:57:01.998161110Z [2024-03-28 02:57:01,997: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:57:01.998665050Z [2024-03-28 02:57:01,998: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:57:02.142575775Z [2024-03-28 02:57:02,142: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:57:02.952905195Z [2024-03-28 02:57:02,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63e174c7-3c3d-43b1-a57b-0a5f2e24105e] succeeded in 1.6269944429986936s: None 2024-03-28T02:57:03.139715292Z [2024-03-28 02:57:03,139: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:57:03.144587642Z [2024-03-28 02:57:03,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:57:03.174039702Z [2024-03-28 02:57:03,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:57:03.175838603Z [2024-03-28 02:57:03,175: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:57:03.176003290Z [2024-03-28 02:57:03,175: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:57:03.176249376Z [2024-03-28 02:57:03,175: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:57:03.176455554Z [2024-03-28 02:57:03,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:57:03.177004708Z [2024-03-28 02:57:03,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:57:03.177229249Z [2024-03-28 02:57:03,177: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:57:03.275834912Z [2024-03-28 02:57:03,275: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:57:03.326644150Z [2024-03-28 02:57:03,326: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:57:03.330401114Z [2024-03-28 02:57:03,329: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:57:03.351952458Z [2024-03-28 02:57:03,351: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:57:03.353217729Z [2024-03-28 02:57:03,352: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:57:03.353236064Z [2024-03-28 02:57:03,353: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:57:03.353311594Z [2024-03-28 02:57:03,353: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:57:03.354424286Z [2024-03-28 02:57:03,354: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:57:03.354723050Z [2024-03-28 02:57:03,354: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:57:03.354738385Z [2024-03-28 02:57:03,354: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:57:03.495003684Z [2024-03-28 02:57:03,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:57:05.169690306Z [2024-03-28 02:57:05,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[200ea22d-de13-4faa-91d1-77cb138834e0] succeeded in 3.866840675000276s: None 2024-03-28T02:57:05.518402301Z [2024-03-28 02:57:05,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2502d8a-9a59-4123-9148-f0ec42dd1e1e] succeeded in 4.243053445999976s: None 2024-03-28T02:58:00.607286779Z [2024-03-28 02:58:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0429cd4-28ee-4ead-835a-f519b1f8b93f] received 2024-03-28T02:58:00.612452776Z [2024-03-28 02:58:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc568b1e-0b79-4b8d-ba08-b82cc72ae340] received 2024-03-28T02:58:00.614723193Z [2024-03-28 02:58:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20fb7bb6-87f3-40ef-8486-8cf87cd94cd5] received 2024-03-28T02:58:00.621690984Z [2024-03-28 02:58:00,621: INFO/ForkPoolWorker-15] [c0429cd4-28ee-4ead-835a-f519b1f8b93f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:58:00.623856521Z [2024-03-28 02:58:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f102832b-71ad-44c5-bd03-239d6d052ffa] received 2024-03-28T02:58:00.624810013Z [2024-03-28 02:58:00,624: INFO/ForkPoolWorker-1] [20fb7bb6-87f3-40ef-8486-8cf87cd94cd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:58:00.628310507Z [2024-03-28 02:58:00,627: INFO/ForkPoolWorker-16] [cc568b1e-0b79-4b8d-ba08-b82cc72ae340] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T02:58:00.639602177Z [2024-03-28 02:58:00,639: INFO/ForkPoolWorker-2] [f102832b-71ad-44c5-bd03-239d6d052ffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:58:00.958523571Z [2024-03-28 02:58:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:58:00.964192276Z [2024-03-28 02:58:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T02:58:01.000198469Z [2024-03-28 02:58:00,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:58:01.115209372Z [2024-03-28 02:58:01,107: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:58:01.260693809Z [2024-03-28 02:58:01,260: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:58:01.359859507Z [2024-03-28 02:58:01,359: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T02:58:01.369910478Z [2024-03-28 02:58:01,369: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:58:01.419447172Z [2024-03-28 02:58:01,419: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T02:58:01.420529056Z [2024-03-28 02:58:01,420: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:58:01.420574899Z [2024-03-28 02:58:01,420: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:58:01.420626817Z [2024-03-28 02:58:01,420: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T02:58:01.420819249Z [2024-03-28 02:58:01,420: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:58:01.539870627Z [2024-03-28 02:58:01,539: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:58:02.004549393Z [2024-03-28 02:58:02,004: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc568b1e-0b79-4b8d-ba08-b82cc72ae340] succeeded in 1.389829447000011s: None 2024-03-28T02:58:02.227004532Z [2024-03-28 02:58:02,226: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f102832b-71ad-44c5-bd03-239d6d052ffa] succeeded in 1.592732070999773s: None 2024-03-28T02:58:02.454579677Z [2024-03-28 02:58:02,454: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:58:02.458358102Z [2024-03-28 02:58:02,457: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:58:02.478903103Z [2024-03-28 02:58:02,478: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:58:02.480451075Z [2024-03-28 02:58:02,480: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:58:02.480615920Z [2024-03-28 02:58:02,480: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:58:02.480824779Z [2024-03-28 02:58:02,480: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:58:02.480907140Z [2024-03-28 02:58:02,480: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:58:02.481194927Z [2024-03-28 02:58:02,481: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:58:02.481685820Z [2024-03-28 02:58:02,481: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:58:02.539919623Z [2024-03-28 02:58:02,539: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T02:58:02.543337241Z [2024-03-28 02:58:02,542: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:58:02.564745210Z [2024-03-28 02:58:02,564: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:58:02.568443398Z [2024-03-28 02:58:02,568: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:58:02.571633966Z [2024-03-28 02:58:02,571: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:58:02.571964700Z [2024-03-28 02:58:02,571: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:58:02.572204874Z [2024-03-28 02:58:02,571: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:58:02.572302066Z [2024-03-28 02:58:02,572: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T02:58:02.572755461Z [2024-03-28 02:58:02,572: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:58:02.572837066Z [2024-03-28 02:58:02,572: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:58:02.660659659Z [2024-03-28 02:58:02,660: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:58:04.911480333Z [2024-03-28 02:58:04,911: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0429cd4-28ee-4ead-835a-f519b1f8b93f] succeeded in 4.299943449999773s: None 2024-03-28T02:58:05.906281452Z [2024-03-28 02:58:05,905: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20fb7bb6-87f3-40ef-8486-8cf87cd94cd5] succeeded in 5.289391013999193s: None 2024-03-28T02:59:00.569799553Z [2024-03-28 02:59:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecdd700c-0963-40f9-b25b-2c95d3bcb731] received 2024-03-28T02:59:00.582755369Z [2024-03-28 02:59:00,582: INFO/ForkPoolWorker-15] [ecdd700c-0963-40f9-b25b-2c95d3bcb731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T02:59:00.595677550Z [2024-03-28 02:59:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[229128ed-e41b-495e-b0c8-f969d4fbe733] received 2024-03-28T02:59:00.603855424Z [2024-03-28 02:59:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b8e01ab-f478-41ea-ae03-45c6de75068b] received 2024-03-28T02:59:00.616423341Z [2024-03-28 02:59:00,616: INFO/ForkPoolWorker-16] [229128ed-e41b-495e-b0c8-f969d4fbe733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T02:59:00.621702207Z [2024-03-28 02:59:00,621: INFO/ForkPoolWorker-1] [5b8e01ab-f478-41ea-ae03-45c6de75068b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T02:59:00.954340935Z [2024-03-28 02:59:00,950: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T02:59:00.979013301Z [2024-03-28 02:59:00,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T02:59:00.987462798Z [2024-03-28 02:59:00,982: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T02:59:01.229744731Z [2024-03-28 02:59:01,229: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T02:59:01.234579182Z [2024-03-28 02:59:01,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:59:01.263531392Z [2024-03-28 02:59:01,263: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T02:59:01.264689911Z [2024-03-28 02:59:01,264: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T02:59:01.264757795Z [2024-03-28 02:59:01,264: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T02:59:01.264768411Z [2024-03-28 02:59:01,264: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T02:59:01.265037130Z [2024-03-28 02:59:01,264: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T02:59:01.366993218Z [2024-03-28 02:59:01,366: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:59:02.146225426Z [2024-03-28 02:59:02,145: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b8e01ab-f478-41ea-ae03-45c6de75068b] succeeded in 1.5384987699999328s: None 2024-03-28T02:59:02.284968690Z [2024-03-28 02:59:02,284: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T02:59:02.288869000Z [2024-03-28 02:59:02,288: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:59:02.301047565Z [2024-03-28 02:59:02,300: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T02:59:02.306975608Z [2024-03-28 02:59:02,306: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T02:59:02.310162889Z [2024-03-28 02:59:02,309: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T02:59:02.311808289Z [2024-03-28 02:59:02,311: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:59:02.311823016Z [2024-03-28 02:59:02,311: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:59:02.311911262Z [2024-03-28 02:59:02,311: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:59:02.311959702Z [2024-03-28 02:59:02,311: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T02:59:02.312252047Z [2024-03-28 02:59:02,312: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T02:59:02.312374081Z [2024-03-28 02:59:02,312: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:59:02.333634289Z [2024-03-28 02:59:02,333: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T02:59:02.338172501Z [2024-03-28 02:59:02,337: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T02:59:02.338306852Z [2024-03-28 02:59:02,338: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T02:59:02.338679705Z [2024-03-28 02:59:02,338: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T02:59:02.338897330Z [2024-03-28 02:59:02,338: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T02:59:02.339522218Z [2024-03-28 02:59:02,339: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T02:59:02.339648430Z [2024-03-28 02:59:02,339: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T02:59:02.400708222Z [2024-03-28 02:59:02,400: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:59:02.469722425Z [2024-03-28 02:59:02,469: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T02:59:03.980668922Z [2024-03-28 02:59:03,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecdd700c-0963-40f9-b25b-2c95d3bcb731] succeeded in 3.408180975000505s: None 2024-03-28T02:59:04.309587659Z [2024-03-28 02:59:04,308: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[229128ed-e41b-495e-b0c8-f969d4fbe733] succeeded in 3.710677437000413s: None 2024-03-28T03:00:01.213190708Z [2024-03-28 03:00:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92365e74-fca9-4661-8105-60d727f73c2d] received 2024-03-28T03:00:01.215210305Z [2024-03-28 03:00:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e76e687-91eb-46bf-97c3-941935e5dd3c] received 2024-03-28T03:00:01.218963163Z [2024-03-28 03:00:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbfe2008-1860-4189-b580-819b6ffae76b] received 2024-03-28T03:00:01.220873694Z [2024-03-28 03:00:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4b97788-67cc-4617-a24d-d7a89696bcee] received 2024-03-28T03:00:01.232089111Z [2024-03-28 03:00:01,231: INFO/ForkPoolWorker-1] [cbfe2008-1860-4189-b580-819b6ffae76b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:00:01.232610027Z [2024-03-28 03:00:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08377307-527e-4f4c-bab1-bed5e7c175a9] received 2024-03-28T03:00:01.246513537Z [2024-03-28 03:00:01,245: INFO/ForkPoolWorker-2] [d4b97788-67cc-4617-a24d-d7a89696bcee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:00:01.250369664Z [2024-03-28 03:00:01,250: INFO/ForkPoolWorker-15] [92365e74-fca9-4661-8105-60d727f73c2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:00:01.266426235Z [2024-03-28 03:00:01,265: INFO/ForkPoolWorker-3] [08377307-527e-4f4c-bab1-bed5e7c175a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:00:01.266473384Z [2024-03-28 03:00:01,264: INFO/ForkPoolWorker-16] [5e76e687-91eb-46bf-97c3-941935e5dd3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:00:01.878155710Z [2024-03-28 03:00:01,874: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:00:01.915451527Z [2024-03-28 03:00:01,910: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:00:02.112782741Z [2024-03-28 03:00:02,108: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:00:02.253089273Z [2024-03-28 03:00:02,249: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:00:02.281430480Z [2024-03-28 03:00:02,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:00:02.479262617Z [2024-03-28 03:00:02,478: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:00:02.488200953Z [2024-03-28 03:00:02,487: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:02.504410254Z [2024-03-28 03:00:02,503: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:02.531887435Z [2024-03-28 03:00:02,531: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:00:02.533019536Z [2024-03-28 03:00:02,532: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:00:02.533077037Z [2024-03-28 03:00:02,532: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:00:02.533123442Z [2024-03-28 03:00:02,533: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:00:02.533386405Z [2024-03-28 03:00:02,533: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:00:02.700351120Z [2024-03-28 03:00:02,699: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:03.617596290Z [2024-03-28 03:00:03,613: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[08377307-527e-4f4c-bab1-bed5e7c175a9] succeeded in 2.3780148179994285s: None 2024-03-28T03:00:03.754060352Z [2024-03-28 03:00:03,753: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbfe2008-1860-4189-b580-819b6ffae76b] succeeded in 2.5316365620001307s: None 2024-03-28T03:00:04.139563284Z [2024-03-28 03:00:04,138: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:00:04.143550592Z [2024-03-28 03:00:04,142: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:04.170685386Z [2024-03-28 03:00:04,170: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:00:04.172330190Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:04.172369440Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:04.172440012Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:04.172448732Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:00:04.172879330Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:00:04.172960563Z [2024-03-28 03:00:04,172: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:04.264266869Z [2024-03-28 03:00:04,263: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:04.396598382Z [2024-03-28 03:00:04,396: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:00:04.403868685Z [2024-03-28 03:00:04,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:04.436202933Z [2024-03-28 03:00:04,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:00:04.438992922Z [2024-03-28 03:00:04,438: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:04.439014311Z [2024-03-28 03:00:04,438: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:04.439020456Z [2024-03-28 03:00:04,438: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:04.439045872Z [2024-03-28 03:00:04,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:00:04.439458874Z [2024-03-28 03:00:04,439: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:00:04.441036756Z [2024-03-28 03:00:04,439: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:04.484590721Z [2024-03-28 03:00:04,484: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:00:04.488241393Z [2024-03-28 03:00:04,487: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:04.511892664Z [2024-03-28 03:00:04,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:00:04.513815788Z [2024-03-28 03:00:04,513: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:04.514037604Z [2024-03-28 03:00:04,513: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:04.514281330Z [2024-03-28 03:00:04,513: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:04.514535332Z [2024-03-28 03:00:04,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:00:04.514968519Z [2024-03-28 03:00:04,514: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:00:04.515051465Z [2024-03-28 03:00:04,514: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:04.534296823Z [2024-03-28 03:00:04,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:04.627101613Z [2024-03-28 03:00:04,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:05.019653773Z [2024-03-28 03:00:05,019: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d4b97788-67cc-4617-a24d-d7a89696bcee] succeeded in 3.796091392001472s: None 2024-03-28T03:00:05.820054288Z [2024-03-28 03:00:05,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b793124-7d01-4f0a-8f72-a5fb9628d64f] received 2024-03-28T03:00:05.828248896Z [2024-03-28 03:00:05,827: INFO/ForkPoolWorker-1] [4b793124-7d01-4f0a-8f72-a5fb9628d64f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:00:06.230371104Z [2024-03-28 03:00:06,227: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:00:06.308936755Z [2024-03-28 03:00:06,307: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e76e687-91eb-46bf-97c3-941935e5dd3c] succeeded in 5.087821618000817s: None 2024-03-28T03:00:06.562603973Z [2024-03-28 03:00:06,561: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92365e74-fca9-4661-8105-60d727f73c2d] succeeded in 5.345933510001487s: None 2024-03-28T03:00:07.558922665Z [2024-03-28 03:00:07,558: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:00:07.562558212Z [2024-03-28 03:00:07,562: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:07.588401590Z [2024-03-28 03:00:07,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:00:07.591343005Z [2024-03-28 03:00:07,590: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:07.591443755Z [2024-03-28 03:00:07,591: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:07.591652456Z [2024-03-28 03:00:07,591: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:07.591737615Z [2024-03-28 03:00:07,591: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:00:07.592190825Z [2024-03-28 03:00:07,591: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:00:07.592415603Z [2024-03-28 03:00:07,592: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:07.699546133Z [2024-03-28 03:00:07,699: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:08.331377343Z [2024-03-28 03:00:08,330: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b793124-7d01-4f0a-8f72-a5fb9628d64f] succeeded in 2.509423137998965s: None 2024-03-28T03:00:09.219367949Z [2024-03-28 03:00:09,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86152dae-aa3f-401a-8c74-100ffecafa17] received 2024-03-28T03:00:09.229774735Z [2024-03-28 03:00:09,229: INFO/ForkPoolWorker-15] [86152dae-aa3f-401a-8c74-100ffecafa17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:00:09.693952553Z [2024-03-28 03:00:09,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:00:11.150272817Z [2024-03-28 03:00:11,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:00:11.156135184Z [2024-03-28 03:00:11,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:11.193628376Z [2024-03-28 03:00:11,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:00:11.193648616Z [2024-03-28 03:00:11,193: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:11.195495910Z [2024-03-28 03:00:11,193: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:11.195513754Z [2024-03-28 03:00:11,194: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:11.195519056Z [2024-03-28 03:00:11,194: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:00:11.195534333Z [2024-03-28 03:00:11,194: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:00:11.195538937Z [2024-03-28 03:00:11,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:11.342702820Z [2024-03-28 03:00:11,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:11.995928613Z [2024-03-28 03:00:11,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ead5abf8-194f-47c5-bbff-c3825dff9e3a] received 2024-03-28T03:00:12.009469525Z [2024-03-28 03:00:12,009: INFO/ForkPoolWorker-16] [ead5abf8-194f-47c5-bbff-c3825dff9e3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:00:12.064620233Z [2024-03-28 03:00:12,064: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86152dae-aa3f-401a-8c74-100ffecafa17] succeeded in 2.8436827579989767s: None 2024-03-28T03:00:12.332240976Z [2024-03-28 03:00:12,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:00:13.647075760Z [2024-03-28 03:00:13,646: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:00:13.651167918Z [2024-03-28 03:00:13,650: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:00:13.673284293Z [2024-03-28 03:00:13,673: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:00:13.675094877Z [2024-03-28 03:00:13,674: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:00:13.675112319Z [2024-03-28 03:00:13,675: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:00:13.675218027Z [2024-03-28 03:00:13,675: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:00:13.675228574Z [2024-03-28 03:00:13,675: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:00:13.675483194Z [2024-03-28 03:00:13,675: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:00:13.675528753Z [2024-03-28 03:00:13,675: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:00:13.785428789Z [2024-03-28 03:00:13,785: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:00:14.346820702Z [2024-03-28 03:00:14,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ead5abf8-194f-47c5-bbff-c3825dff9e3a] succeeded in 2.342934336998951s: None 2024-03-28T03:01:00.272891867Z [2024-03-28 03:01:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bdef98b-0335-4cf6-9cf6-8bfb45311bd1] received 2024-03-28T03:01:00.279066245Z [2024-03-28 03:01:00,278: INFO/ForkPoolWorker-15] [2bdef98b-0335-4cf6-9cf6-8bfb45311bd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:01:00.283489380Z [2024-03-28 03:01:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d280b3b-357d-4edf-9a22-9e7440c41021] received 2024-03-28T03:01:00.289982226Z [2024-03-28 03:01:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76753c27-1ca0-4cff-9464-78f206710981] received 2024-03-28T03:01:00.293559320Z [2024-03-28 03:01:00,293: INFO/ForkPoolWorker-16] [8d280b3b-357d-4edf-9a22-9e7440c41021] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:01:00.302282663Z [2024-03-28 03:01:00,302: INFO/ForkPoolWorker-1] [76753c27-1ca0-4cff-9464-78f206710981] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:01:00.594278805Z [2024-03-28 03:01:00,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:01:00.624540572Z [2024-03-28 03:01:00,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:01:00.789804934Z [2024-03-28 03:01:00,784: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:01:00.819733577Z [2024-03-28 03:01:00,819: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:01:00.823829608Z [2024-03-28 03:01:00,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:01:00.850937747Z [2024-03-28 03:01:00,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:01:00.852066839Z [2024-03-28 03:01:00,851: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:01:00.852273185Z [2024-03-28 03:01:00,851: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:01:00.852486763Z [2024-03-28 03:01:00,852: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:01:00.852742130Z [2024-03-28 03:01:00,852: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:01:00.944074207Z [2024-03-28 03:01:00,943: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:01:01.527186160Z [2024-03-28 03:01:01,526: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d280b3b-357d-4edf-9a22-9e7440c41021] succeeded in 1.2387569090005854s: None 2024-03-28T03:01:01.736538130Z [2024-03-28 03:01:01,736: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:01:01.745230174Z [2024-03-28 03:01:01,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:01:01.783889342Z [2024-03-28 03:01:01,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:01:01.786185650Z [2024-03-28 03:01:01,785: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:01:01.786471154Z [2024-03-28 03:01:01,786: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:01:01.786829216Z [2024-03-28 03:01:01,786: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:01:01.787069291Z [2024-03-28 03:01:01,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:01:01.788922919Z [2024-03-28 03:01:01,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:01:01.789090178Z [2024-03-28 03:01:01,788: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:01:01.953638758Z [2024-03-28 03:01:01,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:01:02.175264570Z [2024-03-28 03:01:02,174: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:01:02.183852048Z [2024-03-28 03:01:02,183: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:01:02.231027653Z [2024-03-28 03:01:02,230: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:01:02.232961894Z [2024-03-28 03:01:02,232: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:01:02.233119998Z [2024-03-28 03:01:02,232: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:01:02.233410175Z [2024-03-28 03:01:02,233: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:01:02.233620542Z [2024-03-28 03:01:02,233: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:01:02.233955343Z [2024-03-28 03:01:02,233: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:01:02.234283508Z [2024-03-28 03:01:02,233: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:01:02.427133853Z [2024-03-28 03:01:02,426: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:01:04.325931474Z [2024-03-28 03:01:04,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bdef98b-0335-4cf6-9cf6-8bfb45311bd1] succeeded in 4.051586800000223s: None 2024-03-28T03:01:04.396338685Z [2024-03-28 03:01:04,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76753c27-1ca0-4cff-9464-78f206710981] succeeded in 4.104178847001094s: None 2024-03-28T03:02:00.769365318Z [2024-03-28 03:02:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[618eced3-a44d-49cc-9b65-fce587e6dcb9] received 2024-03-28T03:02:00.774615918Z [2024-03-28 03:02:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be02fcd7-5f49-4c38-84b3-5aa44766f3ef] received 2024-03-28T03:02:00.781438433Z [2024-03-28 03:02:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88ba8cbb-4e32-4d07-9a26-e2357c152ff7] received 2024-03-28T03:02:00.782371278Z [2024-03-28 03:02:00,781: INFO/ForkPoolWorker-15] [618eced3-a44d-49cc-9b65-fce587e6dcb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:02:00.789706077Z [2024-03-28 03:02:00,789: INFO/ForkPoolWorker-16] [be02fcd7-5f49-4c38-84b3-5aa44766f3ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:02:00.793562448Z [2024-03-28 03:02:00,793: INFO/ForkPoolWorker-1] [88ba8cbb-4e32-4d07-9a26-e2357c152ff7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:02:00.795086565Z [2024-03-28 03:02:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b835644-079a-4a69-b6af-a02a7d5a7ecb] received 2024-03-28T03:02:00.813248928Z [2024-03-28 03:02:00,812: INFO/ForkPoolWorker-2] [3b835644-079a-4a69-b6af-a02a7d5a7ecb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:02:01.280549709Z [2024-03-28 03:02:01,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:02:01.505442659Z [2024-03-28 03:02:01,500: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:02:01.683625057Z [2024-03-28 03:02:01,677: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:02:01.747455907Z [2024-03-28 03:02:01,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:02:01.868804133Z [2024-03-28 03:02:01,868: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:02:01.876337992Z [2024-03-28 03:02:01,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:02:01.935133241Z [2024-03-28 03:02:01,934: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:02:01.939666565Z [2024-03-28 03:02:01,939: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:02:01.940245332Z [2024-03-28 03:02:01,940: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:02:01.941116832Z [2024-03-28 03:02:01,940: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:02:01.942193116Z [2024-03-28 03:02:01,942: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:02:02.124219264Z [2024-03-28 03:02:02,123: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:02:02.133293144Z [2024-03-28 03:02:02,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:02:03.050945630Z [2024-03-28 03:02:03,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88ba8cbb-4e32-4d07-9a26-e2357c152ff7] succeeded in 2.2663673070001096s: None 2024-03-28T03:02:03.413562434Z [2024-03-28 03:02:03,410: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be02fcd7-5f49-4c38-84b3-5aa44766f3ef] succeeded in 2.6267502369992144s: None 2024-03-28T03:02:03.764418303Z [2024-03-28 03:02:03,763: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:02:03.771650291Z [2024-03-28 03:02:03,770: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:02:03.825074154Z [2024-03-28 03:02:03,824: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:02:03.835185787Z [2024-03-28 03:02:03,834: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:02:03.835215870Z [2024-03-28 03:02:03,835: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:02:03.835314476Z [2024-03-28 03:02:03,835: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:02:03.835383022Z [2024-03-28 03:02:03,835: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:02:03.835700011Z [2024-03-28 03:02:03,835: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:02:03.835720761Z [2024-03-28 03:02:03,835: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:02:03.856031041Z [2024-03-28 03:02:03,855: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:02:03.863152606Z [2024-03-28 03:02:03,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:02:03.940596972Z [2024-03-28 03:02:03,940: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:02:03.949372388Z [2024-03-28 03:02:03,948: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:02:03.949989746Z [2024-03-28 03:02:03,949: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:02:03.950418102Z [2024-03-28 03:02:03,950: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:02:03.950711575Z [2024-03-28 03:02:03,950: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:02:03.951261507Z [2024-03-28 03:02:03,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:02:03.951743643Z [2024-03-28 03:02:03,951: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:02:04.019868188Z [2024-03-28 03:02:04,019: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:02:04.107981803Z [2024-03-28 03:02:04,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:02:05.743855184Z [2024-03-28 03:02:05,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[618eced3-a44d-49cc-9b65-fce587e6dcb9] succeeded in 4.970040959999096s: None 2024-03-28T03:02:07.809111337Z [2024-03-28 03:02:07,806: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b835644-079a-4a69-b6af-a02a7d5a7ecb] succeeded in 7.009048690000782s: None 2024-03-28T03:03:00.688362187Z [2024-03-28 03:03:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23731a04-777d-4a05-8a25-5c00c45f4a94] received 2024-03-28T03:03:00.692536978Z [2024-03-28 03:03:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52202c51-e32c-4157-808b-872af9002140] received 2024-03-28T03:03:00.699866566Z [2024-03-28 03:03:00,699: INFO/ForkPoolWorker-16] [52202c51-e32c-4157-808b-872af9002140] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:03:00.702831229Z [2024-03-28 03:03:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abd71333-82ab-4836-b003-609baaed3043] received 2024-03-28T03:03:00.706266313Z [2024-03-28 03:03:00,705: INFO/ForkPoolWorker-15] [23731a04-777d-4a05-8a25-5c00c45f4a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:03:00.714601890Z [2024-03-28 03:03:00,712: INFO/ForkPoolWorker-1] [abd71333-82ab-4836-b003-609baaed3043] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:03:01.022793790Z [2024-03-28 03:03:01,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:03:01.065157092Z [2024-03-28 03:03:01,062: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:03:01.180575552Z [2024-03-28 03:03:01,176: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:03:01.377728165Z [2024-03-28 03:03:01,377: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:03:01.382157103Z [2024-03-28 03:03:01,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:03:01.403914388Z [2024-03-28 03:03:01,403: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:03:01.404914218Z [2024-03-28 03:03:01,404: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:03:01.404979314Z [2024-03-28 03:03:01,404: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:03:01.405032461Z [2024-03-28 03:03:01,404: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:03:01.405243219Z [2024-03-28 03:03:01,405: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:03:01.500630297Z [2024-03-28 03:03:01,500: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:03:02.143024238Z [2024-03-28 03:03:02,142: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abd71333-82ab-4836-b003-609baaed3043] succeeded in 1.437144116998752s: None 2024-03-28T03:03:02.320502631Z [2024-03-28 03:03:02,320: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:03:02.324477367Z [2024-03-28 03:03:02,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:03:02.347011357Z [2024-03-28 03:03:02,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:03:02.348992143Z [2024-03-28 03:03:02,348: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:03:02.349131759Z [2024-03-28 03:03:02,348: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:03:02.349297032Z [2024-03-28 03:03:02,349: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:03:02.349424205Z [2024-03-28 03:03:02,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:03:02.349814613Z [2024-03-28 03:03:02,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:03:02.349990769Z [2024-03-28 03:03:02,349: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:03:02.435623792Z [2024-03-28 03:03:02,435: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:03:02.458433563Z [2024-03-28 03:03:02,457: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:03:02.462235660Z [2024-03-28 03:03:02,461: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:03:02.487768907Z [2024-03-28 03:03:02,487: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:03:02.490440067Z [2024-03-28 03:03:02,489: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:03:02.490451496Z [2024-03-28 03:03:02,489: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:03:02.490457162Z [2024-03-28 03:03:02,489: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:03:02.490463065Z [2024-03-28 03:03:02,489: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:03:02.490468440Z [2024-03-28 03:03:02,490: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:03:02.491226011Z [2024-03-28 03:03:02,490: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:03:02.581315609Z [2024-03-28 03:03:02,580: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:03:04.206597671Z [2024-03-28 03:03:04,206: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52202c51-e32c-4157-808b-872af9002140] succeeded in 3.5124822439993295s: None 2024-03-28T03:03:04.298471378Z [2024-03-28 03:03:04,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23731a04-777d-4a05-8a25-5c00c45f4a94] succeeded in 3.602809101001185s: None 2024-03-28T03:04:00.487843696Z [2024-03-28 03:04:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e4ae50d-daf0-4639-b412-afe2bb27fd57] received 2024-03-28T03:04:00.490777778Z [2024-03-28 03:04:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18a37ac0-5db8-4715-af3e-41550692c1b4] received 2024-03-28T03:04:00.494286604Z [2024-03-28 03:04:00,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b956a3b1-4f05-4d11-a4b7-c3d0b9b55ae6] received 2024-03-28T03:04:00.497645723Z [2024-03-28 03:04:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c04ac0b-afdf-422c-ba7c-ee2666d0c0fb] received 2024-03-28T03:04:00.500665537Z [2024-03-28 03:04:00,500: INFO/ForkPoolWorker-16] [18a37ac0-5db8-4715-af3e-41550692c1b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:04:00.503117401Z [2024-03-28 03:04:00,502: INFO/ForkPoolWorker-15] [4e4ae50d-daf0-4639-b412-afe2bb27fd57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:04:00.511644564Z [2024-03-28 03:04:00,511: INFO/ForkPoolWorker-2] [7c04ac0b-afdf-422c-ba7c-ee2666d0c0fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:04:00.512309654Z [2024-03-28 03:04:00,512: INFO/ForkPoolWorker-1] [b956a3b1-4f05-4d11-a4b7-c3d0b9b55ae6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:04:00.892125061Z [2024-03-28 03:04:00,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:04:00.922709907Z [2024-03-28 03:04:00,919: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:04:00.959494738Z [2024-03-28 03:04:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:04:01.102208075Z [2024-03-28 03:04:01,098: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:04:01.181666701Z [2024-03-28 03:04:01,180: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:04:01.191912765Z [2024-03-28 03:04:01,191: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:04:01.243502701Z [2024-03-28 03:04:01,243: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:04:01.245640274Z [2024-03-28 03:04:01,245: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:04:01.245741051Z [2024-03-28 03:04:01,245: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:04:01.245901566Z [2024-03-28 03:04:01,245: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:04:01.246450351Z [2024-03-28 03:04:01,246: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:04:01.251658338Z [2024-03-28 03:04:01,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:04:01.383699420Z [2024-03-28 03:04:01,383: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:04:02.010424999Z [2024-03-28 03:04:02,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e4ae50d-daf0-4639-b412-afe2bb27fd57] succeeded in 1.5191297620003752s: None 2024-03-28T03:04:02.127093575Z [2024-03-28 03:04:02,126: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c04ac0b-afdf-422c-ba7c-ee2666d0c0fb] succeeded in 1.6236822940009006s: None 2024-03-28T03:04:02.701731688Z [2024-03-28 03:04:02,701: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:04:02.705425517Z [2024-03-28 03:04:02,704: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:04:02.728980066Z [2024-03-28 03:04:02,728: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:04:02.730232918Z [2024-03-28 03:04:02,729: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:04:02.730319922Z [2024-03-28 03:04:02,730: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:04:02.730582327Z [2024-03-28 03:04:02,730: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:04:02.730618869Z [2024-03-28 03:04:02,730: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:04:02.730941394Z [2024-03-28 03:04:02,730: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:04:02.731041808Z [2024-03-28 03:04:02,730: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:04:02.821469572Z [2024-03-28 03:04:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:04:02.897356448Z [2024-03-28 03:04:02,896: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:04:02.901013205Z [2024-03-28 03:04:02,900: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:04:02.927024443Z [2024-03-28 03:04:02,926: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:04:02.928352800Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:04:02.928426668Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:04:02.928442758Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:04:02.928524600Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:04:02.928814184Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:04:02.928845971Z [2024-03-28 03:04:02,928: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:04:03.062368898Z [2024-03-28 03:04:03,061: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:04:04.567994428Z [2024-03-28 03:04:04,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b956a3b1-4f05-4d11-a4b7-c3d0b9b55ae6] succeeded in 4.070215030000327s: None 2024-03-28T03:04:05.194608886Z [2024-03-28 03:04:05,194: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18a37ac0-5db8-4715-af3e-41550692c1b4] succeeded in 4.700781637999171s: None 2024-03-28T03:05:01.239565226Z [2024-03-28 03:05:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b55fdc86-9b0c-4bcc-af82-bbcaea0df72b] received 2024-03-28T03:05:01.245973359Z [2024-03-28 03:05:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd331e6-7a61-4673-9fdc-1f3f3ca1f10b] received 2024-03-28T03:05:01.252353122Z [2024-03-28 03:05:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9567f969-2aba-4c90-ad0a-907b963945a9] received 2024-03-28T03:05:01.253296205Z [2024-03-28 03:05:01,253: INFO/ForkPoolWorker-15] [b55fdc86-9b0c-4bcc-af82-bbcaea0df72b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:05:01.258698469Z [2024-03-28 03:05:01,258: INFO/ForkPoolWorker-16] [6bd331e6-7a61-4673-9fdc-1f3f3ca1f10b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:05:01.261228275Z [2024-03-28 03:05:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de2555ae-6e3a-4baf-b7ef-ec4f0e8beb3f] received 2024-03-28T03:05:01.270700024Z [2024-03-28 03:05:01,270: INFO/ForkPoolWorker-1] [9567f969-2aba-4c90-ad0a-907b963945a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:05:01.276661537Z [2024-03-28 03:05:01,273: INFO/ForkPoolWorker-2] [de2555ae-6e3a-4baf-b7ef-ec4f0e8beb3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:05:01.659380882Z [2024-03-28 03:05:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:05:01.758632497Z [2024-03-28 03:05:01,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:05:01.823882628Z [2024-03-28 03:05:01,819: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:05:01.936255459Z [2024-03-28 03:05:01,931: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:05:02.056591963Z [2024-03-28 03:05:02,056: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:05:02.066036989Z [2024-03-28 03:05:02,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:02.113548954Z [2024-03-28 03:05:02,113: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:05:02.118053826Z [2024-03-28 03:05:02,117: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:05:02.118342592Z [2024-03-28 03:05:02,117: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:05:02.118611248Z [2024-03-28 03:05:02,118: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:05:02.119584581Z [2024-03-28 03:05:02,118: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:05:02.266131481Z [2024-03-28 03:05:02,265: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:03.028117336Z [2024-03-28 03:05:03,027: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bd331e6-7a61-4673-9fdc-1f3f3ca1f10b] succeeded in 1.7797542819989758s: None 2024-03-28T03:05:03.241315047Z [2024-03-28 03:05:03,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:05:03.244589558Z [2024-03-28 03:05:03,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:03.269466335Z [2024-03-28 03:05:03,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:05:03.274996230Z [2024-03-28 03:05:03,274: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:03.275351278Z [2024-03-28 03:05:03,275: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:03.275678956Z [2024-03-28 03:05:03,275: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:03.275802961Z [2024-03-28 03:05:03,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:05:03.276130685Z [2024-03-28 03:05:03,275: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:05:03.276173470Z [2024-03-28 03:05:03,276: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:03.426491166Z [2024-03-28 03:05:03,426: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:04.019908163Z [2024-03-28 03:05:04,019: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:05:04.024890767Z [2024-03-28 03:05:04,024: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:04.058429877Z [2024-03-28 03:05:04,057: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:05:04.063390053Z [2024-03-28 03:05:04,062: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:04.069066227Z [2024-03-28 03:05:04,068: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:05:04.071075202Z [2024-03-28 03:05:04,070: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:04.071158307Z [2024-03-28 03:05:04,070: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:04.071407386Z [2024-03-28 03:05:04,071: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:04.071429125Z [2024-03-28 03:05:04,071: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:05:04.071826332Z [2024-03-28 03:05:04,071: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:05:04.071841090Z [2024-03-28 03:05:04,071: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:04.119658427Z [2024-03-28 03:05:04,119: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:05:04.127330155Z [2024-03-28 03:05:04,126: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:04.127392643Z [2024-03-28 03:05:04,127: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:04.127670117Z [2024-03-28 03:05:04,127: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:04.127825845Z [2024-03-28 03:05:04,127: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:05:04.128252013Z [2024-03-28 03:05:04,128: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:05:04.128359469Z [2024-03-28 03:05:04,128: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:04.224415346Z [2024-03-28 03:05:04,224: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:04.263480127Z [2024-03-28 03:05:04,263: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:04.982659985Z [2024-03-28 03:05:04,982: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9567f969-2aba-4c90-ad0a-907b963945a9] succeeded in 3.7192844589990273s: None 2024-03-28T03:05:05.266412597Z [2024-03-28 03:05:05,265: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b55fdc86-9b0c-4bcc-af82-bbcaea0df72b] succeeded in 4.023812221999833s: None 2024-03-28T03:05:05.266984170Z [2024-03-28 03:05:05,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da4a7c20-4343-47e6-8935-56252fa0f979] received 2024-03-28T03:05:05.273645285Z [2024-03-28 03:05:05,273: INFO/ForkPoolWorker-15] [da4a7c20-4343-47e6-8935-56252fa0f979] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:05:05.568148880Z [2024-03-28 03:05:05,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:05:06.373721172Z [2024-03-28 03:05:06,370: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[de2555ae-6e3a-4baf-b7ef-ec4f0e8beb3f] succeeded in 5.104752601000655s: None 2024-03-28T03:05:06.807639012Z [2024-03-28 03:05:06,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:05:06.811280085Z [2024-03-28 03:05:06,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:06.831156637Z [2024-03-28 03:05:06,830: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:05:06.832439264Z [2024-03-28 03:05:06,832: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:06.832525072Z [2024-03-28 03:05:06,832: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:06.832693151Z [2024-03-28 03:05:06,832: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:06.832768317Z [2024-03-28 03:05:06,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:05:06.833093663Z [2024-03-28 03:05:06,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:05:06.833153118Z [2024-03-28 03:05:06,833: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:06.921351285Z [2024-03-28 03:05:06,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:07.575812984Z [2024-03-28 03:05:07,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da4a7c20-4343-47e6-8935-56252fa0f979] succeeded in 2.306512784000006s: None 2024-03-28T03:05:07.930518094Z [2024-03-28 03:05:07,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5868764-f2c9-4148-bd81-6b854fbfaac4] received 2024-03-28T03:05:07.940274262Z [2024-03-28 03:05:07,939: INFO/ForkPoolWorker-15] [f5868764-f2c9-4148-bd81-6b854fbfaac4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:05:08.315162939Z [2024-03-28 03:05:08,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:05:09.606209051Z [2024-03-28 03:05:09,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:05:09.609844733Z [2024-03-28 03:05:09,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:09.630091035Z [2024-03-28 03:05:09,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:05:09.631578830Z [2024-03-28 03:05:09,631: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:09.631699555Z [2024-03-28 03:05:09,631: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:09.631905859Z [2024-03-28 03:05:09,631: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:09.632019802Z [2024-03-28 03:05:09,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:05:09.632337975Z [2024-03-28 03:05:09,632: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:05:09.632457427Z [2024-03-28 03:05:09,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:09.741287391Z [2024-03-28 03:05:09,740: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:10.351180148Z [2024-03-28 03:05:10,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d77f3cb-ccdd-4928-912c-b9fc526a42fb] received 2024-03-28T03:05:10.371493760Z [2024-03-28 03:05:10,369: INFO/ForkPoolWorker-16] [4d77f3cb-ccdd-4928-912c-b9fc526a42fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:05:10.430516361Z [2024-03-28 03:05:10,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5868764-f2c9-4148-bd81-6b854fbfaac4] succeeded in 2.4980708510011027s: None 2024-03-28T03:05:10.727280613Z [2024-03-28 03:05:10,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:05:12.115853591Z [2024-03-28 03:05:12,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:05:12.119357938Z [2024-03-28 03:05:12,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:05:12.140696302Z [2024-03-28 03:05:12,140: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:05:12.142237038Z [2024-03-28 03:05:12,141: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:05:12.142850925Z [2024-03-28 03:05:12,142: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:05:12.143124153Z [2024-03-28 03:05:12,142: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:05:12.143236514Z [2024-03-28 03:05:12,143: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:05:12.143889252Z [2024-03-28 03:05:12,143: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:05:12.144035995Z [2024-03-28 03:05:12,143: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:05:12.238661045Z [2024-03-28 03:05:12,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:05:12.814637072Z [2024-03-28 03:05:12,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d77f3cb-ccdd-4928-912c-b9fc526a42fb] succeeded in 2.4598591110006964s: None 2024-03-28T03:06:00.339174432Z [2024-03-28 03:06:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ed09fc2-0f1d-4be3-a5f8-0aa0415783ac] received 2024-03-28T03:06:00.343302884Z [2024-03-28 03:06:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de3ef804-9cce-44bd-872a-578ad66e005c] received 2024-03-28T03:06:00.349550358Z [2024-03-28 03:06:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e27703d6-77e2-4021-a588-1f8a72c38cb9] received 2024-03-28T03:06:00.351224567Z [2024-03-28 03:06:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5629594-2028-415d-a7bb-1a3eac637271] received 2024-03-28T03:06:00.353686064Z [2024-03-28 03:06:00,353: INFO/ForkPoolWorker-15] [7ed09fc2-0f1d-4be3-a5f8-0aa0415783ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:06:00.354007420Z [2024-03-28 03:06:00,353: INFO/ForkPoolWorker-16] [de3ef804-9cce-44bd-872a-578ad66e005c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:06:00.357486495Z [2024-03-28 03:06:00,357: INFO/ForkPoolWorker-1] [e27703d6-77e2-4021-a588-1f8a72c38cb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:06:00.365166189Z [2024-03-28 03:06:00,364: INFO/ForkPoolWorker-2] [c5629594-2028-415d-a7bb-1a3eac637271] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:06:00.654932644Z [2024-03-28 03:06:00,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:06:00.697427107Z [2024-03-28 03:06:00,694: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:06:00.728706882Z [2024-03-28 03:06:00,725: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:06:00.739887379Z [2024-03-28 03:06:00,736: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:06:00.888840458Z [2024-03-28 03:06:00,888: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:06:00.894953871Z [2024-03-28 03:06:00,894: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:06:00.928800410Z [2024-03-28 03:06:00,926: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:06:00.933784218Z [2024-03-28 03:06:00,933: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:06:00.933955438Z [2024-03-28 03:06:00,933: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:06:00.934097336Z [2024-03-28 03:06:00,933: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:06:00.934496575Z [2024-03-28 03:06:00,934: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:06:00.973754050Z [2024-03-28 03:06:00,973: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:06:01.085214339Z [2024-03-28 03:06:01,084: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:06:01.748909983Z [2024-03-28 03:06:01,748: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ed09fc2-0f1d-4be3-a5f8-0aa0415783ac] succeeded in 1.406817246999708s: None 2024-03-28T03:06:01.845944566Z [2024-03-28 03:06:01,845: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c5629594-2028-415d-a7bb-1a3eac637271] succeeded in 1.4921498339990649s: None 2024-03-28T03:06:02.148684720Z [2024-03-28 03:06:02,148: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:06:02.152348441Z [2024-03-28 03:06:02,151: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:06:02.175051574Z [2024-03-28 03:06:02,174: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:06:02.176648079Z [2024-03-28 03:06:02,176: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:06:02.176759837Z [2024-03-28 03:06:02,176: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:06:02.177022749Z [2024-03-28 03:06:02,176: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:06:02.177192221Z [2024-03-28 03:06:02,177: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:06:02.177650353Z [2024-03-28 03:06:02,177: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:06:02.180575958Z [2024-03-28 03:06:02,180: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:06:02.238841391Z [2024-03-28 03:06:02,238: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:06:02.242554128Z [2024-03-28 03:06:02,241: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:06:02.278306956Z [2024-03-28 03:06:02,278: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:06:02.281213568Z [2024-03-28 03:06:02,280: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:06:02.281505719Z [2024-03-28 03:06:02,281: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:06:02.281929199Z [2024-03-28 03:06:02,281: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:06:02.283383793Z [2024-03-28 03:06:02,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:06:02.284355484Z [2024-03-28 03:06:02,283: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:06:02.284508752Z [2024-03-28 03:06:02,284: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:06:02.288879956Z [2024-03-28 03:06:02,288: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:06:02.402097314Z [2024-03-28 03:06:02,401: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:06:03.806516690Z [2024-03-28 03:06:03,806: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e27703d6-77e2-4021-a588-1f8a72c38cb9] succeeded in 3.4549464940009784s: None 2024-03-28T03:06:04.392352270Z [2024-03-28 03:06:04,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de3ef804-9cce-44bd-872a-578ad66e005c] succeeded in 4.046301133999805s: None 2024-03-28T03:07:00.574267374Z [2024-03-28 03:07:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b17990d-fc22-412e-95d7-91f74805a9a3] received 2024-03-28T03:07:00.575793020Z [2024-03-28 03:07:00,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c68d3c0a-edf9-446b-9c98-b63fd043ee0e] received 2024-03-28T03:07:00.581440413Z [2024-03-28 03:07:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44cc63c2-3263-4c6c-a06f-4b0591c4800a] received 2024-03-28T03:07:00.582251663Z [2024-03-28 03:07:00,582: INFO/ForkPoolWorker-15] [2b17990d-fc22-412e-95d7-91f74805a9a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:07:00.586454151Z [2024-03-28 03:07:00,586: INFO/ForkPoolWorker-16] [c68d3c0a-edf9-446b-9c98-b63fd043ee0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:07:00.595020682Z [2024-03-28 03:07:00,594: INFO/ForkPoolWorker-1] [44cc63c2-3263-4c6c-a06f-4b0591c4800a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:07:00.895794769Z [2024-03-28 03:07:00,892: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:07:00.902475726Z [2024-03-28 03:07:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:07:00.904579203Z [2024-03-28 03:07:00,901: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:07:01.061235745Z [2024-03-28 03:07:01,060: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:07:01.065250630Z [2024-03-28 03:07:01,064: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:07:01.090575918Z [2024-03-28 03:07:01,090: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:07:01.094257598Z [2024-03-28 03:07:01,093: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:07:01.094364535Z [2024-03-28 03:07:01,094: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:07:01.094465770Z [2024-03-28 03:07:01,094: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:07:01.094775172Z [2024-03-28 03:07:01,094: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:07:01.235653411Z [2024-03-28 03:07:01,233: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:07:01.978891851Z [2024-03-28 03:07:01,978: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44cc63c2-3263-4c6c-a06f-4b0591c4800a] succeeded in 1.395284754999011s: None 2024-03-28T03:07:02.069773912Z [2024-03-28 03:07:02,069: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:07:02.073402682Z [2024-03-28 03:07:02,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:07:02.098181225Z [2024-03-28 03:07:02,097: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:07:02.100074413Z [2024-03-28 03:07:02,099: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:07:02.100375434Z [2024-03-28 03:07:02,099: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:07:02.100740635Z [2024-03-28 03:07:02,100: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:07:02.100969636Z [2024-03-28 03:07:02,100: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:07:02.101571991Z [2024-03-28 03:07:02,101: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:07:02.101797198Z [2024-03-28 03:07:02,101: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:07:02.164457794Z [2024-03-28 03:07:02,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:07:02.168364432Z [2024-03-28 03:07:02,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:07:02.196687654Z [2024-03-28 03:07:02,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:07:02.197172476Z [2024-03-28 03:07:02,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:07:02.200159169Z [2024-03-28 03:07:02,199: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:07:02.200640173Z [2024-03-28 03:07:02,200: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:07:02.201136392Z [2024-03-28 03:07:02,200: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:07:02.201521176Z [2024-03-28 03:07:02,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:07:02.202564630Z [2024-03-28 03:07:02,201: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:07:02.202933464Z [2024-03-28 03:07:02,202: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:07:02.294294482Z [2024-03-28 03:07:02,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:07:03.795676725Z [2024-03-28 03:07:03,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b17990d-fc22-412e-95d7-91f74805a9a3] succeeded in 3.2158279169998423s: None 2024-03-28T03:07:04.074186459Z [2024-03-28 03:07:04,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c68d3c0a-edf9-446b-9c98-b63fd043ee0e] succeeded in 3.4963132760003646s: None 2024-03-28T03:08:00.747730863Z [2024-03-28 03:08:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff47244b-58e1-4cc6-b201-86266ebcdf88] received 2024-03-28T03:08:00.749550271Z [2024-03-28 03:08:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2409b5b8-c330-4ba0-a4af-90aaa28d5d50] received 2024-03-28T03:08:00.752512881Z [2024-03-28 03:08:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4451d83e-9b65-4106-8843-d261f32960cc] received 2024-03-28T03:08:00.756541495Z [2024-03-28 03:08:00,756: INFO/ForkPoolWorker-15] [ff47244b-58e1-4cc6-b201-86266ebcdf88] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:08:00.758885083Z [2024-03-28 03:08:00,758: INFO/ForkPoolWorker-16] [2409b5b8-c330-4ba0-a4af-90aaa28d5d50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:08:00.762078234Z [2024-03-28 03:08:00,761: INFO/ForkPoolWorker-1] [4451d83e-9b65-4106-8843-d261f32960cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:08:00.768908180Z [2024-03-28 03:08:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ab8edcb-5831-47a0-a4bf-19f0a6731193] received 2024-03-28T03:08:00.777302904Z [2024-03-28 03:08:00,776: INFO/ForkPoolWorker-2] [7ab8edcb-5831-47a0-a4bf-19f0a6731193] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:08:01.090949233Z [2024-03-28 03:08:01,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:08:01.115997192Z [2024-03-28 03:08:01,112: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:08:01.118901967Z [2024-03-28 03:08:01,114: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:08:01.142723861Z [2024-03-28 03:08:01,138: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:08:01.346193121Z [2024-03-28 03:08:01,345: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:08:01.352265625Z [2024-03-28 03:08:01,351: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:08:01.388162868Z [2024-03-28 03:08:01,387: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:08:01.390274637Z [2024-03-28 03:08:01,390: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:08:01.390412319Z [2024-03-28 03:08:01,390: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:08:01.390508091Z [2024-03-28 03:08:01,390: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:08:01.390774370Z [2024-03-28 03:08:01,390: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:08:01.421749391Z [2024-03-28 03:08:01,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:08:01.516610065Z [2024-03-28 03:08:01,516: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:08:02.191953130Z [2024-03-28 03:08:02,191: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff47244b-58e1-4cc6-b201-86266ebcdf88] succeeded in 1.4410116460003337s: None 2024-03-28T03:08:02.223615188Z [2024-03-28 03:08:02,223: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ab8edcb-5831-47a0-a4bf-19f0a6731193] succeeded in 1.4519857920004142s: None 2024-03-28T03:08:02.698993469Z [2024-03-28 03:08:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:08:02.702608276Z [2024-03-28 03:08:02,702: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:08:02.752833589Z [2024-03-28 03:08:02,752: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:08:02.756881944Z [2024-03-28 03:08:02,756: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:08:02.756917988Z [2024-03-28 03:08:02,756: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:08:02.757081938Z [2024-03-28 03:08:02,756: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:08:02.757122122Z [2024-03-28 03:08:02,757: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:08:02.757570280Z [2024-03-28 03:08:02,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:08:02.757583890Z [2024-03-28 03:08:02,757: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:08:02.776442703Z [2024-03-28 03:08:02,775: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:08:02.782945013Z [2024-03-28 03:08:02,780: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:08:02.833615567Z [2024-03-28 03:08:02,833: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:08:02.837618122Z [2024-03-28 03:08:02,836: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:08:02.837923965Z [2024-03-28 03:08:02,837: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:08:02.839584143Z [2024-03-28 03:08:02,837: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:08:02.839841832Z [2024-03-28 03:08:02,839: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:08:02.841980450Z [2024-03-28 03:08:02,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:08:02.842194641Z [2024-03-28 03:08:02,841: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:08:02.860250635Z [2024-03-28 03:08:02,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:08:02.946830998Z [2024-03-28 03:08:02,946: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:08:04.587989635Z [2024-03-28 03:08:04,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4451d83e-9b65-4106-8843-d261f32960cc] succeeded in 3.8328487939998013s: None 2024-03-28T03:08:05.059350198Z [2024-03-28 03:08:05,058: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2409b5b8-c330-4ba0-a4af-90aaa28d5d50] succeeded in 4.307000250999408s: None 2024-03-28T03:09:01.252476463Z [2024-03-28 03:09:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa5d13c-986b-44d3-a6af-8e2c46f0a8bb] received 2024-03-28T03:09:01.255101523Z [2024-03-28 03:09:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e89c50d6-1d73-41e7-9ba7-76418cb3cd7c] received 2024-03-28T03:09:01.261105193Z [2024-03-28 03:09:01,260: INFO/ForkPoolWorker-15] [8fa5d13c-986b-44d3-a6af-8e2c46f0a8bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:09:01.264182405Z [2024-03-28 03:09:01,263: INFO/ForkPoolWorker-16] [e89c50d6-1d73-41e7-9ba7-76418cb3cd7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:09:01.273282168Z [2024-03-28 03:09:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dea2daca-d9f5-4ab3-a6ae-48edad12bb50] received 2024-03-28T03:09:01.300965722Z [2024-03-28 03:09:01,300: INFO/ForkPoolWorker-1] [dea2daca-d9f5-4ab3-a6ae-48edad12bb50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:09:01.642163573Z [2024-03-28 03:09:01,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:09:01.684029329Z [2024-03-28 03:09:01,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:09:01.745882646Z [2024-03-28 03:09:01,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:09:01.827908054Z [2024-03-28 03:09:01,827: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:09:01.832187380Z [2024-03-28 03:09:01,831: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:09:01.859987843Z [2024-03-28 03:09:01,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:09:01.861647666Z [2024-03-28 03:09:01,861: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:09:01.861705071Z [2024-03-28 03:09:01,861: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:09:01.861797707Z [2024-03-28 03:09:01,861: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:09:01.861980903Z [2024-03-28 03:09:01,861: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:09:01.964306587Z [2024-03-28 03:09:01,963: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:09:02.683223985Z [2024-03-28 03:09:02,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fa5d13c-986b-44d3-a6af-8e2c46f0a8bb] succeeded in 1.4292686650005635s: None 2024-03-28T03:09:03.081560443Z [2024-03-28 03:09:03,081: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:09:03.085164488Z [2024-03-28 03:09:03,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:09:03.109944603Z [2024-03-28 03:09:03,109: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:09:03.112093095Z [2024-03-28 03:09:03,111: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:09:03.112265284Z [2024-03-28 03:09:03,112: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:09:03.112611323Z [2024-03-28 03:09:03,112: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:09:03.112773973Z [2024-03-28 03:09:03,112: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:09:03.113157558Z [2024-03-28 03:09:03,112: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:09:03.113865561Z [2024-03-28 03:09:03,113: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:09:03.259516575Z [2024-03-28 03:09:03,259: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:09:03.379121573Z [2024-03-28 03:09:03,378: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:09:03.383575972Z [2024-03-28 03:09:03,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:09:03.417628312Z [2024-03-28 03:09:03,417: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:09:03.419103976Z [2024-03-28 03:09:03,418: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:09:03.419201779Z [2024-03-28 03:09:03,419: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:09:03.419356631Z [2024-03-28 03:09:03,419: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:09:03.419440063Z [2024-03-28 03:09:03,419: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:09:03.419747357Z [2024-03-28 03:09:03,419: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:09:03.419815583Z [2024-03-28 03:09:03,419: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:09:03.521231745Z [2024-03-28 03:09:03,520: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:09:05.072492242Z [2024-03-28 03:09:05,071: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dea2daca-d9f5-4ab3-a6ae-48edad12bb50] succeeded in 3.792861849999099s: None 2024-03-28T03:09:05.266637957Z [2024-03-28 03:09:05,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e89c50d6-1d73-41e7-9ba7-76418cb3cd7c] succeeded in 4.009968223999749s: None 2024-03-28T03:10:01.102438894Z [2024-03-28 03:10:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdcacab0-6eaf-420e-b8a2-7727ffb75421] received 2024-03-28T03:10:01.124939799Z [2024-03-28 03:10:01,122: INFO/ForkPoolWorker-15] [bdcacab0-6eaf-420e-b8a2-7727ffb75421] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:10:01.133573739Z [2024-03-28 03:10:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d837b4a-6c88-4db0-8447-0ce7ea2e82b8] received 2024-03-28T03:10:01.136395150Z [2024-03-28 03:10:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea6928b-83d0-407f-9b68-63912449a637] received 2024-03-28T03:10:01.142126202Z [2024-03-28 03:10:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a42da0f4-b0ba-40c0-9df4-a2e746acf36c] received 2024-03-28T03:10:01.149164982Z [2024-03-28 03:10:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78146ab0-cb9f-4a73-b663-157f73c2cb69] received 2024-03-28T03:10:01.169283677Z [2024-03-28 03:10:01,167: INFO/ForkPoolWorker-16] [4d837b4a-6c88-4db0-8447-0ce7ea2e82b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:10:01.186374377Z [2024-03-28 03:10:01,185: INFO/ForkPoolWorker-2] [a42da0f4-b0ba-40c0-9df4-a2e746acf36c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:10:01.200817167Z [2024-03-28 03:10:01,199: INFO/ForkPoolWorker-1] [6ea6928b-83d0-407f-9b68-63912449a637] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:10:01.239393524Z [2024-03-28 03:10:01,235: INFO/ForkPoolWorker-3] [78146ab0-cb9f-4a73-b663-157f73c2cb69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:10:02.315545622Z [2024-03-28 03:10:02,303: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:10:02.672266209Z [2024-03-28 03:10:02,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:10:03.027946185Z [2024-03-28 03:10:02,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:10:03.077669025Z [2024-03-28 03:10:03,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:10:03.142158972Z [2024-03-28 03:10:03,110: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:10:04.426512620Z [2024-03-28 03:10:04,426: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:10:04.471474574Z [2024-03-28 03:10:04,470: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:04.660484028Z [2024-03-28 03:10:04,660: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:10:04.666962556Z [2024-03-28 03:10:04,666: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:10:04.667551666Z [2024-03-28 03:10:04,666: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:10:04.667801060Z [2024-03-28 03:10:04,667: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:10:04.668261701Z [2024-03-28 03:10:04,668: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:10:04.675916094Z [2024-03-28 03:10:04,675: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:04.945762250Z [2024-03-28 03:10:04,945: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:06.003233755Z [2024-03-28 03:10:06,001: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a42da0f4-b0ba-40c0-9df4-a2e746acf36c] succeeded in 4.852614474999427s: None 2024-03-28T03:10:06.659691657Z [2024-03-28 03:10:06,659: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:10:06.667453825Z [2024-03-28 03:10:06,666: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:06.762919168Z [2024-03-28 03:10:06,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:10:06.765392599Z [2024-03-28 03:10:06,764: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:06.765412359Z [2024-03-28 03:10:06,765: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:06.765420310Z [2024-03-28 03:10:06,765: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:06.765424443Z [2024-03-28 03:10:06,765: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:10:06.766288349Z [2024-03-28 03:10:06,766: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:10:06.766455494Z [2024-03-28 03:10:06,766: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:07.040803221Z [2024-03-28 03:10:07,037: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:07.306818644Z [2024-03-28 03:10:07,306: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T03:10:07.310630966Z [2024-03-28 03:10:07,310: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:07.365719429Z [2024-03-28 03:10:07,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdcacab0-6eaf-420e-b8a2-7727ffb75421] succeeded in 6.255340921999959s: None 2024-03-28T03:10:07.415437352Z [2024-03-28 03:10:07,414: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T03:10:07.445895830Z [2024-03-28 03:10:07,423: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:07.446745071Z [2024-03-28 03:10:07,446: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:07.447996653Z [2024-03-28 03:10:07,446: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:07.448012254Z [2024-03-28 03:10:07,447: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T03:10:07.448865828Z [2024-03-28 03:10:07,448: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:10:07.450061830Z [2024-03-28 03:10:07,448: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:07.591117234Z [2024-03-28 03:10:07,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:10:07.593556824Z [2024-03-28 03:10:07,593: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:07.594678861Z [2024-03-28 03:10:07,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:07.650840490Z [2024-03-28 03:10:07,650: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:10:07.653943620Z [2024-03-28 03:10:07,653: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:07.654123047Z [2024-03-28 03:10:07,653: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:07.654458047Z [2024-03-28 03:10:07,654: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:07.654616928Z [2024-03-28 03:10:07,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:10:07.655112078Z [2024-03-28 03:10:07,654: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:10:07.655776212Z [2024-03-28 03:10:07,655: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:07.817285533Z [2024-03-28 03:10:07,811: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:09.267097854Z [2024-03-28 03:10:09,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d837b4a-6c88-4db0-8447-0ce7ea2e82b8] succeeded in 8.13209489700057s: None 2024-03-28T03:10:09.878872844Z [2024-03-28 03:10:09,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2e6726b-a6ba-4ae6-a6d2-17a3d2e2c65e] received 2024-03-28T03:10:09.891747180Z [2024-03-28 03:10:09,891: INFO/ForkPoolWorker-15] [a2e6726b-a6ba-4ae6-a6d2-17a3d2e2c65e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:10:10.090176055Z [2024-03-28 03:10:10,089: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ea6928b-83d0-407f-9b68-63912449a637] succeeded in 8.943141818001095s: None 2024-03-28T03:10:10.109319090Z [2024-03-28 03:10:10,108: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[78146ab0-cb9f-4a73-b663-157f73c2cb69] succeeded in 8.95152046900148s: None 2024-03-28T03:10:10.335490603Z [2024-03-28 03:10:10,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:10:11.923467562Z [2024-03-28 03:10:11,923: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:10:11.927697457Z [2024-03-28 03:10:11,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:11.961353137Z [2024-03-28 03:10:11,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:10:11.963057859Z [2024-03-28 03:10:11,962: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:11.963279275Z [2024-03-28 03:10:11,963: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:11.963521363Z [2024-03-28 03:10:11,963: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:11.963693470Z [2024-03-28 03:10:11,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:10:11.964083199Z [2024-03-28 03:10:11,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:10:11.964264070Z [2024-03-28 03:10:11,964: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:12.047510518Z [2024-03-28 03:10:12,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:12.711422109Z [2024-03-28 03:10:12,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2e6726b-a6ba-4ae6-a6d2-17a3d2e2c65e] succeeded in 2.8310456390008767s: None 2024-03-28T03:10:13.625821722Z [2024-03-28 03:10:13,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91133695-908f-40e5-b6a1-9d863a32a020] received 2024-03-28T03:10:13.655937175Z [2024-03-28 03:10:13,655: INFO/ForkPoolWorker-15] [91133695-908f-40e5-b6a1-9d863a32a020] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:10:13.941788704Z [2024-03-28 03:10:13,938: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:10:15.098670763Z [2024-03-28 03:10:15,098: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:10:15.101977856Z [2024-03-28 03:10:15,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:15.125456147Z [2024-03-28 03:10:15,125: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:10:15.130673698Z [2024-03-28 03:10:15,130: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:15.130715283Z [2024-03-28 03:10:15,130: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:15.130932181Z [2024-03-28 03:10:15,130: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:15.131101776Z [2024-03-28 03:10:15,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:10:15.131483334Z [2024-03-28 03:10:15,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:10:15.131589569Z [2024-03-28 03:10:15,131: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:15.244414647Z [2024-03-28 03:10:15,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:15.966412146Z [2024-03-28 03:10:15,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91133695-908f-40e5-b6a1-9d863a32a020] succeeded in 2.339289984000061s: None 2024-03-28T03:10:16.173411262Z [2024-03-28 03:10:16,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99372619-d625-4993-8ee1-e4e44653019a] received 2024-03-28T03:10:16.191886031Z [2024-03-28 03:10:16,191: INFO/ForkPoolWorker-15] [99372619-d625-4993-8ee1-e4e44653019a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:10:16.516813253Z [2024-03-28 03:10:16,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:10:17.869613530Z [2024-03-28 03:10:17,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:10:17.873453141Z [2024-03-28 03:10:17,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:10:17.894280484Z [2024-03-28 03:10:17,894: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:10:17.895689225Z [2024-03-28 03:10:17,895: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:10:17.896259441Z [2024-03-28 03:10:17,896: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:10:17.896376653Z [2024-03-28 03:10:17,896: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:10:17.896427592Z [2024-03-28 03:10:17,896: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:10:17.896638229Z [2024-03-28 03:10:17,896: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:10:17.896693765Z [2024-03-28 03:10:17,896: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:10:17.982030915Z [2024-03-28 03:10:17,981: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:10:18.582979262Z [2024-03-28 03:10:18,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99372619-d625-4993-8ee1-e4e44653019a] succeeded in 2.4017339120000543s: None 2024-03-28T03:11:00.450218129Z [2024-03-28 03:11:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be5cbcc2-793d-4819-84d7-492d2365e5c6] received 2024-03-28T03:11:00.454917745Z [2024-03-28 03:11:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d75c5c2c-eca4-4709-94b9-c62b631fd41d] received 2024-03-28T03:11:00.467089701Z [2024-03-28 03:11:00,466: INFO/ForkPoolWorker-15] [be5cbcc2-793d-4819-84d7-492d2365e5c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:11:00.470365240Z [2024-03-28 03:11:00,469: INFO/ForkPoolWorker-16] [d75c5c2c-eca4-4709-94b9-c62b631fd41d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:11:00.471169820Z [2024-03-28 03:11:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed83a4b1-a4b9-4a0b-8a5e-8d11fb3073d8] received 2024-03-28T03:11:00.493798994Z [2024-03-28 03:11:00,493: INFO/ForkPoolWorker-1] [ed83a4b1-a4b9-4a0b-8a5e-8d11fb3073d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:11:00.954001384Z [2024-03-28 03:11:00,949: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:11:00.982541674Z [2024-03-28 03:11:00,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:11:01.009142579Z [2024-03-28 03:11:01,004: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:11:01.279018450Z [2024-03-28 03:11:01,278: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:11:01.285786667Z [2024-03-28 03:11:01,284: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:11:01.334648863Z [2024-03-28 03:11:01,334: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:11:01.336226827Z [2024-03-28 03:11:01,335: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:11:01.336432833Z [2024-03-28 03:11:01,336: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:11:01.336583617Z [2024-03-28 03:11:01,336: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:11:01.336991038Z [2024-03-28 03:11:01,336: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:11:01.462690045Z [2024-03-28 03:11:01,462: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:11:02.166140957Z [2024-03-28 03:11:02,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed83a4b1-a4b9-4a0b-8a5e-8d11fb3073d8] succeeded in 1.6914868039984867s: None 2024-03-28T03:11:02.568291847Z [2024-03-28 03:11:02,567: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:11:02.575121310Z [2024-03-28 03:11:02,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:11:02.601662594Z [2024-03-28 03:11:02,601: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:11:02.603300081Z [2024-03-28 03:11:02,603: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:11:02.603376380Z [2024-03-28 03:11:02,603: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:11:02.603677010Z [2024-03-28 03:11:02,603: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:11:02.603772045Z [2024-03-28 03:11:02,603: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:11:02.604487293Z [2024-03-28 03:11:02,604: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:11:02.604644409Z [2024-03-28 03:11:02,604: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:11:02.711767772Z [2024-03-28 03:11:02,711: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:11:02.827128931Z [2024-03-28 03:11:02,826: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:11:02.831205275Z [2024-03-28 03:11:02,830: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:11:02.858127194Z [2024-03-28 03:11:02,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:11:02.859693755Z [2024-03-28 03:11:02,859: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:11:02.859843821Z [2024-03-28 03:11:02,859: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:11:02.860075083Z [2024-03-28 03:11:02,859: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:11:02.860123159Z [2024-03-28 03:11:02,860: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:11:02.860439476Z [2024-03-28 03:11:02,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:11:02.860464206Z [2024-03-28 03:11:02,860: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:11:02.946935149Z [2024-03-28 03:11:02,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:11:04.710277625Z [2024-03-28 03:11:04,709: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d75c5c2c-eca4-4709-94b9-c62b631fd41d] succeeded in 4.250787859000411s: None 2024-03-28T03:11:05.952521684Z [2024-03-28 03:11:05,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be5cbcc2-793d-4819-84d7-492d2365e5c6] succeeded in 5.496286112000234s: None 2024-03-28T03:12:00.299653521Z [2024-03-28 03:12:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8faba609-552d-43d1-8ac5-03fa715d1409] received 2024-03-28T03:12:00.302032530Z [2024-03-28 03:12:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4c3be90-cce2-4804-afda-3b33e3415285] received 2024-03-28T03:12:00.311993572Z [2024-03-28 03:12:00,311: INFO/ForkPoolWorker-15] [8faba609-552d-43d1-8ac5-03fa715d1409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:12:00.315514115Z [2024-03-28 03:12:00,315: INFO/ForkPoolWorker-16] [d4c3be90-cce2-4804-afda-3b33e3415285] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:12:00.317500819Z [2024-03-28 03:12:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2179e50-7da7-42e2-8793-cdaadfbde4f1] received 2024-03-28T03:12:00.326839459Z [2024-03-28 03:12:00,326: INFO/ForkPoolWorker-1] [a2179e50-7da7-42e2-8793-cdaadfbde4f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:12:00.335246397Z [2024-03-28 03:12:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4974b940-c9f4-4128-915c-8f2147eead9a] received 2024-03-28T03:12:00.348720150Z [2024-03-28 03:12:00,348: INFO/ForkPoolWorker-2] [4974b940-c9f4-4128-915c-8f2147eead9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:12:00.638874619Z [2024-03-28 03:12:00,635: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:12:00.649740730Z [2024-03-28 03:12:00,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:12:00.722658075Z [2024-03-28 03:12:00,719: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:12:00.802718552Z [2024-03-28 03:12:00,802: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:12:00.806721985Z [2024-03-28 03:12:00,806: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:12:00.843822883Z [2024-03-28 03:12:00,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:12:00.844877744Z [2024-03-28 03:12:00,844: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:12:00.845073504Z [2024-03-28 03:12:00,844: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:12:00.845242871Z [2024-03-28 03:12:00,845: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:12:00.845961470Z [2024-03-28 03:12:00,845: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:12:00.857572272Z [2024-03-28 03:12:00,854: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:12:01.014681545Z [2024-03-28 03:12:01,014: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:12:01.089233550Z [2024-03-28 03:12:01,088: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:12:01.808329913Z [2024-03-28 03:12:01,787: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2179e50-7da7-42e2-8793-cdaadfbde4f1] succeeded in 1.4678020470000774s: None 2024-03-28T03:12:01.856732078Z [2024-03-28 03:12:01,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4c3be90-cce2-4804-afda-3b33e3415285] succeeded in 1.5515864300014073s: None 2024-03-28T03:12:02.229144587Z [2024-03-28 03:12:02,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:12:02.233821733Z [2024-03-28 03:12:02,233: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:12:02.285314536Z [2024-03-28 03:12:02,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:12:02.291329549Z [2024-03-28 03:12:02,290: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:12:02.291369203Z [2024-03-28 03:12:02,291: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:12:02.291546800Z [2024-03-28 03:12:02,291: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:12:02.291641219Z [2024-03-28 03:12:02,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:12:02.292057497Z [2024-03-28 03:12:02,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:12:02.292148602Z [2024-03-28 03:12:02,292: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:12:02.429799117Z [2024-03-28 03:12:02,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:12:02.482177699Z [2024-03-28 03:12:02,481: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:12:02.485839510Z [2024-03-28 03:12:02,485: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:12:02.535714067Z [2024-03-28 03:12:02,535: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:12:02.563739779Z [2024-03-28 03:12:02,563: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:12:02.566450679Z [2024-03-28 03:12:02,563: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:12:02.567017752Z [2024-03-28 03:12:02,566: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:12:02.567364675Z [2024-03-28 03:12:02,567: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:12:02.581264029Z [2024-03-28 03:12:02,580: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:12:02.603347115Z [2024-03-28 03:12:02,602: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:12:02.762370459Z [2024-03-28 03:12:02,762: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:12:04.136433964Z [2024-03-28 03:12:04,135: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8faba609-552d-43d1-8ac5-03fa715d1409] succeeded in 3.8337332230003085s: None 2024-03-28T03:12:04.776670305Z [2024-03-28 03:12:04,776: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4974b940-c9f4-4128-915c-8f2147eead9a] succeeded in 4.439326790999985s: None 2024-03-28T03:13:00.242528139Z [2024-03-28 03:13:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6714b838-3d1b-472d-ad62-b04fd72fcc34] received 2024-03-28T03:13:00.246470123Z [2024-03-28 03:13:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2fef62b-7296-41f7-8e27-eb1566168707] received 2024-03-28T03:13:00.255338406Z [2024-03-28 03:13:00,255: INFO/ForkPoolWorker-15] [6714b838-3d1b-472d-ad62-b04fd72fcc34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:13:00.260502470Z [2024-03-28 03:13:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33b8b1e0-0dce-44b2-a229-2aebfe6c5c24] received 2024-03-28T03:13:00.261390615Z [2024-03-28 03:13:00,261: INFO/ForkPoolWorker-16] [e2fef62b-7296-41f7-8e27-eb1566168707] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:13:00.276656624Z [2024-03-28 03:13:00,276: INFO/ForkPoolWorker-1] [33b8b1e0-0dce-44b2-a229-2aebfe6c5c24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:13:00.650361059Z [2024-03-28 03:13:00,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:13:00.653416587Z [2024-03-28 03:13:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:13:00.689835897Z [2024-03-28 03:13:00,686: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:13:00.819432169Z [2024-03-28 03:13:00,819: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:13:00.823533485Z [2024-03-28 03:13:00,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:13:00.856675939Z [2024-03-28 03:13:00,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:13:00.858217400Z [2024-03-28 03:13:00,857: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:13:00.858429431Z [2024-03-28 03:13:00,858: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:13:00.858580573Z [2024-03-28 03:13:00,858: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:13:00.858919128Z [2024-03-28 03:13:00,858: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:13:00.963305514Z [2024-03-28 03:13:00,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:13:01.641156447Z [2024-03-28 03:13:01,640: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2fef62b-7296-41f7-8e27-eb1566168707] succeeded in 1.3925939299988386s: None 2024-03-28T03:13:01.873223591Z [2024-03-28 03:13:01,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:13:01.877139118Z [2024-03-28 03:13:01,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:13:01.898701587Z [2024-03-28 03:13:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:13:01.904029720Z [2024-03-28 03:13:01,903: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:13:01.904839897Z [2024-03-28 03:13:01,904: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:13:01.905108685Z [2024-03-28 03:13:01,904: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:13:01.905316099Z [2024-03-28 03:13:01,905: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:13:01.905903744Z [2024-03-28 03:13:01,905: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:13:01.906085865Z [2024-03-28 03:13:01,905: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:13:02.023511059Z [2024-03-28 03:13:02,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:13:02.037131403Z [2024-03-28 03:13:02,036: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:13:02.040702138Z [2024-03-28 03:13:02,040: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:13:02.064666584Z [2024-03-28 03:13:02,064: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:13:02.066403887Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:13:02.066430033Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:13:02.066596528Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:13:02.066647881Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:13:02.066936699Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:13:02.066988533Z [2024-03-28 03:13:02,066: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:13:02.173090304Z [2024-03-28 03:13:02,172: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:13:03.923131629Z [2024-03-28 03:13:03,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6714b838-3d1b-472d-ad62-b04fd72fcc34] succeeded in 3.675214541999594s: None 2024-03-28T03:13:04.367453199Z [2024-03-28 03:13:04,366: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33b8b1e0-0dce-44b2-a229-2aebfe6c5c24] succeeded in 4.098543532998519s: None 2024-03-28T03:14:00.675365105Z [2024-03-28 03:14:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0a5315b-c4d9-4ef1-aa19-e040bc4f6d33] received 2024-03-28T03:14:00.681672541Z [2024-03-28 03:14:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d32c16-c936-4982-b949-426cdd005803] received 2024-03-28T03:14:00.681696220Z [2024-03-28 03:14:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a45de157-49dd-4213-9bd8-2db6565c831c] received 2024-03-28T03:14:00.682564460Z [2024-03-28 03:14:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0afa9e1-1748-4eb7-9b58-fd13ea84e063] received 2024-03-28T03:14:00.688900470Z [2024-03-28 03:14:00,688: INFO/ForkPoolWorker-15] [e0a5315b-c4d9-4ef1-aa19-e040bc4f6d33] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:14:00.689355255Z [2024-03-28 03:14:00,689: INFO/ForkPoolWorker-1] [a45de157-49dd-4213-9bd8-2db6565c831c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:14:00.693564323Z [2024-03-28 03:14:00,693: INFO/ForkPoolWorker-2] [a0afa9e1-1748-4eb7-9b58-fd13ea84e063] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:14:00.703024567Z [2024-03-28 03:14:00,702: INFO/ForkPoolWorker-16] [77d32c16-c936-4982-b949-426cdd005803] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:14:01.022416704Z [2024-03-28 03:14:01,018: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:14:01.038214069Z [2024-03-28 03:14:01,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:14:01.245273200Z [2024-03-28 03:14:01,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:14:01.277588804Z [2024-03-28 03:14:01,274: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:14:01.346949749Z [2024-03-28 03:14:01,346: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:14:01.366504064Z [2024-03-28 03:14:01,365: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:14:01.436226904Z [2024-03-28 03:14:01,435: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:14:01.446323738Z [2024-03-28 03:14:01,445: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:14:01.446477671Z [2024-03-28 03:14:01,446: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:14:01.455575399Z [2024-03-28 03:14:01,446: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:14:01.455931605Z [2024-03-28 03:14:01,455: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:14:01.710127531Z [2024-03-28 03:14:01,709: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:14:01.914880726Z [2024-03-28 03:14:01,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:14:02.617172580Z [2024-03-28 03:14:02,616: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0a5315b-c4d9-4ef1-aa19-e040bc4f6d33] succeeded in 1.936203408999063s: None 2024-03-28T03:14:03.007238786Z [2024-03-28 03:14:03,006: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0afa9e1-1748-4eb7-9b58-fd13ea84e063] succeeded in 2.3211104500005604s: None 2024-03-28T03:14:03.069586998Z [2024-03-28 03:14:03,069: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:14:03.073457654Z [2024-03-28 03:14:03,072: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:14:03.096412516Z [2024-03-28 03:14:03,096: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:14:03.097914286Z [2024-03-28 03:14:03,097: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:14:03.098081356Z [2024-03-28 03:14:03,097: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:14:03.098479996Z [2024-03-28 03:14:03,098: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:14:03.099021289Z [2024-03-28 03:14:03,098: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:14:03.099382125Z [2024-03-28 03:14:03,099: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:14:03.099958304Z [2024-03-28 03:14:03,099: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:14:03.182712387Z [2024-03-28 03:14:03,182: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:14:03.644103263Z [2024-03-28 03:14:03,642: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:14:03.653678210Z [2024-03-28 03:14:03,652: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:14:03.708783747Z [2024-03-28 03:14:03,705: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:14:03.708941139Z [2024-03-28 03:14:03,707: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:14:03.708948134Z [2024-03-28 03:14:03,707: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:14:03.708952953Z [2024-03-28 03:14:03,707: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:14:03.708957261Z [2024-03-28 03:14:03,708: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:14:03.709316893Z [2024-03-28 03:14:03,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:14:03.709872590Z [2024-03-28 03:14:03,709: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:14:03.846742721Z [2024-03-28 03:14:03,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:14:05.226958824Z [2024-03-28 03:14:05,226: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a45de157-49dd-4213-9bd8-2db6565c831c] succeeded in 4.543098023999846s: None 2024-03-28T03:14:05.599788456Z [2024-03-28 03:14:05,599: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77d32c16-c936-4982-b949-426cdd005803] succeeded in 4.916681638000227s: None 2024-03-28T03:15:01.112019942Z [2024-03-28 03:15:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6ee2a44-9df3-4dfb-bdde-5ae6a8621e81] received 2024-03-28T03:15:01.115704107Z [2024-03-28 03:15:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ab3d181-eaae-4ad5-9e15-2e25c0476a0a] received 2024-03-28T03:15:01.119556940Z [2024-03-28 03:15:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[041912a7-ab3b-4c52-af02-7c0e297fc973] received 2024-03-28T03:15:01.126307951Z [2024-03-28 03:15:01,125: INFO/ForkPoolWorker-15] [a6ee2a44-9df3-4dfb-bdde-5ae6a8621e81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:15:01.128475200Z [2024-03-28 03:15:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a900b09f-ec6f-4beb-ae36-5ea8619cd4fe] received 2024-03-28T03:15:01.129323368Z [2024-03-28 03:15:01,128: INFO/ForkPoolWorker-16] [3ab3d181-eaae-4ad5-9e15-2e25c0476a0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:15:01.130794657Z [2024-03-28 03:15:01,130: INFO/ForkPoolWorker-1] [041912a7-ab3b-4c52-af02-7c0e297fc973] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:15:01.147994552Z [2024-03-28 03:15:01,147: INFO/ForkPoolWorker-2] [a900b09f-ec6f-4beb-ae36-5ea8619cd4fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:15:01.517151413Z [2024-03-28 03:15:01,513: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:15:01.530073118Z [2024-03-28 03:15:01,526: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:15:01.669983151Z [2024-03-28 03:15:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:15:01.696046117Z [2024-03-28 03:15:01,695: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:15:01.700501540Z [2024-03-28 03:15:01,699: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:01.733029348Z [2024-03-28 03:15:01,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:15:01.738773776Z [2024-03-28 03:15:01,738: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:15:01.738978076Z [2024-03-28 03:15:01,738: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:15:01.739154059Z [2024-03-28 03:15:01,738: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:15:01.739577878Z [2024-03-28 03:15:01,739: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:15:01.754205345Z [2024-03-28 03:15:01,750: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:15:01.849728085Z [2024-03-28 03:15:01,849: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:02.572187092Z [2024-03-28 03:15:02,571: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a900b09f-ec6f-4beb-ae36-5ea8619cd4fe] succeeded in 1.4362575800005288s: None 2024-03-28T03:15:03.010157012Z [2024-03-28 03:15:03,009: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:15:03.014108749Z [2024-03-28 03:15:03,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:03.043374782Z [2024-03-28 03:15:03,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:15:03.046738287Z [2024-03-28 03:15:03,046: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:03.047165670Z [2024-03-28 03:15:03,046: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:03.047526355Z [2024-03-28 03:15:03,047: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:03.047777283Z [2024-03-28 03:15:03,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:15:03.048778363Z [2024-03-28 03:15:03,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:15:03.049007046Z [2024-03-28 03:15:03,048: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:03.190027533Z [2024-03-28 03:15:03,189: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:03.277577631Z [2024-03-28 03:15:03,277: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:15:03.281466804Z [2024-03-28 03:15:03,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:03.350510391Z [2024-03-28 03:15:03,350: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:15:03.354364709Z [2024-03-28 03:15:03,353: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:03.354463446Z [2024-03-28 03:15:03,354: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:03.354642644Z [2024-03-28 03:15:03,354: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:03.354805362Z [2024-03-28 03:15:03,354: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:15:03.355185244Z [2024-03-28 03:15:03,354: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:15:03.364040547Z [2024-03-28 03:15:03,361: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:03.503946626Z [2024-03-28 03:15:03,503: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:15:03.508049381Z [2024-03-28 03:15:03,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:03.514063302Z [2024-03-28 03:15:03,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:03.572303253Z [2024-03-28 03:15:03,572: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:15:03.574291885Z [2024-03-28 03:15:03,574: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:03.574507602Z [2024-03-28 03:15:03,574: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:03.574764469Z [2024-03-28 03:15:03,574: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:03.574914912Z [2024-03-28 03:15:03,574: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:15:03.575427098Z [2024-03-28 03:15:03,575: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:15:03.575538570Z [2024-03-28 03:15:03,575: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:03.708539502Z [2024-03-28 03:15:03,708: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:04.055250172Z [2024-03-28 03:15:04,054: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6ee2a44-9df3-4dfb-bdde-5ae6a8621e81] succeeded in 2.9403238909999345s: None 2024-03-28T03:15:05.002159445Z [2024-03-28 03:15:05,001: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4e3bd27-050d-475f-8e45-f0cff6735e5c] received 2024-03-28T03:15:05.010846917Z [2024-03-28 03:15:05,010: INFO/ForkPoolWorker-15] [a4e3bd27-050d-475f-8e45-f0cff6735e5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:15:05.314497750Z [2024-03-28 03:15:05,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:15:05.558698518Z [2024-03-28 03:15:05,558: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[041912a7-ab3b-4c52-af02-7c0e297fc973] succeeded in 4.4341821760008315s: None 2024-03-28T03:15:05.651558020Z [2024-03-28 03:15:05,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ab3d181-eaae-4ad5-9e15-2e25c0476a0a] succeeded in 4.533174177999172s: None 2024-03-28T03:15:06.558654113Z [2024-03-28 03:15:06,558: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:15:06.562274276Z [2024-03-28 03:15:06,561: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:06.582289328Z [2024-03-28 03:15:06,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:15:06.584315011Z [2024-03-28 03:15:06,583: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:06.584407916Z [2024-03-28 03:15:06,584: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:06.584582133Z [2024-03-28 03:15:06,584: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:06.584647526Z [2024-03-28 03:15:06,584: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:15:06.585038774Z [2024-03-28 03:15:06,584: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:15:06.585103592Z [2024-03-28 03:15:06,584: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:06.710449320Z [2024-03-28 03:15:06,710: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:07.422074365Z [2024-03-28 03:15:07,421: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4e3bd27-050d-475f-8e45-f0cff6735e5c] succeeded in 2.4178418409992446s: None 2024-03-28T03:15:07.568992602Z [2024-03-28 03:15:07,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b42ad98f-9b24-49e9-865f-f2ee49527833] received 2024-03-28T03:15:07.576366271Z [2024-03-28 03:15:07,576: INFO/ForkPoolWorker-15] [b42ad98f-9b24-49e9-865f-f2ee49527833] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:15:07.924022576Z [2024-03-28 03:15:07,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:15:09.324761241Z [2024-03-28 03:15:09,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:15:09.328739832Z [2024-03-28 03:15:09,328: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:09.358807656Z [2024-03-28 03:15:09,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:15:09.360407239Z [2024-03-28 03:15:09,360: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:09.360760988Z [2024-03-28 03:15:09,360: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:09.361092137Z [2024-03-28 03:15:09,360: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:09.361337507Z [2024-03-28 03:15:09,361: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:15:09.361772182Z [2024-03-28 03:15:09,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:15:09.362130765Z [2024-03-28 03:15:09,361: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:09.451379857Z [2024-03-28 03:15:09,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:11.176396787Z [2024-03-28 03:15:11,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e0f2790-a5fc-4780-8237-8be621949dda] received 2024-03-28T03:15:11.190215533Z [2024-03-28 03:15:11,189: INFO/ForkPoolWorker-16] [1e0f2790-a5fc-4780-8237-8be621949dda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:15:11.287109450Z [2024-03-28 03:15:11,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b42ad98f-9b24-49e9-865f-f2ee49527833] succeeded in 3.716527951999524s: None 2024-03-28T03:15:11.618907507Z [2024-03-28 03:15:11,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:15:12.776977257Z [2024-03-28 03:15:12,776: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:15:12.780470587Z [2024-03-28 03:15:12,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:15:12.803054214Z [2024-03-28 03:15:12,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:15:12.805131575Z [2024-03-28 03:15:12,804: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:15:12.805152441Z [2024-03-28 03:15:12,805: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:15:12.805275586Z [2024-03-28 03:15:12,805: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:15:12.805346491Z [2024-03-28 03:15:12,805: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:15:12.805796872Z [2024-03-28 03:15:12,805: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:15:12.805813164Z [2024-03-28 03:15:12,805: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:15:12.903691037Z [2024-03-28 03:15:12,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:15:13.453908230Z [2024-03-28 03:15:13,453: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e0f2790-a5fc-4780-8237-8be621949dda] succeeded in 2.2751915989992995s: None 2024-03-28T03:16:00.368088451Z [2024-03-28 03:16:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4fe3c4b-1abb-4a33-a630-397d84046456] received 2024-03-28T03:16:00.374512670Z [2024-03-28 03:16:00,374: INFO/ForkPoolWorker-15] [c4fe3c4b-1abb-4a33-a630-397d84046456] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:16:00.375034264Z [2024-03-28 03:16:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[528ce859-60ee-4411-845b-75e97a867a26] received 2024-03-28T03:16:00.386648124Z [2024-03-28 03:16:00,386: INFO/ForkPoolWorker-16] [528ce859-60ee-4411-845b-75e97a867a26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:16:00.391036447Z [2024-03-28 03:16:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edb38185-e38e-4eea-95c3-e3154458c109] received 2024-03-28T03:16:00.395522058Z [2024-03-28 03:16:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71e762cb-10fd-44d8-9cbd-0ac2ed11b679] received 2024-03-28T03:16:00.403751793Z [2024-03-28 03:16:00,403: INFO/ForkPoolWorker-1] [edb38185-e38e-4eea-95c3-e3154458c109] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:16:00.405592507Z [2024-03-28 03:16:00,405: INFO/ForkPoolWorker-2] [71e762cb-10fd-44d8-9cbd-0ac2ed11b679] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:16:00.738011152Z [2024-03-28 03:16:00,734: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:16:00.756210900Z [2024-03-28 03:16:00,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:16:00.817631741Z [2024-03-28 03:16:00,813: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:16:00.905388054Z [2024-03-28 03:16:00,901: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:16:00.915079157Z [2024-03-28 03:16:00,914: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:16:00.919151284Z [2024-03-28 03:16:00,918: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:16:00.946360529Z [2024-03-28 03:16:00,946: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:16:00.948730491Z [2024-03-28 03:16:00,948: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:16:00.948830165Z [2024-03-28 03:16:00,948: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:16:00.948849825Z [2024-03-28 03:16:00,948: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:16:00.949037562Z [2024-03-28 03:16:00,948: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:16:01.068847628Z [2024-03-28 03:16:01,068: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:16:01.314360735Z [2024-03-28 03:16:01,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:16:01.835535548Z [2024-03-28 03:16:01,835: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[71e762cb-10fd-44d8-9cbd-0ac2ed11b679] succeeded in 1.4364311499994074s: None 2024-03-28T03:16:02.095778799Z [2024-03-28 03:16:02,095: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4fe3c4b-1abb-4a33-a630-397d84046456] succeeded in 1.7261563080010092s: None 2024-03-28T03:16:02.436551043Z [2024-03-28 03:16:02,436: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:16:02.440384630Z [2024-03-28 03:16:02,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:16:02.460882565Z [2024-03-28 03:16:02,460: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:16:02.462463513Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:16:02.462481842Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:16:02.462602628Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:16:02.462632855Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:16:02.462916700Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:16:02.463047751Z [2024-03-28 03:16:02,462: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:16:02.583771376Z [2024-03-28 03:16:02,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:16:02.756378115Z [2024-03-28 03:16:02,755: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:16:02.760139584Z [2024-03-28 03:16:02,759: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:16:02.786047690Z [2024-03-28 03:16:02,785: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:16:02.787543576Z [2024-03-28 03:16:02,787: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:16:02.787703182Z [2024-03-28 03:16:02,787: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:16:02.787898492Z [2024-03-28 03:16:02,787: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:16:02.788081675Z [2024-03-28 03:16:02,787: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:16:02.788437767Z [2024-03-28 03:16:02,788: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:16:02.789591330Z [2024-03-28 03:16:02,789: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:16:02.922460090Z [2024-03-28 03:16:02,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:16:04.625052310Z [2024-03-28 03:16:04,624: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edb38185-e38e-4eea-95c3-e3154458c109] succeeded in 4.231721162999747s: None 2024-03-28T03:16:04.747908811Z [2024-03-28 03:16:04,747: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[528ce859-60ee-4411-845b-75e97a867a26] succeeded in 4.370748549999917s: None 2024-03-28T03:17:00.725457272Z [2024-03-28 03:17:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e150d28b-05d0-4c46-b841-3415b4a83a80] received 2024-03-28T03:17:00.734170233Z [2024-03-28 03:17:00,733: INFO/ForkPoolWorker-15] [e150d28b-05d0-4c46-b841-3415b4a83a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:17:00.754262304Z [2024-03-28 03:17:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd729d0c-2660-4816-b180-0d549da45b8a] received 2024-03-28T03:17:00.758791217Z [2024-03-28 03:17:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0157e07a-672d-4cef-b632-b2fcc78f30ac] received 2024-03-28T03:17:00.760986329Z [2024-03-28 03:17:00,760: INFO/ForkPoolWorker-16] [bd729d0c-2660-4816-b180-0d549da45b8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:17:00.769931688Z [2024-03-28 03:17:00,769: INFO/ForkPoolWorker-1] [0157e07a-672d-4cef-b632-b2fcc78f30ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:17:01.144872018Z [2024-03-28 03:17:01,140: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:17:01.222158431Z [2024-03-28 03:17:01,218: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:17:01.363832800Z [2024-03-28 03:17:01,363: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:17:01.370734466Z [2024-03-28 03:17:01,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:17:01.408681563Z [2024-03-28 03:17:01,408: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:17:01.410654522Z [2024-03-28 03:17:01,410: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:17:01.411052948Z [2024-03-28 03:17:01,410: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:17:01.411236689Z [2024-03-28 03:17:01,411: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:17:01.411566117Z [2024-03-28 03:17:01,411: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:17:01.479326153Z [2024-03-28 03:17:01,472: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:17:01.541107216Z [2024-03-28 03:17:01,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:17:02.325735494Z [2024-03-28 03:17:02,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0157e07a-672d-4cef-b632-b2fcc78f30ac] succeeded in 1.5643169400009356s: None 2024-03-28T03:17:02.648831212Z [2024-03-28 03:17:02,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:17:02.652732060Z [2024-03-28 03:17:02,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:17:02.674765476Z [2024-03-28 03:17:02,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:17:02.677802039Z [2024-03-28 03:17:02,677: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:17:02.678049630Z [2024-03-28 03:17:02,677: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:17:02.678487229Z [2024-03-28 03:17:02,678: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:17:02.678654523Z [2024-03-28 03:17:02,678: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:17:02.679457910Z [2024-03-28 03:17:02,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:17:02.679538242Z [2024-03-28 03:17:02,679: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:17:02.799269356Z [2024-03-28 03:17:02,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:17:03.193359105Z [2024-03-28 03:17:03,192: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:17:03.197251904Z [2024-03-28 03:17:03,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:17:03.220039845Z [2024-03-28 03:17:03,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:17:03.221617084Z [2024-03-28 03:17:03,221: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:17:03.221775148Z [2024-03-28 03:17:03,221: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:17:03.222053579Z [2024-03-28 03:17:03,221: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:17:03.222279230Z [2024-03-28 03:17:03,222: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:17:03.222772833Z [2024-03-28 03:17:03,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:17:03.222948841Z [2024-03-28 03:17:03,222: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:17:03.330925086Z [2024-03-28 03:17:03,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:17:04.524462114Z [2024-03-28 03:17:04,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e150d28b-05d0-4c46-b841-3415b4a83a80] succeeded in 3.7972429589990497s: None 2024-03-28T03:17:05.397985585Z [2024-03-28 03:17:05,397: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd729d0c-2660-4816-b180-0d549da45b8a] succeeded in 4.641575246001594s: None 2024-03-28T03:18:00.221519300Z [2024-03-28 03:18:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f381a10-2f6a-4498-b6b0-c2945cda0255] received 2024-03-28T03:18:00.224712563Z [2024-03-28 03:18:00,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[512e9e3c-5f2b-4481-9049-7afa4ecdb88b] received 2024-03-28T03:18:00.227590307Z [2024-03-28 03:18:00,227: INFO/ForkPoolWorker-15] [5f381a10-2f6a-4498-b6b0-c2945cda0255] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:18:00.237287963Z [2024-03-28 03:18:00,233: INFO/ForkPoolWorker-16] [512e9e3c-5f2b-4481-9049-7afa4ecdb88b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:18:00.237327710Z [2024-03-28 03:18:00,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87866272-e3ae-4678-b365-18fb29042696] received 2024-03-28T03:18:00.242083996Z [2024-03-28 03:18:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96dc4a4c-2203-448a-b044-bbb299e9cf04] received 2024-03-28T03:18:00.245319065Z [2024-03-28 03:18:00,245: INFO/ForkPoolWorker-1] [87866272-e3ae-4678-b365-18fb29042696] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:18:00.259837894Z [2024-03-28 03:18:00,259: INFO/ForkPoolWorker-2] [96dc4a4c-2203-448a-b044-bbb299e9cf04] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:18:00.558162096Z [2024-03-28 03:18:00,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:18:00.608711995Z [2024-03-28 03:18:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:18:00.684280903Z [2024-03-28 03:18:00,679: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:18:00.733233946Z [2024-03-28 03:18:00,729: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:18:00.861103268Z [2024-03-28 03:18:00,860: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:18:00.870234629Z [2024-03-28 03:18:00,869: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:18:00.931175148Z [2024-03-28 03:18:00,930: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:18:00.934766082Z [2024-03-28 03:18:00,934: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:18:00.934979097Z [2024-03-28 03:18:00,934: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:18:00.935072737Z [2024-03-28 03:18:00,934: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:18:00.935418366Z [2024-03-28 03:18:00,935: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:18:01.040261753Z [2024-03-28 03:18:01,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:18:01.049242887Z [2024-03-28 03:18:01,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:18:01.879057962Z [2024-03-28 03:18:01,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f381a10-2f6a-4498-b6b0-c2945cda0255] succeeded in 1.6557911460004107s: None 2024-03-28T03:18:01.994961382Z [2024-03-28 03:18:01,994: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[96dc4a4c-2203-448a-b044-bbb299e9cf04] succeeded in 1.7498619819998567s: None 2024-03-28T03:18:02.255314737Z [2024-03-28 03:18:02,254: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:18:02.258919463Z [2024-03-28 03:18:02,258: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:18:02.292687404Z [2024-03-28 03:18:02,292: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:18:02.296128705Z [2024-03-28 03:18:02,295: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:18:02.296380187Z [2024-03-28 03:18:02,296: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:18:02.296683236Z [2024-03-28 03:18:02,296: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:18:02.296900190Z [2024-03-28 03:18:02,296: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:18:02.297822177Z [2024-03-28 03:18:02,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:18:02.298102470Z [2024-03-28 03:18:02,297: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:18:02.386932716Z [2024-03-28 03:18:02,386: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:18:02.543122934Z [2024-03-28 03:18:02,542: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:18:02.548428613Z [2024-03-28 03:18:02,547: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:18:02.582921432Z [2024-03-28 03:18:02,582: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:18:02.585461506Z [2024-03-28 03:18:02,584: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:18:02.585667737Z [2024-03-28 03:18:02,585: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:18:02.586035053Z [2024-03-28 03:18:02,585: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:18:02.586193892Z [2024-03-28 03:18:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:18:02.586960275Z [2024-03-28 03:18:02,586: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:18:02.587297840Z [2024-03-28 03:18:02,586: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:18:02.687728291Z [2024-03-28 03:18:02,687: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:18:04.205295524Z [2024-03-28 03:18:04,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87866272-e3ae-4678-b365-18fb29042696] succeeded in 3.9661506520005787s: None 2024-03-28T03:18:04.540622225Z [2024-03-28 03:18:04,540: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[512e9e3c-5f2b-4481-9049-7afa4ecdb88b] succeeded in 4.314311819998693s: None 2024-03-28T03:19:00.342473665Z [2024-03-28 03:19:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b45fcc44-904c-4790-8259-6186fd107c77] received 2024-03-28T03:19:00.347810281Z [2024-03-28 03:19:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46e6d1eb-f28e-4e7e-bf36-a8d5291af526] received 2024-03-28T03:19:00.351329000Z [2024-03-28 03:19:00,351: INFO/ForkPoolWorker-15] [b45fcc44-904c-4790-8259-6186fd107c77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:19:00.359059389Z [2024-03-28 03:19:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f855631-4804-4e5f-8332-fccd00ec3750] received 2024-03-28T03:19:00.363764985Z [2024-03-28 03:19:00,363: INFO/ForkPoolWorker-16] [46e6d1eb-f28e-4e7e-bf36-a8d5291af526] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:19:00.363996975Z [2024-03-28 03:19:00,363: INFO/ForkPoolWorker-1] [2f855631-4804-4e5f-8332-fccd00ec3750] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:19:00.644894932Z [2024-03-28 03:19:00,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:19:00.674423402Z [2024-03-28 03:19:00,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:19:00.728840309Z [2024-03-28 03:19:00,725: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:19:00.902114127Z [2024-03-28 03:19:00,901: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:19:00.906386630Z [2024-03-28 03:19:00,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:19:00.939537534Z [2024-03-28 03:19:00,939: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:19:00.942703032Z [2024-03-28 03:19:00,942: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:19:00.942778538Z [2024-03-28 03:19:00,942: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:19:00.942889309Z [2024-03-28 03:19:00,942: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:19:00.943684773Z [2024-03-28 03:19:00,943: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:19:01.087046434Z [2024-03-28 03:19:01,086: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:19:01.722683042Z [2024-03-28 03:19:01,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f855631-4804-4e5f-8332-fccd00ec3750] succeeded in 1.3622425269986707s: None 2024-03-28T03:19:01.920583244Z [2024-03-28 03:19:01,920: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:19:01.924156991Z [2024-03-28 03:19:01,923: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:19:01.950701893Z [2024-03-28 03:19:01,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:19:01.954881161Z [2024-03-28 03:19:01,954: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:19:01.954929698Z [2024-03-28 03:19:01,954: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:19:01.955275226Z [2024-03-28 03:19:01,954: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:19:01.955443113Z [2024-03-28 03:19:01,955: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:19:01.955911584Z [2024-03-28 03:19:01,955: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:19:01.956107787Z [2024-03-28 03:19:01,955: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:19:02.048316229Z [2024-03-28 03:19:02,047: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:19:02.052015151Z [2024-03-28 03:19:02,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:19:02.057408550Z [2024-03-28 03:19:02,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:19:02.073528862Z [2024-03-28 03:19:02,073: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:19:02.075195145Z [2024-03-28 03:19:02,074: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:19:02.075235995Z [2024-03-28 03:19:02,075: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:19:02.075503947Z [2024-03-28 03:19:02,075: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:19:02.075744422Z [2024-03-28 03:19:02,075: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:19:02.076043051Z [2024-03-28 03:19:02,075: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:19:02.076089284Z [2024-03-28 03:19:02,075: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:19:02.168793847Z [2024-03-28 03:19:02,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:19:03.637061754Z [2024-03-28 03:19:03,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46e6d1eb-f28e-4e7e-bf36-a8d5291af526] succeeded in 3.2867502359986247s: None 2024-03-28T03:19:04.281770782Z [2024-03-28 03:19:04,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b45fcc44-904c-4790-8259-6186fd107c77] succeeded in 3.936680906001129s: None 2024-03-28T03:20:00.352259760Z [2024-03-28 03:20:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95726309-b5e2-45aa-910c-c320dc1dbfb7] received 2024-03-28T03:20:00.355153373Z [2024-03-28 03:20:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df26a57b-f3b3-4c18-af69-2230d82edd5c] received 2024-03-28T03:20:00.359307045Z [2024-03-28 03:20:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f564944d-f3c0-40f2-ae59-9de98916da2b] received 2024-03-28T03:20:00.360964031Z [2024-03-28 03:20:00,360: INFO/ForkPoolWorker-16] [df26a57b-f3b3-4c18-af69-2230d82edd5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:20:00.362286719Z [2024-03-28 03:20:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69a4bd42-3991-412b-95a6-3d85bfe9ef54] received 2024-03-28T03:20:00.364166840Z [2024-03-28 03:20:00,363: INFO/ForkPoolWorker-15] [95726309-b5e2-45aa-910c-c320dc1dbfb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:20:00.365584659Z [2024-03-28 03:20:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97daa63e-5f1a-484f-af02-79b304cd4291] received 2024-03-28T03:20:00.367841570Z [2024-03-28 03:20:00,367: INFO/ForkPoolWorker-2] [69a4bd42-3991-412b-95a6-3d85bfe9ef54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:20:00.370809583Z [2024-03-28 03:20:00,370: INFO/ForkPoolWorker-1] [f564944d-f3c0-40f2-ae59-9de98916da2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:20:00.391982195Z [2024-03-28 03:20:00,391: INFO/ForkPoolWorker-3] [97daa63e-5f1a-484f-af02-79b304cd4291] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:20:00.858097076Z [2024-03-28 03:20:00,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:20:00.891673265Z [2024-03-28 03:20:00,886: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:20:01.011519287Z [2024-03-28 03:20:00,999: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:20:01.028882788Z [2024-03-28 03:20:01,021: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:20:01.119958089Z [2024-03-28 03:20:01,108: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:20:01.417351420Z [2024-03-28 03:20:01,416: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T03:20:01.422204805Z [2024-03-28 03:20:01,421: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:01.468987274Z [2024-03-28 03:20:01,468: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T03:20:01.470793160Z [2024-03-28 03:20:01,470: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:20:01.470852850Z [2024-03-28 03:20:01,470: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:20:01.470901410Z [2024-03-28 03:20:01,470: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T03:20:01.471168459Z [2024-03-28 03:20:01,471: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:20:01.630148761Z [2024-03-28 03:20:01,629: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:01.720705958Z [2024-03-28 03:20:01,720: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:02.598330385Z [2024-03-28 03:20:02,597: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[97daa63e-5f1a-484f-af02-79b304cd4291] succeeded in 2.226487628000541s: None 2024-03-28T03:20:02.610719960Z [2024-03-28 03:20:02,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f564944d-f3c0-40f2-ae59-9de98916da2b] succeeded in 2.2462962710014835s: None 2024-03-28T03:20:02.654224299Z [2024-03-28 03:20:02,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:20:02.658034196Z [2024-03-28 03:20:02,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:02.684384939Z [2024-03-28 03:20:02,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:20:02.686725596Z [2024-03-28 03:20:02,686: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:02.687108783Z [2024-03-28 03:20:02,686: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:02.687779238Z [2024-03-28 03:20:02,687: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:02.688031958Z [2024-03-28 03:20:02,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:20:02.689668823Z [2024-03-28 03:20:02,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:20:02.689965745Z [2024-03-28 03:20:02,689: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:02.826741809Z [2024-03-28 03:20:02,826: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:02.943574423Z [2024-03-28 03:20:02,943: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:20:02.947452539Z [2024-03-28 03:20:02,946: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:02.984070921Z [2024-03-28 03:20:02,983: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:20:02.989960150Z [2024-03-28 03:20:02,989: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:02.990226194Z [2024-03-28 03:20:02,989: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:02.990648181Z [2024-03-28 03:20:02,990: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:02.990931117Z [2024-03-28 03:20:02,990: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:20:02.991663713Z [2024-03-28 03:20:02,991: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:20:02.991910724Z [2024-03-28 03:20:02,991: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:03.132608899Z [2024-03-28 03:20:03,132: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:20:03.136809852Z [2024-03-28 03:20:03,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:03.142751047Z [2024-03-28 03:20:03,142: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:03.165239707Z [2024-03-28 03:20:03,164: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:20:03.167333297Z [2024-03-28 03:20:03,166: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:03.167382661Z [2024-03-28 03:20:03,167: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:03.167509329Z [2024-03-28 03:20:03,167: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:03.167524398Z [2024-03-28 03:20:03,167: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:20:03.167974809Z [2024-03-28 03:20:03,167: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:20:03.168011299Z [2024-03-28 03:20:03,167: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:03.251577917Z [2024-03-28 03:20:03,251: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:03.980402179Z [2024-03-28 03:20:03,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df26a57b-f3b3-4c18-af69-2230d82edd5c] succeeded in 3.623983675999625s: None 2024-03-28T03:20:04.558241191Z [2024-03-28 03:20:04,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b09911c1-934a-47ac-b37d-e33360fcf4e0] received 2024-03-28T03:20:04.568670319Z [2024-03-28 03:20:04,568: INFO/ForkPoolWorker-16] [b09911c1-934a-47ac-b37d-e33360fcf4e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:20:04.878809431Z [2024-03-28 03:20:04,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95726309-b5e2-45aa-910c-c320dc1dbfb7] succeeded in 4.522129404000225s: None 2024-03-28T03:20:04.925857818Z [2024-03-28 03:20:04,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:20:05.770395313Z [2024-03-28 03:20:05,769: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69a4bd42-3991-412b-95a6-3d85bfe9ef54] succeeded in 5.406596820999766s: None 2024-03-28T03:20:06.150549922Z [2024-03-28 03:20:06,150: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:20:06.154083817Z [2024-03-28 03:20:06,153: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:06.175898237Z [2024-03-28 03:20:06,175: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:20:06.177367935Z [2024-03-28 03:20:06,177: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:06.177381806Z [2024-03-28 03:20:06,177: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:06.177709133Z [2024-03-28 03:20:06,177: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:06.177879243Z [2024-03-28 03:20:06,177: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:20:06.178497957Z [2024-03-28 03:20:06,178: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:20:06.178585511Z [2024-03-28 03:20:06,178: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:06.260376031Z [2024-03-28 03:20:06,259: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:06.889844856Z [2024-03-28 03:20:06,889: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b09911c1-934a-47ac-b37d-e33360fcf4e0] succeeded in 2.3300481580008636s: None 2024-03-28T03:20:06.996821497Z [2024-03-28 03:20:06,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3e19d9b-b6d8-426b-a8a5-2abced179639] received 2024-03-28T03:20:07.003637768Z [2024-03-28 03:20:07,003: INFO/ForkPoolWorker-15] [c3e19d9b-b6d8-426b-a8a5-2abced179639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:20:07.367543551Z [2024-03-28 03:20:07,364: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:20:08.683602924Z [2024-03-28 03:20:08,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:20:08.687214460Z [2024-03-28 03:20:08,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:08.708385295Z [2024-03-28 03:20:08,708: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:20:08.710310969Z [2024-03-28 03:20:08,710: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:08.710345534Z [2024-03-28 03:20:08,710: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:08.710561427Z [2024-03-28 03:20:08,710: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:08.710643096Z [2024-03-28 03:20:08,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:20:08.711831080Z [2024-03-28 03:20:08,711: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:20:08.711880511Z [2024-03-28 03:20:08,711: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:08.811813937Z [2024-03-28 03:20:08,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:10.475330687Z [2024-03-28 03:20:10,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3e19d9b-b6d8-426b-a8a5-2abced179639] succeeded in 3.4769456169997284s: None 2024-03-28T03:20:10.622469928Z [2024-03-28 03:20:10,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[575944e0-8cac-4204-9c51-0975e21fe506] received 2024-03-28T03:20:10.642921145Z [2024-03-28 03:20:10,642: INFO/ForkPoolWorker-15] [575944e0-8cac-4204-9c51-0975e21fe506] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:20:11.103153076Z [2024-03-28 03:20:11,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:20:12.396142333Z [2024-03-28 03:20:12,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:20:12.400470181Z [2024-03-28 03:20:12,399: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:20:12.421359945Z [2024-03-28 03:20:12,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:20:12.424437663Z [2024-03-28 03:20:12,424: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:20:12.424525525Z [2024-03-28 03:20:12,424: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:20:12.424714669Z [2024-03-28 03:20:12,424: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:20:12.425227401Z [2024-03-28 03:20:12,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:20:12.425242307Z [2024-03-28 03:20:12,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:20:12.425271076Z [2024-03-28 03:20:12,425: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:20:12.541446744Z [2024-03-28 03:20:12,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:20:13.133613346Z [2024-03-28 03:20:13,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[575944e0-8cac-4204-9c51-0975e21fe506] succeeded in 2.498934597999323s: None 2024-03-28T03:21:00.204852228Z [2024-03-28 03:21:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ca20b2f-2b4a-4c63-8d60-16ea1b8f6292] received 2024-03-28T03:21:00.214085439Z [2024-03-28 03:21:00,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2ce0306-7d76-42d4-a425-e28e4222a3a1] received 2024-03-28T03:21:00.216108280Z [2024-03-28 03:21:00,215: INFO/ForkPoolWorker-15] [9ca20b2f-2b4a-4c63-8d60-16ea1b8f6292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:21:00.221709054Z [2024-03-28 03:21:00,221: INFO/ForkPoolWorker-16] [a2ce0306-7d76-42d4-a425-e28e4222a3a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:21:00.234153909Z [2024-03-28 03:21:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3bdba79-eb5b-4f0c-926c-b7ce30fe84d5] received 2024-03-28T03:21:00.247711549Z [2024-03-28 03:21:00,247: INFO/ForkPoolWorker-1] [c3bdba79-eb5b-4f0c-926c-b7ce30fe84d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:21:00.564531404Z [2024-03-28 03:21:00,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:21:00.621952426Z [2024-03-28 03:21:00,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:21:00.679948404Z [2024-03-28 03:21:00,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:21:00.841929443Z [2024-03-28 03:21:00,841: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:21:00.846305398Z [2024-03-28 03:21:00,845: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:21:00.873989138Z [2024-03-28 03:21:00,873: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:21:00.875928017Z [2024-03-28 03:21:00,875: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:21:00.876124041Z [2024-03-28 03:21:00,875: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:21:00.876218508Z [2024-03-28 03:21:00,876: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:21:00.876481031Z [2024-03-28 03:21:00,876: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:21:00.972353527Z [2024-03-28 03:21:00,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:21:01.762931812Z [2024-03-28 03:21:01,762: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3bdba79-eb5b-4f0c-926c-b7ce30fe84d5] succeeded in 1.5272584470003494s: None 2024-03-28T03:21:01.987854677Z [2024-03-28 03:21:01,987: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:21:01.991792026Z [2024-03-28 03:21:01,991: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:21:02.015297066Z [2024-03-28 03:21:02,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:21:02.017330365Z [2024-03-28 03:21:02,017: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:21:02.018333540Z [2024-03-28 03:21:02,018: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:21:02.018620360Z [2024-03-28 03:21:02,018: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:21:02.018807281Z [2024-03-28 03:21:02,018: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:21:02.019394393Z [2024-03-28 03:21:02,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:21:02.019591848Z [2024-03-28 03:21:02,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:21:02.052016942Z [2024-03-28 03:21:02,051: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:21:02.055606958Z [2024-03-28 03:21:02,055: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:21:02.089097645Z [2024-03-28 03:21:02,088: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:21:02.091074337Z [2024-03-28 03:21:02,090: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:21:02.091716550Z [2024-03-28 03:21:02,091: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:21:02.091987734Z [2024-03-28 03:21:02,091: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:21:02.092705209Z [2024-03-28 03:21:02,092: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:21:02.093555289Z [2024-03-28 03:21:02,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:21:02.093782033Z [2024-03-28 03:21:02,093: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:21:02.126369262Z [2024-03-28 03:21:02,126: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:21:02.192013599Z [2024-03-28 03:21:02,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:21:03.808813001Z [2024-03-28 03:21:03,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ca20b2f-2b4a-4c63-8d60-16ea1b8f6292] succeeded in 3.6005348869985028s: None 2024-03-28T03:21:04.074037587Z [2024-03-28 03:21:04,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2ce0306-7d76-42d4-a425-e28e4222a3a1] succeeded in 3.857727967999381s: None 2024-03-28T03:22:01.034818629Z [2024-03-28 03:22:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ace9a00-2f93-434a-8f20-ae7f0c61e8d1] received 2024-03-28T03:22:01.042188802Z [2024-03-28 03:22:01,041: INFO/ForkPoolWorker-15] [7ace9a00-2f93-434a-8f20-ae7f0c61e8d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:22:01.044694993Z [2024-03-28 03:22:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94f98ae0-86b2-49b7-8e0c-28d54035c4ec] received 2024-03-28T03:22:01.052905585Z [2024-03-28 03:22:01,052: INFO/ForkPoolWorker-16] [94f98ae0-86b2-49b7-8e0c-28d54035c4ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:22:01.056192018Z [2024-03-28 03:22:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6018283f-ab78-4322-81d8-b96d49dae6dd] received 2024-03-28T03:22:01.058260182Z [2024-03-28 03:22:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eabd1f80-4b54-4d8d-99d9-c9796e7bfa5e] received 2024-03-28T03:22:01.062687914Z [2024-03-28 03:22:01,062: INFO/ForkPoolWorker-1] [6018283f-ab78-4322-81d8-b96d49dae6dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:22:01.065030840Z [2024-03-28 03:22:01,064: INFO/ForkPoolWorker-2] [eabd1f80-4b54-4d8d-99d9-c9796e7bfa5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:22:01.402506047Z [2024-03-28 03:22:01,399: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:22:01.474777031Z [2024-03-28 03:22:01,471: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:22:01.506192733Z [2024-03-28 03:22:01,503: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:22:01.509038174Z [2024-03-28 03:22:01,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:22:01.771785238Z [2024-03-28 03:22:01,771: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:22:01.794272785Z [2024-03-28 03:22:01,793: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:22:01.876338055Z [2024-03-28 03:22:01,876: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:22:01.877887397Z [2024-03-28 03:22:01,877: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:22:01.883086096Z [2024-03-28 03:22:01,882: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:22:01.883126736Z [2024-03-28 03:22:01,882: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:22:01.883131486Z [2024-03-28 03:22:01,883: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:22:01.883384473Z [2024-03-28 03:22:01,883: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:22:02.062664535Z [2024-03-28 03:22:02,062: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:22:02.696251537Z [2024-03-28 03:22:02,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ace9a00-2f93-434a-8f20-ae7f0c61e8d1] succeeded in 1.6586384450001788s: None 2024-03-28T03:22:02.848237242Z [2024-03-28 03:22:02,847: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eabd1f80-4b54-4d8d-99d9-c9796e7bfa5e] succeeded in 1.7882497369992052s: None 2024-03-28T03:22:03.180518204Z [2024-03-28 03:22:03,180: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:22:03.184240280Z [2024-03-28 03:22:03,183: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:22:03.207547347Z [2024-03-28 03:22:03,207: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:22:03.208879679Z [2024-03-28 03:22:03,208: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:22:03.208898295Z [2024-03-28 03:22:03,208: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:22:03.209021882Z [2024-03-28 03:22:03,208: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:22:03.209086345Z [2024-03-28 03:22:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:22:03.209365109Z [2024-03-28 03:22:03,209: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:22:03.209386412Z [2024-03-28 03:22:03,209: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:22:03.259505756Z [2024-03-28 03:22:03,259: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:22:03.263441921Z [2024-03-28 03:22:03,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:22:03.295658883Z [2024-03-28 03:22:03,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:22:03.297130271Z [2024-03-28 03:22:03,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:22:03.298187411Z [2024-03-28 03:22:03,297: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:22:03.298456055Z [2024-03-28 03:22:03,298: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:22:03.298786434Z [2024-03-28 03:22:03,298: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:22:03.299008915Z [2024-03-28 03:22:03,298: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:22:03.299502055Z [2024-03-28 03:22:03,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:22:03.299873260Z [2024-03-28 03:22:03,299: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:22:03.427415029Z [2024-03-28 03:22:03,427: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:22:04.937927727Z [2024-03-28 03:22:04,937: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6018283f-ab78-4322-81d8-b96d49dae6dd] succeeded in 3.880159704000107s: None 2024-03-28T03:22:05.144653911Z [2024-03-28 03:22:05,144: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94f98ae0-86b2-49b7-8e0c-28d54035c4ec] succeeded in 4.097371398998803s: None 2024-03-28T03:23:00.760312244Z [2024-03-28 03:23:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[641790d3-ba62-48eb-9881-8d538be247b3] received 2024-03-28T03:23:00.763631002Z [2024-03-28 03:23:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[739352d7-8d70-4e36-a870-57d9e95d6708] received 2024-03-28T03:23:00.768440943Z [2024-03-28 03:23:00,768: INFO/ForkPoolWorker-15] [641790d3-ba62-48eb-9881-8d538be247b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:23:00.769560243Z [2024-03-28 03:23:00,769: INFO/ForkPoolWorker-16] [739352d7-8d70-4e36-a870-57d9e95d6708] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:23:00.773022247Z [2024-03-28 03:23:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f972182-2aaa-4471-9f69-94a1045297a6] received 2024-03-28T03:23:00.792742183Z [2024-03-28 03:23:00,792: INFO/ForkPoolWorker-1] [8f972182-2aaa-4471-9f69-94a1045297a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:23:01.094668689Z [2024-03-28 03:23:01,091: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:23:01.101838578Z [2024-03-28 03:23:01,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:23:01.108546056Z [2024-03-28 03:23:01,105: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:23:01.258623408Z [2024-03-28 03:23:01,258: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:23:01.263178151Z [2024-03-28 03:23:01,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:23:01.289971233Z [2024-03-28 03:23:01,289: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:23:01.294672493Z [2024-03-28 03:23:01,294: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:23:01.294769020Z [2024-03-28 03:23:01,294: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:23:01.294842285Z [2024-03-28 03:23:01,294: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:23:01.295162141Z [2024-03-28 03:23:01,295: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:23:01.396967685Z [2024-03-28 03:23:01,396: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:23:02.033149877Z [2024-03-28 03:23:02,032: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f972182-2aaa-4471-9f69-94a1045297a6] succeeded in 1.2580313959988416s: None 2024-03-28T03:23:02.405038444Z [2024-03-28 03:23:02,404: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:23:02.408756583Z [2024-03-28 03:23:02,408: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:23:02.431534971Z [2024-03-28 03:23:02,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:23:02.432882060Z [2024-03-28 03:23:02,432: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:23:02.432915133Z [2024-03-28 03:23:02,432: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:23:02.433149815Z [2024-03-28 03:23:02,432: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:23:02.433248299Z [2024-03-28 03:23:02,433: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:23:02.433676536Z [2024-03-28 03:23:02,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:23:02.433698785Z [2024-03-28 03:23:02,433: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:23:02.451011214Z [2024-03-28 03:23:02,450: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:23:02.454574622Z [2024-03-28 03:23:02,454: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:23:02.477884120Z [2024-03-28 03:23:02,477: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:23:02.479241872Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:23:02.479393611Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:23:02.479620835Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:23:02.479643976Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:23:02.480069349Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:23:02.480082350Z [2024-03-28 03:23:02,479: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:23:02.520631370Z [2024-03-28 03:23:02,520: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:23:02.606201432Z [2024-03-28 03:23:02,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:23:04.169870664Z [2024-03-28 03:23:04,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[739352d7-8d70-4e36-a870-57d9e95d6708] succeeded in 3.4043439810011478s: None 2024-03-28T03:23:04.544908750Z [2024-03-28 03:23:04,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[641790d3-ba62-48eb-9881-8d538be247b3] succeeded in 3.7820243869991828s: None 2024-03-28T03:24:00.469025069Z [2024-03-28 03:24:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dd747f1-93e4-4016-bc19-e151ad712f65] received 2024-03-28T03:24:00.474501442Z [2024-03-28 03:24:00,474: INFO/ForkPoolWorker-15] [5dd747f1-93e4-4016-bc19-e151ad712f65] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:24:00.480598628Z [2024-03-28 03:24:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3595c20-3eff-4292-b1b2-363dfa2a00bb] received 2024-03-28T03:24:00.485010032Z [2024-03-28 03:24:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a65249d2-54b0-49e2-bc51-e8bbc0a9fe62] received 2024-03-28T03:24:00.489629646Z [2024-03-28 03:24:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2714852-a617-4658-bf03-316e9304b8c6] received 2024-03-28T03:24:00.493439048Z [2024-03-28 03:24:00,493: INFO/ForkPoolWorker-16] [a3595c20-3eff-4292-b1b2-363dfa2a00bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:24:00.494675872Z [2024-03-28 03:24:00,494: INFO/ForkPoolWorker-1] [a65249d2-54b0-49e2-bc51-e8bbc0a9fe62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:24:00.497309679Z [2024-03-28 03:24:00,497: INFO/ForkPoolWorker-2] [e2714852-a617-4658-bf03-316e9304b8c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:24:00.811484141Z [2024-03-28 03:24:00,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:24:00.826002100Z [2024-03-28 03:24:00,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:24:00.892621730Z [2024-03-28 03:24:00,889: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:24:00.913511555Z [2024-03-28 03:24:00,910: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:24:01.084297789Z [2024-03-28 03:24:01,083: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:24:01.088393431Z [2024-03-28 03:24:01,087: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:24:01.097712564Z [2024-03-28 03:24:01,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:24:01.115478897Z [2024-03-28 03:24:01,115: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:24:01.122514793Z [2024-03-28 03:24:01,122: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:24:01.122947133Z [2024-03-28 03:24:01,122: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:24:01.123090813Z [2024-03-28 03:24:01,122: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:24:01.123411309Z [2024-03-28 03:24:01,123: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:24:01.233469265Z [2024-03-28 03:24:01,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:24:01.735099433Z [2024-03-28 03:24:01,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dd747f1-93e4-4016-bc19-e151ad712f65] succeeded in 1.2649154549999366s: None 2024-03-28T03:24:02.037394109Z [2024-03-28 03:24:02,036: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e2714852-a617-4658-bf03-316e9304b8c6] succeeded in 1.5463341240010777s: None 2024-03-28T03:24:02.184482780Z [2024-03-28 03:24:02,184: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:24:02.188262384Z [2024-03-28 03:24:02,187: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:24:02.210265739Z [2024-03-28 03:24:02,210: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:24:02.212310795Z [2024-03-28 03:24:02,212: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:24:02.212474403Z [2024-03-28 03:24:02,212: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:24:02.212708930Z [2024-03-28 03:24:02,212: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:24:02.212875426Z [2024-03-28 03:24:02,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:24:02.213360881Z [2024-03-28 03:24:02,213: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:24:02.213579344Z [2024-03-28 03:24:02,213: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:24:02.323710605Z [2024-03-28 03:24:02,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:24:02.598871730Z [2024-03-28 03:24:02,598: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:24:02.602432041Z [2024-03-28 03:24:02,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:24:02.623831641Z [2024-03-28 03:24:02,623: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:24:02.625823549Z [2024-03-28 03:24:02,625: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:24:02.625872168Z [2024-03-28 03:24:02,625: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:24:02.626156398Z [2024-03-28 03:24:02,625: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:24:02.626253518Z [2024-03-28 03:24:02,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:24:02.626691312Z [2024-03-28 03:24:02,626: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:24:02.626700121Z [2024-03-28 03:24:02,626: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:24:02.710310266Z [2024-03-28 03:24:02,710: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:24:04.183084947Z [2024-03-28 03:24:04,182: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3595c20-3eff-4292-b1b2-363dfa2a00bb] succeeded in 3.6967079780006316s: None 2024-03-28T03:24:04.546469501Z [2024-03-28 03:24:04,546: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a65249d2-54b0-49e2-bc51-e8bbc0a9fe62] succeeded in 4.06008760000077s: None 2024-03-28T03:25:00.810530094Z [2024-03-28 03:25:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7f8b81d-daea-4dbd-b38e-e318d89eddd1] received 2024-03-28T03:25:00.814531690Z [2024-03-28 03:25:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20c23bc7-189d-49e8-b365-ed817ad276c6] received 2024-03-28T03:25:00.818976864Z [2024-03-28 03:25:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a66ffd4-099a-405c-a52e-3ea431b28b99] received 2024-03-28T03:25:00.822626312Z [2024-03-28 03:25:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2049e9ac-044e-48de-80b4-aeea791edd70] received 2024-03-28T03:25:00.829261274Z [2024-03-28 03:25:00,828: INFO/ForkPoolWorker-15] [b7f8b81d-daea-4dbd-b38e-e318d89eddd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:25:00.832763928Z [2024-03-28 03:25:00,832: INFO/ForkPoolWorker-2] [2049e9ac-044e-48de-80b4-aeea791edd70] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:25:00.833025461Z [2024-03-28 03:25:00,832: INFO/ForkPoolWorker-1] [1a66ffd4-099a-405c-a52e-3ea431b28b99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:25:00.839680067Z [2024-03-28 03:25:00,839: INFO/ForkPoolWorker-16] [20c23bc7-189d-49e8-b365-ed817ad276c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:25:01.212615070Z [2024-03-28 03:25:01,209: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:25:01.273178724Z [2024-03-28 03:25:01,269: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:25:01.369804334Z [2024-03-28 03:25:01,366: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:25:01.415470431Z [2024-03-28 03:25:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:25:01.614046717Z [2024-03-28 03:25:01,613: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:25:01.619111365Z [2024-03-28 03:25:01,618: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:01.646831048Z [2024-03-28 03:25:01,646: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:25:01.648092979Z [2024-03-28 03:25:01,647: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:25:01.648385429Z [2024-03-28 03:25:01,648: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:25:01.648510563Z [2024-03-28 03:25:01,648: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:25:01.648846136Z [2024-03-28 03:25:01,648: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:25:01.825964063Z [2024-03-28 03:25:01,825: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:02.527339056Z [2024-03-28 03:25:02,526: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2049e9ac-044e-48de-80b4-aeea791edd70] succeeded in 1.702285106999625s: None 2024-03-28T03:25:02.667541833Z [2024-03-28 03:25:02,667: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:25:02.671329918Z [2024-03-28 03:25:02,670: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:02.692884152Z [2024-03-28 03:25:02,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:25:02.694623644Z [2024-03-28 03:25:02,694: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:02.694760014Z [2024-03-28 03:25:02,694: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:02.694970667Z [2024-03-28 03:25:02,694: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:02.695119841Z [2024-03-28 03:25:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:25:02.695542120Z [2024-03-28 03:25:02,695: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:25:02.695570431Z [2024-03-28 03:25:02,695: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:02.813136942Z [2024-03-28 03:25:02,812: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:02.825717338Z [2024-03-28 03:25:02,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:25:02.830233617Z [2024-03-28 03:25:02,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:02.863059717Z [2024-03-28 03:25:02,862: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:25:02.868546598Z [2024-03-28 03:25:02,868: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:02.868579171Z [2024-03-28 03:25:02,868: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:02.868825637Z [2024-03-28 03:25:02,868: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:02.869010083Z [2024-03-28 03:25:02,868: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:25:02.869425732Z [2024-03-28 03:25:02,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:25:02.870224904Z [2024-03-28 03:25:02,870: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:02.967349711Z [2024-03-28 03:25:02,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:02.978610266Z [2024-03-28 03:25:02,978: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:25:02.982603437Z [2024-03-28 03:25:02,982: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:03.042134626Z [2024-03-28 03:25:03,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:25:03.046216585Z [2024-03-28 03:25:03,045: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:03.046384130Z [2024-03-28 03:25:03,046: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:03.046660347Z [2024-03-28 03:25:03,046: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:03.046828729Z [2024-03-28 03:25:03,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:25:03.047330461Z [2024-03-28 03:25:03,047: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:25:03.047417060Z [2024-03-28 03:25:03,047: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:03.202325527Z [2024-03-28 03:25:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:03.743238006Z [2024-03-28 03:25:03,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7f8b81d-daea-4dbd-b38e-e318d89eddd1] succeeded in 2.9296417300010944s: None 2024-03-28T03:25:04.332077231Z [2024-03-28 03:25:04,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c7f41e1-79e6-47c1-ac6a-a395b44ba10e] received 2024-03-28T03:25:04.341587071Z [2024-03-28 03:25:04,341: INFO/ForkPoolWorker-15] [0c7f41e1-79e6-47c1-ac6a-a395b44ba10e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:25:04.614982986Z [2024-03-28 03:25:04,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:25:05.475455657Z [2024-03-28 03:25:05,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20c23bc7-189d-49e8-b365-ed817ad276c6] succeeded in 4.65617318600016s: None 2024-03-28T03:25:05.662966530Z [2024-03-28 03:25:05,661: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a66ffd4-099a-405c-a52e-3ea431b28b99] succeeded in 4.8402904009999475s: None 2024-03-28T03:25:05.803682313Z [2024-03-28 03:25:05,803: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:25:05.807015798Z [2024-03-28 03:25:05,806: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:05.829257674Z [2024-03-28 03:25:05,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:25:05.831091883Z [2024-03-28 03:25:05,830: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:05.831256700Z [2024-03-28 03:25:05,831: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:05.831604917Z [2024-03-28 03:25:05,831: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:05.831683244Z [2024-03-28 03:25:05,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:25:05.832165753Z [2024-03-28 03:25:05,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:25:05.832519850Z [2024-03-28 03:25:05,832: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:05.923948759Z [2024-03-28 03:25:05,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:06.680338765Z [2024-03-28 03:25:06,679: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c7f41e1-79e6-47c1-ac6a-a395b44ba10e] succeeded in 2.346460640999794s: None 2024-03-28T03:25:07.722608045Z [2024-03-28 03:25:07,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ccfcc9e-b3fb-4808-af59-65613afda585] received 2024-03-28T03:25:07.732981696Z [2024-03-28 03:25:07,732: INFO/ForkPoolWorker-15] [4ccfcc9e-b3fb-4808-af59-65613afda585] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:25:08.057630951Z [2024-03-28 03:25:08,054: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:25:09.608691918Z [2024-03-28 03:25:09,608: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:25:09.612248658Z [2024-03-28 03:25:09,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:09.636195744Z [2024-03-28 03:25:09,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:25:09.637595959Z [2024-03-28 03:25:09,637: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:09.637737364Z [2024-03-28 03:25:09,637: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:09.637888057Z [2024-03-28 03:25:09,637: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:09.637976055Z [2024-03-28 03:25:09,637: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:25:09.638302958Z [2024-03-28 03:25:09,638: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:25:09.638398585Z [2024-03-28 03:25:09,638: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:09.732413261Z [2024-03-28 03:25:09,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:11.323758457Z [2024-03-28 03:25:11,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a1a02e5-8d67-4735-b139-dd3d33354fdf] received 2024-03-28T03:25:11.354445379Z [2024-03-28 03:25:11,354: INFO/ForkPoolWorker-16] [2a1a02e5-8d67-4735-b139-dd3d33354fdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:25:11.381779150Z [2024-03-28 03:25:11,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ccfcc9e-b3fb-4808-af59-65613afda585] succeeded in 3.657092515999466s: None 2024-03-28T03:25:11.665839290Z [2024-03-28 03:25:11,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:25:12.890415449Z [2024-03-28 03:25:12,889: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:25:12.893906385Z [2024-03-28 03:25:12,893: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:25:12.913934211Z [2024-03-28 03:25:12,913: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:25:12.915588112Z [2024-03-28 03:25:12,915: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:25:12.915774737Z [2024-03-28 03:25:12,915: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:25:12.916081892Z [2024-03-28 03:25:12,915: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:25:12.916274189Z [2024-03-28 03:25:12,916: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:25:12.916757226Z [2024-03-28 03:25:12,916: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:25:12.917006701Z [2024-03-28 03:25:12,916: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:25:13.021284916Z [2024-03-28 03:25:13,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:25:13.668363934Z [2024-03-28 03:25:13,667: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a1a02e5-8d67-4735-b139-dd3d33354fdf] succeeded in 2.33775804600009s: None 2024-03-28T03:26:00.592249403Z [2024-03-28 03:26:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46f7fe9-f646-4a1e-8d00-d0f708be17bd] received 2024-03-28T03:26:00.594417448Z [2024-03-28 03:26:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a17ab98b-e4ae-4783-8906-0efd84d3d001] received 2024-03-28T03:26:00.602822774Z [2024-03-28 03:26:00,602: INFO/ForkPoolWorker-16] [a17ab98b-e4ae-4783-8906-0efd84d3d001] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:26:00.603417035Z [2024-03-28 03:26:00,603: INFO/ForkPoolWorker-15] [c46f7fe9-f646-4a1e-8d00-d0f708be17bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:26:00.608532150Z [2024-03-28 03:26:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5023cd-0661-4ee6-9b0c-721de44b3280] received 2024-03-28T03:26:00.613157538Z [2024-03-28 03:26:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[313e8121-01a4-4290-95a3-511559fd6615] received 2024-03-28T03:26:00.618347318Z [2024-03-28 03:26:00,618: INFO/ForkPoolWorker-1] [aa5023cd-0661-4ee6-9b0c-721de44b3280] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:26:00.627529484Z [2024-03-28 03:26:00,627: INFO/ForkPoolWorker-2] [313e8121-01a4-4290-95a3-511559fd6615] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:26:00.968517370Z [2024-03-28 03:26:00,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:26:01.056319896Z [2024-03-28 03:26:01,052: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:26:01.170874381Z [2024-03-28 03:26:01,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:26:01.247933703Z [2024-03-28 03:26:01,247: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:26:01.256637608Z [2024-03-28 03:26:01,243: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:26:01.324987061Z [2024-03-28 03:26:01,324: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:26:01.329416067Z [2024-03-28 03:26:01,328: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:26:01.367874997Z [2024-03-28 03:26:01,367: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:26:01.369461336Z [2024-03-28 03:26:01,369: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:26:01.369668546Z [2024-03-28 03:26:01,369: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:26:01.370045775Z [2024-03-28 03:26:01,369: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:26:01.370341002Z [2024-03-28 03:26:01,370: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:26:01.459967854Z [2024-03-28 03:26:01,459: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:26:01.918937824Z [2024-03-28 03:26:01,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa5023cd-0661-4ee6-9b0c-721de44b3280] succeeded in 1.30833759899906s: None 2024-03-28T03:26:02.166470317Z [2024-03-28 03:26:02,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a17ab98b-e4ae-4783-8906-0efd84d3d001] succeeded in 1.5702197669997986s: None 2024-03-28T03:26:02.735338665Z [2024-03-28 03:26:02,734: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:26:02.740174124Z [2024-03-28 03:26:02,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:26:02.767067900Z [2024-03-28 03:26:02,766: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:26:02.768534787Z [2024-03-28 03:26:02,768: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:26:02.768686737Z [2024-03-28 03:26:02,768: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:26:02.768937314Z [2024-03-28 03:26:02,768: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:26:02.769084790Z [2024-03-28 03:26:02,768: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:26:02.769424246Z [2024-03-28 03:26:02,769: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:26:02.769714965Z [2024-03-28 03:26:02,769: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:26:02.812420497Z [2024-03-28 03:26:02,812: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:26:02.816171723Z [2024-03-28 03:26:02,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:26:02.847660094Z [2024-03-28 03:26:02,847: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:26:02.849132026Z [2024-03-28 03:26:02,848: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:26:02.849247436Z [2024-03-28 03:26:02,849: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:26:02.849424519Z [2024-03-28 03:26:02,849: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:26:02.849569261Z [2024-03-28 03:26:02,849: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:26:02.850044415Z [2024-03-28 03:26:02,849: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:26:02.850062458Z [2024-03-28 03:26:02,849: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:26:02.879744450Z [2024-03-28 03:26:02,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:26:02.955703602Z [2024-03-28 03:26:02,955: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:26:04.606193926Z [2024-03-28 03:26:04,605: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c46f7fe9-f646-4a1e-8d00-d0f708be17bd] succeeded in 4.011393487000532s: None 2024-03-28T03:26:05.123390507Z [2024-03-28 03:26:05,122: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[313e8121-01a4-4290-95a3-511559fd6615] succeeded in 4.508148060998792s: None 2024-03-28T03:27:00.542285796Z [2024-03-28 03:27:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1beb035c-55bb-4889-9a66-a12db497101a] received 2024-03-28T03:27:00.544096566Z [2024-03-28 03:27:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2765590-c1df-41e7-92f9-6630d1059293] received 2024-03-28T03:27:00.550873242Z [2024-03-28 03:27:00,550: INFO/ForkPoolWorker-15] [1beb035c-55bb-4889-9a66-a12db497101a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:27:00.557885602Z [2024-03-28 03:27:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a86dc4b-5ec0-4f94-ba67-6504718b50b5] received 2024-03-28T03:27:00.560429826Z [2024-03-28 03:27:00,560: INFO/ForkPoolWorker-16] [e2765590-c1df-41e7-92f9-6630d1059293] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:27:00.572595865Z [2024-03-28 03:27:00,572: INFO/ForkPoolWorker-1] [4a86dc4b-5ec0-4f94-ba67-6504718b50b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:27:00.875668634Z [2024-03-28 03:27:00,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:27:00.889382741Z [2024-03-28 03:27:00,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:27:00.978609508Z [2024-03-28 03:27:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:27:01.170001712Z [2024-03-28 03:27:01,169: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:27:01.175691558Z [2024-03-28 03:27:01,175: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:27:01.206878282Z [2024-03-28 03:27:01,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:27:01.208627801Z [2024-03-28 03:27:01,208: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:27:01.208847819Z [2024-03-28 03:27:01,208: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:27:01.209206920Z [2024-03-28 03:27:01,208: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:27:01.209528885Z [2024-03-28 03:27:01,209: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:27:01.328919542Z [2024-03-28 03:27:01,328: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:27:01.996971982Z [2024-03-28 03:27:01,996: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a86dc4b-5ec0-4f94-ba67-6504718b50b5] succeeded in 1.4333903980004834s: None 2024-03-28T03:27:02.100116714Z [2024-03-28 03:27:02,099: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:27:02.103678390Z [2024-03-28 03:27:02,103: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:27:02.118653763Z [2024-03-28 03:27:02,118: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:27:02.122404481Z [2024-03-28 03:27:02,121: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:27:02.146842820Z [2024-03-28 03:27:02,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:27:02.151667521Z [2024-03-28 03:27:02,150: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:27:02.151910924Z [2024-03-28 03:27:02,151: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:27:02.153603734Z [2024-03-28 03:27:02,151: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:27:02.153798336Z [2024-03-28 03:27:02,153: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:27:02.154108981Z [2024-03-28 03:27:02,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:27:02.154169320Z [2024-03-28 03:27:02,154: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:27:02.169192900Z [2024-03-28 03:27:02,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:27:02.171627571Z [2024-03-28 03:27:02,171: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:27:02.171869988Z [2024-03-28 03:27:02,171: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:27:02.172278773Z [2024-03-28 03:27:02,171: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:27:02.172491696Z [2024-03-28 03:27:02,172: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:27:02.173185316Z [2024-03-28 03:27:02,172: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:27:02.173466911Z [2024-03-28 03:27:02,173: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:27:02.315793247Z [2024-03-28 03:27:02,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:27:02.368379972Z [2024-03-28 03:27:02,368: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:27:04.019803833Z [2024-03-28 03:27:04,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2765590-c1df-41e7-92f9-6630d1059293] succeeded in 3.4719947470002808s: None 2024-03-28T03:27:04.611572621Z [2024-03-28 03:27:04,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1beb035c-55bb-4889-9a66-a12db497101a] succeeded in 4.066263775001062s: None 2024-03-28T03:28:00.614324445Z [2024-03-28 03:28:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d3033ad-2594-48e4-94b6-3172cbac7f0b] received 2024-03-28T03:28:00.620286670Z [2024-03-28 03:28:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b193c92b-2569-4b66-8a0a-769d6f56f0fc] received 2024-03-28T03:28:00.622234529Z [2024-03-28 03:28:00,621: INFO/ForkPoolWorker-15] [4d3033ad-2594-48e4-94b6-3172cbac7f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:28:00.623150568Z [2024-03-28 03:28:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24106e42-9e5c-484e-8fe9-254442f2b596] received 2024-03-28T03:28:00.637534508Z [2024-03-28 03:28:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c64e5b6-9be1-4140-be80-d26ed61b7f68] received 2024-03-28T03:28:00.638015024Z [2024-03-28 03:28:00,637: INFO/ForkPoolWorker-1] [24106e42-9e5c-484e-8fe9-254442f2b596] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:28:00.638089595Z [2024-03-28 03:28:00,637: INFO/ForkPoolWorker-16] [b193c92b-2569-4b66-8a0a-769d6f56f0fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:28:00.654436322Z [2024-03-28 03:28:00,654: INFO/ForkPoolWorker-2] [1c64e5b6-9be1-4140-be80-d26ed61b7f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:28:01.060533731Z [2024-03-28 03:28:01,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:28:01.061789509Z [2024-03-28 03:28:01,058: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:28:01.100580881Z [2024-03-28 03:28:01,096: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:28:01.211253041Z [2024-03-28 03:28:01,207: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:28:01.374550153Z [2024-03-28 03:28:01,374: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:28:01.402285208Z [2024-03-28 03:28:01,401: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:28:01.406193586Z [2024-03-28 03:28:01,405: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:28:01.437159627Z [2024-03-28 03:28:01,436: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:28:01.442500615Z [2024-03-28 03:28:01,441: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:28:01.443638263Z [2024-03-28 03:28:01,442: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:28:01.444280845Z [2024-03-28 03:28:01,443: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:28:01.445155855Z [2024-03-28 03:28:01,444: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:28:01.625095960Z [2024-03-28 03:28:01,624: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:28:02.002911202Z [2024-03-28 03:28:02,002: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24106e42-9e5c-484e-8fe9-254442f2b596] succeeded in 1.3768411999990349s: None 2024-03-28T03:28:02.293374251Z [2024-03-28 03:28:02,292: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b193c92b-2569-4b66-8a0a-769d6f56f0fc] succeeded in 1.6686630620006326s: None 2024-03-28T03:28:02.543751312Z [2024-03-28 03:28:02,543: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:28:02.548855074Z [2024-03-28 03:28:02,548: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:28:02.580368901Z [2024-03-28 03:28:02,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:28:02.582939223Z [2024-03-28 03:28:02,582: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:28:02.583279899Z [2024-03-28 03:28:02,583: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:28:02.583581555Z [2024-03-28 03:28:02,583: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:28:02.583765608Z [2024-03-28 03:28:02,583: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:28:02.584261739Z [2024-03-28 03:28:02,584: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:28:02.584529740Z [2024-03-28 03:28:02,584: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:28:02.674781973Z [2024-03-28 03:28:02,674: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:28:02.992493190Z [2024-03-28 03:28:02,992: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:28:02.996581784Z [2024-03-28 03:28:02,996: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:28:03.037890497Z [2024-03-28 03:28:03,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:28:03.040102687Z [2024-03-28 03:28:03,039: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:28:03.040323890Z [2024-03-28 03:28:03,040: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:28:03.040613762Z [2024-03-28 03:28:03,040: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:28:03.040799393Z [2024-03-28 03:28:03,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:28:03.041258093Z [2024-03-28 03:28:03,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:28:03.042046202Z [2024-03-28 03:28:03,041: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:28:03.160421315Z [2024-03-28 03:28:03,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:28:04.599082053Z [2024-03-28 03:28:04,598: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c64e5b6-9be1-4140-be80-d26ed61b7f68] succeeded in 3.9558616670001356s: None 2024-03-28T03:28:04.868818709Z [2024-03-28 03:28:04,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d3033ad-2594-48e4-94b6-3172cbac7f0b] succeeded in 4.25272651799969s: None 2024-03-28T03:29:00.469433323Z [2024-03-28 03:29:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0ebf575-f1c1-4b6e-b2f6-4086d49be88c] received 2024-03-28T03:29:00.478893722Z [2024-03-28 03:29:00,478: INFO/ForkPoolWorker-15] [d0ebf575-f1c1-4b6e-b2f6-4086d49be88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:29:00.486348319Z [2024-03-28 03:29:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c112416b-84c7-42e4-a1c1-9b418c449ec1] received 2024-03-28T03:29:00.494143933Z [2024-03-28 03:29:00,493: INFO/ForkPoolWorker-16] [c112416b-84c7-42e4-a1c1-9b418c449ec1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:29:00.494833552Z [2024-03-28 03:29:00,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dac8a4af-8e93-4349-953b-0e58e53bb86e] received 2024-03-28T03:29:00.502118834Z [2024-03-28 03:29:00,501: INFO/ForkPoolWorker-1] [dac8a4af-8e93-4349-953b-0e58e53bb86e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:29:00.842868373Z [2024-03-28 03:29:00,836: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:29:00.849667110Z [2024-03-28 03:29:00,845: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:29:00.868587229Z [2024-03-28 03:29:00,864: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:29:01.029767944Z [2024-03-28 03:29:01,029: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:29:01.033918704Z [2024-03-28 03:29:01,033: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:29:01.062606937Z [2024-03-28 03:29:01,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:29:01.063954920Z [2024-03-28 03:29:01,063: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:29:01.064156850Z [2024-03-28 03:29:01,063: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:29:01.064306029Z [2024-03-28 03:29:01,064: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:29:01.064620533Z [2024-03-28 03:29:01,064: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:29:01.158981513Z [2024-03-28 03:29:01,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:29:01.735588146Z [2024-03-28 03:29:01,735: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0ebf575-f1c1-4b6e-b2f6-4086d49be88c] succeeded in 1.2632812869996997s: None 2024-03-28T03:29:02.113982884Z [2024-03-28 03:29:02,113: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:29:02.118055719Z [2024-03-28 03:29:02,117: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:29:02.167105242Z [2024-03-28 03:29:02,166: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:29:02.169433349Z [2024-03-28 03:29:02,169: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:29:02.169640624Z [2024-03-28 03:29:02,169: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:29:02.169976812Z [2024-03-28 03:29:02,169: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:29:02.170199765Z [2024-03-28 03:29:02,169: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:29:02.170625723Z [2024-03-28 03:29:02,170: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:29:02.170836039Z [2024-03-28 03:29:02,170: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:29:02.296075938Z [2024-03-28 03:29:02,295: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:29:02.368788765Z [2024-03-28 03:29:02,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:29:02.372280547Z [2024-03-28 03:29:02,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:29:02.404784131Z [2024-03-28 03:29:02,404: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:29:02.406719803Z [2024-03-28 03:29:02,406: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:29:02.406994986Z [2024-03-28 03:29:02,406: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:29:02.407327709Z [2024-03-28 03:29:02,407: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:29:02.407481357Z [2024-03-28 03:29:02,407: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:29:02.407902296Z [2024-03-28 03:29:02,407: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:29:02.408075050Z [2024-03-28 03:29:02,407: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:29:02.501370128Z [2024-03-28 03:29:02,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:29:03.964031316Z [2024-03-28 03:29:03,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dac8a4af-8e93-4349-953b-0e58e53bb86e] succeeded in 3.4660488610006723s: None 2024-03-28T03:29:05.333537380Z [2024-03-28 03:29:05,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c112416b-84c7-42e4-a1c1-9b418c449ec1] succeeded in 4.845222505000493s: None 2024-03-28T03:30:01.119501738Z [2024-03-28 03:30:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2f11fd6-7dd0-4b40-a373-b232aabb6b2a] received 2024-03-28T03:30:01.121694970Z [2024-03-28 03:30:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb44d822-cf2c-47c6-a58f-06fcf505095f] received 2024-03-28T03:30:01.127075649Z [2024-03-28 03:30:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54bddf92-0685-41c5-a193-5dac8ca58b22] received 2024-03-28T03:30:01.130112063Z [2024-03-28 03:30:01,129: INFO/ForkPoolWorker-15] [c2f11fd6-7dd0-4b40-a373-b232aabb6b2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:30:01.131890097Z [2024-03-28 03:30:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acdbdbef-6264-4733-898a-6d461c1141d2] received 2024-03-28T03:30:01.133332658Z [2024-03-28 03:30:01,132: INFO/ForkPoolWorker-16] [fb44d822-cf2c-47c6-a58f-06fcf505095f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:30:01.136156608Z [2024-03-28 03:30:01,135: INFO/ForkPoolWorker-1] [54bddf92-0685-41c5-a193-5dac8ca58b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:30:01.138750752Z [2024-03-28 03:30:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65a580d3-b7e4-436e-859d-c8df88b0bcac] received 2024-03-28T03:30:01.140363966Z [2024-03-28 03:30:01,140: INFO/ForkPoolWorker-2] [acdbdbef-6264-4733-898a-6d461c1141d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:30:01.164264473Z [2024-03-28 03:30:01,163: INFO/ForkPoolWorker-3] [65a580d3-b7e4-436e-859d-c8df88b0bcac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:30:01.680689970Z [2024-03-28 03:30:01,647: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:30:01.758962884Z [2024-03-28 03:30:01,755: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:30:01.854095877Z [2024-03-28 03:30:01,850: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:30:01.912260562Z [2024-03-28 03:30:01,893: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:30:01.920997190Z [2024-03-28 03:30:01,911: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:30:02.293499481Z [2024-03-28 03:30:02,292: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T03:30:02.301559830Z [2024-03-28 03:30:02,300: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:02.355029776Z [2024-03-28 03:30:02,354: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T03:30:02.359438156Z [2024-03-28 03:30:02,359: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:30:02.360099525Z [2024-03-28 03:30:02,359: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:30:02.360342306Z [2024-03-28 03:30:02,360: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T03:30:02.360856435Z [2024-03-28 03:30:02,360: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:30:02.552731771Z [2024-03-28 03:30:02,552: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:02.693016928Z [2024-03-28 03:30:02,692: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:03.894706703Z [2024-03-28 03:30:03,894: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[acdbdbef-6264-4733-898a-6d461c1141d2] succeeded in 2.758799010000075s: None 2024-03-28T03:30:03.896227610Z [2024-03-28 03:30:03,894: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[65a580d3-b7e4-436e-859d-c8df88b0bcac] succeeded in 2.7518647070010047s: None 2024-03-28T03:30:04.139076991Z [2024-03-28 03:30:04,138: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:30:04.142669888Z [2024-03-28 03:30:04,142: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:04.177220980Z [2024-03-28 03:30:04,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:30:04.182076104Z [2024-03-28 03:30:04,181: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:04.182100038Z [2024-03-28 03:30:04,181: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:04.182195633Z [2024-03-28 03:30:04,181: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:04.182282237Z [2024-03-28 03:30:04,182: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:30:04.182725556Z [2024-03-28 03:30:04,182: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:30:04.182777502Z [2024-03-28 03:30:04,182: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:04.290427003Z [2024-03-28 03:30:04,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:04.340405740Z [2024-03-28 03:30:04,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:30:04.344891218Z [2024-03-28 03:30:04,344: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:04.398795379Z [2024-03-28 03:30:04,398: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:30:04.403672056Z [2024-03-28 03:30:04,403: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:04.403713852Z [2024-03-28 03:30:04,403: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:04.405018818Z [2024-03-28 03:30:04,403: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:04.405053274Z [2024-03-28 03:30:04,403: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:30:04.405059450Z [2024-03-28 03:30:04,403: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:30:04.405063424Z [2024-03-28 03:30:04,404: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:04.424289186Z [2024-03-28 03:30:04,423: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:30:04.428737635Z [2024-03-28 03:30:04,428: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:04.461233620Z [2024-03-28 03:30:04,460: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:30:04.466599518Z [2024-03-28 03:30:04,466: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:04.466658219Z [2024-03-28 03:30:04,466: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:04.467043131Z [2024-03-28 03:30:04,466: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:04.467114304Z [2024-03-28 03:30:04,466: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:30:04.467564915Z [2024-03-28 03:30:04,467: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:30:04.467583961Z [2024-03-28 03:30:04,467: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:04.504383894Z [2024-03-28 03:30:04,504: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:04.558700929Z [2024-03-28 03:30:04,558: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:05.343600294Z [2024-03-28 03:30:05,341: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54bddf92-0685-41c5-a193-5dac8ca58b22] succeeded in 4.21244983699944s: None 2024-03-28T03:30:05.566526283Z [2024-03-28 03:30:05,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9825700-b7ec-47cc-8513-eec0229a4986] received 2024-03-28T03:30:05.574045889Z [2024-03-28 03:30:05,573: INFO/ForkPoolWorker-1] [d9825700-b7ec-47cc-8513-eec0229a4986] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:30:05.868887306Z [2024-03-28 03:30:05,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:30:06.574708205Z [2024-03-28 03:30:06,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2f11fd6-7dd0-4b40-a373-b232aabb6b2a] succeeded in 5.451211712999793s: None 2024-03-28T03:30:06.575762048Z [2024-03-28 03:30:06,575: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb44d822-cf2c-47c6-a58f-06fcf505095f] succeeded in 5.452483594999649s: None 2024-03-28T03:30:07.188793603Z [2024-03-28 03:30:07,188: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:30:07.191975071Z [2024-03-28 03:30:07,191: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:07.252071979Z [2024-03-28 03:30:07,251: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:30:07.260042051Z [2024-03-28 03:30:07,259: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:07.260241088Z [2024-03-28 03:30:07,259: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:07.260544204Z [2024-03-28 03:30:07,260: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:07.260840218Z [2024-03-28 03:30:07,260: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:30:07.261859806Z [2024-03-28 03:30:07,261: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:30:07.261980108Z [2024-03-28 03:30:07,261: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:07.385239484Z [2024-03-28 03:30:07,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:08.239123474Z [2024-03-28 03:30:08,238: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9825700-b7ec-47cc-8513-eec0229a4986] succeeded in 2.6703402130005998s: None 2024-03-28T03:30:09.024434598Z [2024-03-28 03:30:09,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61ee794f-093b-4e19-8b91-b2eefa3bffc3] received 2024-03-28T03:30:09.031043979Z [2024-03-28 03:30:09,030: INFO/ForkPoolWorker-15] [61ee794f-093b-4e19-8b91-b2eefa3bffc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:30:09.346434413Z [2024-03-28 03:30:09,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:30:10.801505303Z [2024-03-28 03:30:10,800: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:30:10.805558509Z [2024-03-28 03:30:10,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:10.828935818Z [2024-03-28 03:30:10,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:30:10.830472035Z [2024-03-28 03:30:10,830: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:10.830580551Z [2024-03-28 03:30:10,830: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:10.830721482Z [2024-03-28 03:30:10,830: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:10.830848616Z [2024-03-28 03:30:10,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:30:10.831129026Z [2024-03-28 03:30:10,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:30:10.831210050Z [2024-03-28 03:30:10,831: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:10.934302116Z [2024-03-28 03:30:10,933: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:12.528396154Z [2024-03-28 03:30:12,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61ee794f-093b-4e19-8b91-b2eefa3bffc3] succeeded in 3.5021171609987505s: None 2024-03-28T03:30:13.046282626Z [2024-03-28 03:30:13,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ead51dd0-87b0-4df8-97dd-2dc56a68ba78] received 2024-03-28T03:30:13.056668368Z [2024-03-28 03:30:13,056: INFO/ForkPoolWorker-15] [ead51dd0-87b0-4df8-97dd-2dc56a68ba78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:30:13.468226498Z [2024-03-28 03:30:13,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:30:14.642172007Z [2024-03-28 03:30:14,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:30:14.645447204Z [2024-03-28 03:30:14,644: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:30:14.665354874Z [2024-03-28 03:30:14,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:30:14.666762448Z [2024-03-28 03:30:14,666: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:30:14.666921242Z [2024-03-28 03:30:14,666: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:30:14.667177964Z [2024-03-28 03:30:14,666: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:30:14.667338313Z [2024-03-28 03:30:14,667: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:30:14.667839124Z [2024-03-28 03:30:14,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:30:14.667980479Z [2024-03-28 03:30:14,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:30:14.752970091Z [2024-03-28 03:30:14,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:30:15.373089195Z [2024-03-28 03:30:15,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ead51dd0-87b0-4df8-97dd-2dc56a68ba78] succeeded in 2.324342905998492s: None 2024-03-28T03:31:00.825145479Z [2024-03-28 03:31:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54f8c0b7-8085-40ca-a4f8-43464ba5d1ab] received 2024-03-28T03:31:00.835452251Z [2024-03-28 03:31:00,835: INFO/ForkPoolWorker-15] [54f8c0b7-8085-40ca-a4f8-43464ba5d1ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:31:00.852862424Z [2024-03-28 03:31:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15922b87-aa1b-4dac-a888-cbb70b78c44f] received 2024-03-28T03:31:00.861056797Z [2024-03-28 03:31:00,860: INFO/ForkPoolWorker-16] [15922b87-aa1b-4dac-a888-cbb70b78c44f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:31:00.872268933Z [2024-03-28 03:31:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[207b2c91-7570-4735-b42d-a19072d552ba] received 2024-03-28T03:31:00.887828076Z [2024-03-28 03:31:00,887: INFO/ForkPoolWorker-1] [207b2c91-7570-4735-b42d-a19072d552ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:31:01.343041880Z [2024-03-28 03:31:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:31:01.360544778Z [2024-03-28 03:31:01,357: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:31:01.362665734Z [2024-03-28 03:31:01,356: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:31:01.543863839Z [2024-03-28 03:31:01,543: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:31:01.548758150Z [2024-03-28 03:31:01,548: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:31:01.586680255Z [2024-03-28 03:31:01,586: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:31:01.588374439Z [2024-03-28 03:31:01,588: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:31:01.588646193Z [2024-03-28 03:31:01,588: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:31:01.588811093Z [2024-03-28 03:31:01,588: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:31:01.589281962Z [2024-03-28 03:31:01,589: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:31:01.693416845Z [2024-03-28 03:31:01,693: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:31:02.450840779Z [2024-03-28 03:31:02,450: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[207b2c91-7570-4735-b42d-a19072d552ba] succeeded in 1.576353372000085s: None 2024-03-28T03:31:02.581543789Z [2024-03-28 03:31:02,581: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:31:02.585142503Z [2024-03-28 03:31:02,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:31:02.604854507Z [2024-03-28 03:31:02,604: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:31:02.606696500Z [2024-03-28 03:31:02,606: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:31:02.606829602Z [2024-03-28 03:31:02,606: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:31:02.607032385Z [2024-03-28 03:31:02,606: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:31:02.607163338Z [2024-03-28 03:31:02,607: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:31:02.607479055Z [2024-03-28 03:31:02,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:31:02.607588770Z [2024-03-28 03:31:02,607: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:31:02.717671738Z [2024-03-28 03:31:02,717: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:31:02.721676853Z [2024-03-28 03:31:02,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:31:02.726756709Z [2024-03-28 03:31:02,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:31:02.745578024Z [2024-03-28 03:31:02,745: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:31:02.747078548Z [2024-03-28 03:31:02,746: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:31:02.747125848Z [2024-03-28 03:31:02,746: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:31:02.747389857Z [2024-03-28 03:31:02,747: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:31:02.747564855Z [2024-03-28 03:31:02,747: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:31:02.747897459Z [2024-03-28 03:31:02,747: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:31:02.748185459Z [2024-03-28 03:31:02,747: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:31:02.864100958Z [2024-03-28 03:31:02,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:31:04.424300044Z [2024-03-28 03:31:04,423: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54f8c0b7-8085-40ca-a4f8-43464ba5d1ab] succeeded in 3.5972515039993596s: None 2024-03-28T03:31:05.106548292Z [2024-03-28 03:31:05,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15922b87-aa1b-4dac-a888-cbb70b78c44f] succeeded in 4.2511686500001815s: None 2024-03-28T03:31:56.291681746Z [2024-03-28 03:31:56,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71197de0-d437-41b1-9538-7543c0fd0897] received 2024-03-28T03:31:56.301783165Z [2024-03-28 03:31:56,299: INFO/ForkPoolWorker-15] [71197de0-d437-41b1-9538-7543c0fd0897] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240328033155_434201', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-28T03:31:56.599585487Z [2024-03-28 03:31:56,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-28T03:31:56.899035975Z [2024-03-28 03:31:56,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:31:57.482962634Z [2024-03-28 03:31:57,482: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71197de0-d437-41b1-9538-7543c0fd0897] succeeded in 1.193368015001397s: None 2024-03-28T03:32:00.452702618Z [2024-03-28 03:32:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be34171f-f61d-4b9a-85fd-4f16fcc9aacc] received 2024-03-28T03:32:00.454216874Z [2024-03-28 03:32:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f80de8f0-6166-4246-af7a-9fa71527b6ef] received 2024-03-28T03:32:00.460354395Z [2024-03-28 03:32:00,460: INFO/ForkPoolWorker-16] [f80de8f0-6166-4246-af7a-9fa71527b6ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:32:00.466649487Z [2024-03-28 03:32:00,466: INFO/ForkPoolWorker-15] [be34171f-f61d-4b9a-85fd-4f16fcc9aacc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:32:00.469897053Z [2024-03-28 03:32:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dffa62f4-271b-4c1b-9a1c-77c90c28312d] received 2024-03-28T03:32:00.482899627Z [2024-03-28 03:32:00,482: INFO/ForkPoolWorker-1] [dffa62f4-271b-4c1b-9a1c-77c90c28312d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:32:00.492535832Z [2024-03-28 03:32:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bb47fb3-70e5-4ac4-b91c-73a98a751fa3] received 2024-03-28T03:32:00.501668000Z [2024-03-28 03:32:00,501: INFO/ForkPoolWorker-2] [9bb47fb3-70e5-4ac4-b91c-73a98a751fa3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:32:00.768310110Z [2024-03-28 03:32:00,765: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:32:00.796370365Z [2024-03-28 03:32:00,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:32:00.805559048Z [2024-03-28 03:32:00,801: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:32:00.901813580Z [2024-03-28 03:32:00,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:32:01.130621023Z [2024-03-28 03:32:01,130: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:32:01.135859660Z [2024-03-28 03:32:01,135: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:32:01.174886757Z [2024-03-28 03:32:01,174: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:32:01.176295877Z [2024-03-28 03:32:01,176: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:32:01.176440111Z [2024-03-28 03:32:01,176: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:32:01.176553425Z [2024-03-28 03:32:01,176: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:32:01.177112084Z [2024-03-28 03:32:01,176: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:32:01.200915603Z [2024-03-28 03:32:01,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:32:01.298442267Z [2024-03-28 03:32:01,298: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:32:01.883599671Z [2024-03-28 03:32:01,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be34171f-f61d-4b9a-85fd-4f16fcc9aacc] succeeded in 1.4260983339991071s: None 2024-03-28T03:32:02.095553452Z [2024-03-28 03:32:02,095: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bb47fb3-70e5-4ac4-b91c-73a98a751fa3] succeeded in 1.5999079480006912s: None 2024-03-28T03:32:02.463214612Z [2024-03-28 03:32:02,462: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:32:02.469402340Z [2024-03-28 03:32:02,468: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:32:02.495479672Z [2024-03-28 03:32:02,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:32:02.497299720Z [2024-03-28 03:32:02,496: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:32:02.498597278Z [2024-03-28 03:32:02,498: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:32:02.499133622Z [2024-03-28 03:32:02,498: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:32:02.499235312Z [2024-03-28 03:32:02,499: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:32:02.500100580Z [2024-03-28 03:32:02,499: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:32:02.500293833Z [2024-03-28 03:32:02,500: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:32:02.541782967Z [2024-03-28 03:32:02,541: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:32:02.545291306Z [2024-03-28 03:32:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:32:02.569806856Z [2024-03-28 03:32:02,569: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:32:02.571478621Z [2024-03-28 03:32:02,571: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:32:02.571604196Z [2024-03-28 03:32:02,571: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:32:02.571805653Z [2024-03-28 03:32:02,571: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:32:02.571925872Z [2024-03-28 03:32:02,571: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:32:02.572254125Z [2024-03-28 03:32:02,572: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:32:02.572448134Z [2024-03-28 03:32:02,572: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:32:02.593081729Z [2024-03-28 03:32:02,592: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:32:02.688076832Z [2024-03-28 03:32:02,687: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:32:04.346713245Z [2024-03-28 03:32:04,346: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dffa62f4-271b-4c1b-9a1c-77c90c28312d] succeeded in 3.8750431520002167s: None 2024-03-28T03:32:04.832326837Z [2024-03-28 03:32:04,831: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f80de8f0-6166-4246-af7a-9fa71527b6ef] succeeded in 4.376936681999723s: None 2024-03-28T03:33:00.210379340Z [2024-03-28 03:33:00,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9df38f2-cb12-4e52-99f6-813593cdea2e] received 2024-03-28T03:33:00.212106912Z [2024-03-28 03:33:00,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[462978a9-af7e-49d6-8801-c00e8ceca403] received 2024-03-28T03:33:00.216159027Z [2024-03-28 03:33:00,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc27148b-e79c-402b-920a-606172181174] received 2024-03-28T03:33:00.216734577Z [2024-03-28 03:33:00,216: INFO/ForkPoolWorker-15] [f9df38f2-cb12-4e52-99f6-813593cdea2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:33:00.219006714Z [2024-03-28 03:33:00,218: INFO/ForkPoolWorker-16] [462978a9-af7e-49d6-8801-c00e8ceca403] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:33:00.227880674Z [2024-03-28 03:33:00,227: INFO/ForkPoolWorker-1] [fc27148b-e79c-402b-920a-606172181174] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:33:00.521610086Z [2024-03-28 03:33:00,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:33:00.523333295Z [2024-03-28 03:33:00,519: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:33:00.526321565Z [2024-03-28 03:33:00,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:33:00.694221940Z [2024-03-28 03:33:00,693: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:33:00.700211675Z [2024-03-28 03:33:00,699: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:33:00.731601865Z [2024-03-28 03:33:00,731: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:33:00.732638213Z [2024-03-28 03:33:00,732: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:33:00.732709114Z [2024-03-28 03:33:00,732: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:33:00.732758090Z [2024-03-28 03:33:00,732: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:33:00.732978135Z [2024-03-28 03:33:00,732: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:33:00.829276376Z [2024-03-28 03:33:00,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:33:01.519236985Z [2024-03-28 03:33:01,518: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc27148b-e79c-402b-920a-606172181174] succeeded in 1.2970203170007153s: None 2024-03-28T03:33:01.773626855Z [2024-03-28 03:33:01,773: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:33:01.777616932Z [2024-03-28 03:33:01,776: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:33:01.816750448Z [2024-03-28 03:33:01,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:33:01.819208241Z [2024-03-28 03:33:01,818: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:33:01.819304408Z [2024-03-28 03:33:01,819: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:33:01.819457336Z [2024-03-28 03:33:01,819: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:33:01.819513023Z [2024-03-28 03:33:01,819: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:33:01.820049345Z [2024-03-28 03:33:01,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:33:01.820171000Z [2024-03-28 03:33:01,820: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:33:01.831593520Z [2024-03-28 03:33:01,831: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:33:01.836679631Z [2024-03-28 03:33:01,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:33:01.863991039Z [2024-03-28 03:33:01,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:33:01.867740310Z [2024-03-28 03:33:01,867: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:33:01.868140636Z [2024-03-28 03:33:01,867: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:33:01.868480695Z [2024-03-28 03:33:01,868: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:33:01.868717893Z [2024-03-28 03:33:01,868: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:33:01.869373229Z [2024-03-28 03:33:01,869: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:33:01.869689680Z [2024-03-28 03:33:01,869: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:33:01.932768088Z [2024-03-28 03:33:01,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:33:01.979387942Z [2024-03-28 03:33:01,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:33:03.455666518Z [2024-03-28 03:33:03,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9df38f2-cb12-4e52-99f6-813593cdea2e] succeeded in 3.2437443630005873s: None 2024-03-28T03:33:03.937613309Z [2024-03-28 03:33:03,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[462978a9-af7e-49d6-8801-c00e8ceca403] succeeded in 3.723759198999687s: None 2024-03-28T03:34:01.017288509Z [2024-03-28 03:34:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37c49860-5b5d-4b0c-9fc3-2656b4cf4ff3] received 2024-03-28T03:34:01.020308093Z [2024-03-28 03:34:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea053c1e-7aa0-4468-9c4a-949891afa31a] received 2024-03-28T03:34:01.024485882Z [2024-03-28 03:34:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1aa8e94-9677-444d-b50f-bbe0250d1b73] received 2024-03-28T03:34:01.026961855Z [2024-03-28 03:34:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4a67ec-3dc0-4167-aa3a-a1769313bd15] received 2024-03-28T03:34:01.030479918Z [2024-03-28 03:34:01,030: INFO/ForkPoolWorker-15] [37c49860-5b5d-4b0c-9fc3-2656b4cf4ff3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:34:01.032488508Z [2024-03-28 03:34:01,032: INFO/ForkPoolWorker-16] [ea053c1e-7aa0-4468-9c4a-949891afa31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:34:01.040742793Z [2024-03-28 03:34:01,040: INFO/ForkPoolWorker-2] [aa4a67ec-3dc0-4167-aa3a-a1769313bd15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:34:01.041533301Z [2024-03-28 03:34:01,041: INFO/ForkPoolWorker-1] [a1aa8e94-9677-444d-b50f-bbe0250d1b73] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:34:01.409192453Z [2024-03-28 03:34:01,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:34:01.492285630Z [2024-03-28 03:34:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:34:01.538553685Z [2024-03-28 03:34:01,532: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:34:01.567754612Z [2024-03-28 03:34:01,563: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:34:01.791795202Z [2024-03-28 03:34:01,791: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:34:01.798659764Z [2024-03-28 03:34:01,797: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:34:01.827742375Z [2024-03-28 03:34:01,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:34:01.832188470Z [2024-03-28 03:34:01,831: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:34:01.832346809Z [2024-03-28 03:34:01,832: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:34:01.832466867Z [2024-03-28 03:34:01,832: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:34:01.832825226Z [2024-03-28 03:34:01,832: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:34:01.908408985Z [2024-03-28 03:34:01,908: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:34:01.977678109Z [2024-03-28 03:34:01,977: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:34:02.734585962Z [2024-03-28 03:34:02,734: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea053c1e-7aa0-4468-9c4a-949891afa31a] succeeded in 1.7116604650000227s: None 2024-03-28T03:34:02.744983452Z [2024-03-28 03:34:02,744: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1aa8e94-9677-444d-b50f-bbe0250d1b73] succeeded in 1.7164549640001496s: None 2024-03-28T03:34:03.140260969Z [2024-03-28 03:34:03,139: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:34:03.140749044Z [2024-03-28 03:34:03,140: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:34:03.144086741Z [2024-03-28 03:34:03,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:34:03.144590075Z [2024-03-28 03:34:03,144: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:34:03.167078532Z [2024-03-28 03:34:03,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:34:03.169424517Z [2024-03-28 03:34:03,169: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:34:03.169444528Z [2024-03-28 03:34:03,169: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:34:03.170686622Z [2024-03-28 03:34:03,169: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:34:03.170710048Z [2024-03-28 03:34:03,170: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:34:03.171073113Z [2024-03-28 03:34:03,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:34:03.171105238Z [2024-03-28 03:34:03,171: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:34:03.173245985Z [2024-03-28 03:34:03,172: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:34:03.175390050Z [2024-03-28 03:34:03,175: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:34:03.175632092Z [2024-03-28 03:34:03,175: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:34:03.175997102Z [2024-03-28 03:34:03,175: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:34:03.176198040Z [2024-03-28 03:34:03,176: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:34:03.176697416Z [2024-03-28 03:34:03,176: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:34:03.176941602Z [2024-03-28 03:34:03,176: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:34:03.284909363Z [2024-03-28 03:34:03,284: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:34:03.290145583Z [2024-03-28 03:34:03,289: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:34:05.612763066Z [2024-03-28 03:34:05,612: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37c49860-5b5d-4b0c-9fc3-2656b4cf4ff3] succeeded in 4.5939415030006785s: None 2024-03-28T03:34:05.748428095Z [2024-03-28 03:34:05,747: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aa4a67ec-3dc0-4167-aa3a-a1769313bd15] succeeded in 4.717422453000836s: None 2024-03-28T03:35:00.634669622Z [2024-03-28 03:35:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d24a1c5-a397-413d-ada4-0189efd89b17] received 2024-03-28T03:35:00.641023584Z [2024-03-28 03:35:00,640: INFO/ForkPoolWorker-15] [0d24a1c5-a397-413d-ada4-0189efd89b17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:35:00.641542179Z [2024-03-28 03:35:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74f35e52-a91e-4040-b69d-671fb60e9cf6] received 2024-03-28T03:35:00.646808713Z [2024-03-28 03:35:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e23cd6d9-3152-4e57-a33b-0b508c36e0eb] received 2024-03-28T03:35:00.648375089Z [2024-03-28 03:35:00,648: INFO/ForkPoolWorker-16] [74f35e52-a91e-4040-b69d-671fb60e9cf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:35:00.657290846Z [2024-03-28 03:35:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c526001-84c8-44ea-b6b5-39be3d480638] received 2024-03-28T03:35:00.668048014Z [2024-03-28 03:35:00,667: INFO/ForkPoolWorker-2] [0c526001-84c8-44ea-b6b5-39be3d480638] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:35:00.679082664Z [2024-03-28 03:35:00,678: INFO/ForkPoolWorker-1] [e23cd6d9-3152-4e57-a33b-0b508c36e0eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:35:00.981129037Z [2024-03-28 03:35:00,977: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:35:01.004919608Z [2024-03-28 03:35:00,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:35:01.078567288Z [2024-03-28 03:35:01,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:35:01.153125890Z [2024-03-28 03:35:01,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:35:01.223943838Z [2024-03-28 03:35:01,223: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:35:01.228362876Z [2024-03-28 03:35:01,227: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:01.253817846Z [2024-03-28 03:35:01,253: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:35:01.256108839Z [2024-03-28 03:35:01,255: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:35:01.256255522Z [2024-03-28 03:35:01,256: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:35:01.256325802Z [2024-03-28 03:35:01,256: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:35:01.256638524Z [2024-03-28 03:35:01,256: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:35:01.386599794Z [2024-03-28 03:35:01,386: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:02.064079229Z [2024-03-28 03:35:02,063: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e23cd6d9-3152-4e57-a33b-0b508c36e0eb] succeeded in 1.4105337990004045s: None 2024-03-28T03:35:02.549392082Z [2024-03-28 03:35:02,548: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:35:02.554017133Z [2024-03-28 03:35:02,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:02.602730616Z [2024-03-28 03:35:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:35:02.605114158Z [2024-03-28 03:35:02,604: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:02.605382339Z [2024-03-28 03:35:02,605: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:02.605704422Z [2024-03-28 03:35:02,605: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:02.605935024Z [2024-03-28 03:35:02,605: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:35:02.606376393Z [2024-03-28 03:35:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:35:02.607022756Z [2024-03-28 03:35:02,606: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:02.686800017Z [2024-03-28 03:35:02,686: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:35:02.690349416Z [2024-03-28 03:35:02,689: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:02.691715979Z [2024-03-28 03:35:02,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:02.718693332Z [2024-03-28 03:35:02,718: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:35:02.722352690Z [2024-03-28 03:35:02,721: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:02.722399184Z [2024-03-28 03:35:02,722: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:02.722415704Z [2024-03-28 03:35:02,722: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:02.722448570Z [2024-03-28 03:35:02,722: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:35:02.722859118Z [2024-03-28 03:35:02,722: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:35:02.722897775Z [2024-03-28 03:35:02,722: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:02.807196165Z [2024-03-28 03:35:02,806: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:02.883466188Z [2024-03-28 03:35:02,882: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:35:02.892982601Z [2024-03-28 03:35:02,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:02.928162922Z [2024-03-28 03:35:02,927: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:35:02.933587539Z [2024-03-28 03:35:02,933: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:02.933808864Z [2024-03-28 03:35:02,933: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:02.934070738Z [2024-03-28 03:35:02,933: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:02.934225645Z [2024-03-28 03:35:02,934: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:35:02.934690867Z [2024-03-28 03:35:02,934: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:35:02.935033863Z [2024-03-28 03:35:02,934: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:03.097876601Z [2024-03-28 03:35:03,097: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:03.954726979Z [2024-03-28 03:35:03,953: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74f35e52-a91e-4040-b69d-671fb60e9cf6] succeeded in 3.3108195189997787s: None 2024-03-28T03:35:04.873819444Z [2024-03-28 03:35:04,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dde746a-8a18-4f45-bd1a-1880f594e90a] received 2024-03-28T03:35:04.886362644Z [2024-03-28 03:35:04,885: INFO/ForkPoolWorker-16] [0dde746a-8a18-4f45-bd1a-1880f594e90a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:35:04.937638897Z [2024-03-28 03:35:04,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d24a1c5-a397-413d-ada4-0189efd89b17] succeeded in 4.301167204999729s: None 2024-03-28T03:35:05.198513302Z [2024-03-28 03:35:05,195: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:35:06.240688615Z [2024-03-28 03:35:06,240: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c526001-84c8-44ea-b6b5-39be3d480638] succeeded in 5.581246899000689s: None 2024-03-28T03:35:06.545855591Z [2024-03-28 03:35:06,545: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:35:06.549629686Z [2024-03-28 03:35:06,549: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:06.572223073Z [2024-03-28 03:35:06,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:35:06.574382612Z [2024-03-28 03:35:06,574: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:06.574555070Z [2024-03-28 03:35:06,574: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:06.574947398Z [2024-03-28 03:35:06,574: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:06.575059094Z [2024-03-28 03:35:06,574: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:35:06.575688530Z [2024-03-28 03:35:06,575: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:35:06.575869932Z [2024-03-28 03:35:06,575: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:06.692138103Z [2024-03-28 03:35:06,691: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:07.386592712Z [2024-03-28 03:35:07,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0dde746a-8a18-4f45-bd1a-1880f594e90a] succeeded in 2.508621905999462s: None 2024-03-28T03:35:07.399078840Z [2024-03-28 03:35:07,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32b2e307-20d3-4f63-aff2-8e4c065885d7] received 2024-03-28T03:35:07.405043890Z [2024-03-28 03:35:07,404: INFO/ForkPoolWorker-15] [32b2e307-20d3-4f63-aff2-8e4c065885d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:35:07.686828398Z [2024-03-28 03:35:07,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:35:09.159952446Z [2024-03-28 03:35:09,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:35:09.164795542Z [2024-03-28 03:35:09,164: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:09.212008339Z [2024-03-28 03:35:09,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:35:09.215749017Z [2024-03-28 03:35:09,215: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:09.215862367Z [2024-03-28 03:35:09,215: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:09.216055541Z [2024-03-28 03:35:09,215: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:09.216181516Z [2024-03-28 03:35:09,216: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:35:09.216521265Z [2024-03-28 03:35:09,216: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:35:09.216565596Z [2024-03-28 03:35:09,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:09.389987608Z [2024-03-28 03:35:09,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:10.067560378Z [2024-03-28 03:35:10,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32b2e307-20d3-4f63-aff2-8e4c065885d7] succeeded in 2.666638488000899s: None 2024-03-28T03:35:10.875461898Z [2024-03-28 03:35:10,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e657ee7c-1b37-45c2-9d3b-78c2a814938f] received 2024-03-28T03:35:10.894516863Z [2024-03-28 03:35:10,894: INFO/ForkPoolWorker-15] [e657ee7c-1b37-45c2-9d3b-78c2a814938f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:35:11.312711251Z [2024-03-28 03:35:11,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:35:12.571431447Z [2024-03-28 03:35:12,571: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:35:12.574797265Z [2024-03-28 03:35:12,574: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:35:12.596375147Z [2024-03-28 03:35:12,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:35:12.597710562Z [2024-03-28 03:35:12,597: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:35:12.597833340Z [2024-03-28 03:35:12,597: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:35:12.597993375Z [2024-03-28 03:35:12,597: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:35:12.598050038Z [2024-03-28 03:35:12,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:35:12.598450438Z [2024-03-28 03:35:12,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:35:12.598507595Z [2024-03-28 03:35:12,598: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:35:12.680207896Z [2024-03-28 03:35:12,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:35:13.275286819Z [2024-03-28 03:35:13,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e657ee7c-1b37-45c2-9d3b-78c2a814938f] succeeded in 2.392670014000032s: None 2024-03-28T03:36:01.078198264Z [2024-03-28 03:36:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3d03fb6-4426-4384-a155-f55a3ce7a3a2] received 2024-03-28T03:36:01.084689980Z [2024-03-28 03:36:01,084: INFO/ForkPoolWorker-15] [f3d03fb6-4426-4384-a155-f55a3ce7a3a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:36:01.085322213Z [2024-03-28 03:36:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69394940-1098-4429-9333-48a3b73a9a3e] received 2024-03-28T03:36:01.094358555Z [2024-03-28 03:36:01,094: INFO/ForkPoolWorker-16] [69394940-1098-4429-9333-48a3b73a9a3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:36:01.102930665Z [2024-03-28 03:36:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bd55bef-047c-4154-bc4b-80824ee0363b] received 2024-03-28T03:36:01.106871333Z [2024-03-28 03:36:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdd19cba-0453-4357-b750-3a554cb14155] received 2024-03-28T03:36:01.119120440Z [2024-03-28 03:36:01,118: INFO/ForkPoolWorker-1] [5bd55bef-047c-4154-bc4b-80824ee0363b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:36:01.128951510Z [2024-03-28 03:36:01,128: INFO/ForkPoolWorker-2] [bdd19cba-0453-4357-b750-3a554cb14155] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:36:01.450682497Z [2024-03-28 03:36:01,447: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:36:01.492686025Z [2024-03-28 03:36:01,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:36:01.551973603Z [2024-03-28 03:36:01,543: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:36:01.583173813Z [2024-03-28 03:36:01,579: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:36:01.764115645Z [2024-03-28 03:36:01,763: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:36:01.768409209Z [2024-03-28 03:36:01,767: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:36:01.802527957Z [2024-03-28 03:36:01,802: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:36:01.803768751Z [2024-03-28 03:36:01,803: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:36:01.803924703Z [2024-03-28 03:36:01,803: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:36:01.803999070Z [2024-03-28 03:36:01,803: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:36:01.804327047Z [2024-03-28 03:36:01,804: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:36:01.832974468Z [2024-03-28 03:36:01,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:36:01.921220525Z [2024-03-28 03:36:01,920: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:36:02.663822507Z [2024-03-28 03:36:02,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3d03fb6-4426-4384-a155-f55a3ce7a3a2] succeeded in 1.5841708239986474s: None 2024-03-28T03:36:02.723991957Z [2024-03-28 03:36:02,723: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bdd19cba-0453-4357-b750-3a554cb14155] succeeded in 1.6144290690008347s: None 2024-03-28T03:36:03.226302874Z [2024-03-28 03:36:03,225: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:36:03.230340570Z [2024-03-28 03:36:03,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:36:03.247767832Z [2024-03-28 03:36:03,247: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:36:03.251630117Z [2024-03-28 03:36:03,251: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:36:03.262052272Z [2024-03-28 03:36:03,261: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:36:03.266735121Z [2024-03-28 03:36:03,266: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:36:03.267086156Z [2024-03-28 03:36:03,266: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:36:03.267392810Z [2024-03-28 03:36:03,267: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:36:03.267617393Z [2024-03-28 03:36:03,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:36:03.267964755Z [2024-03-28 03:36:03,267: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:36:03.268181294Z [2024-03-28 03:36:03,268: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:36:03.291431540Z [2024-03-28 03:36:03,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:36:03.292971958Z [2024-03-28 03:36:03,292: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:36:03.292982631Z [2024-03-28 03:36:03,292: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:36:03.293188015Z [2024-03-28 03:36:03,292: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:36:03.293605024Z [2024-03-28 03:36:03,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:36:03.293973123Z [2024-03-28 03:36:03,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:36:03.294115806Z [2024-03-28 03:36:03,293: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:36:03.420420966Z [2024-03-28 03:36:03,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:36:03.427299716Z [2024-03-28 03:36:03,426: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:36:05.262229347Z [2024-03-28 03:36:05,261: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5bd55bef-047c-4154-bc4b-80824ee0363b] succeeded in 4.156717879999633s: None 2024-03-28T03:36:06.515531401Z [2024-03-28 03:36:06,514: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69394940-1098-4429-9333-48a3b73a9a3e] succeeded in 5.427959287999329s: None 2024-03-28T03:37:00.314233764Z [2024-03-28 03:37:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afc04e5e-5d2e-4389-9cae-aec5ac98c65d] received 2024-03-28T03:37:00.322050394Z [2024-03-28 03:37:00,321: INFO/ForkPoolWorker-15] [afc04e5e-5d2e-4389-9cae-aec5ac98c65d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:37:00.322498887Z [2024-03-28 03:37:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32b2c60e-551f-4181-8bdb-7bd1364eb19c] received 2024-03-28T03:37:00.330689893Z [2024-03-28 03:37:00,330: INFO/ForkPoolWorker-16] [32b2c60e-551f-4181-8bdb-7bd1364eb19c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:37:00.333661956Z [2024-03-28 03:37:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26aad15e-45a8-4c74-851e-85ec390f9ce3] received 2024-03-28T03:37:00.340587950Z [2024-03-28 03:37:00,340: INFO/ForkPoolWorker-1] [26aad15e-45a8-4c74-851e-85ec390f9ce3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:37:00.637770258Z [2024-03-28 03:37:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:37:00.644095043Z [2024-03-28 03:37:00,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:37:00.659181216Z [2024-03-28 03:37:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:37:00.826103631Z [2024-03-28 03:37:00,825: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:37:00.830191424Z [2024-03-28 03:37:00,829: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:37:00.856718811Z [2024-03-28 03:37:00,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:37:00.859076414Z [2024-03-28 03:37:00,858: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:37:00.859384567Z [2024-03-28 03:37:00,859: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:37:00.859591549Z [2024-03-28 03:37:00,859: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:37:00.859939086Z [2024-03-28 03:37:00,859: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:37:00.967962722Z [2024-03-28 03:37:00,967: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:37:01.698440443Z [2024-03-28 03:37:01,697: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32b2c60e-551f-4181-8bdb-7bd1364eb19c] succeeded in 1.3739667070003634s: None 2024-03-28T03:37:01.966648076Z [2024-03-28 03:37:01,966: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:37:01.970092844Z [2024-03-28 03:37:01,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:37:01.991384595Z [2024-03-28 03:37:01,991: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:37:01.992880511Z [2024-03-28 03:37:01,992: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:37:01.992896638Z [2024-03-28 03:37:01,992: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:37:01.993010755Z [2024-03-28 03:37:01,992: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:37:01.993039945Z [2024-03-28 03:37:01,992: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:37:01.993391360Z [2024-03-28 03:37:01,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:37:01.993403181Z [2024-03-28 03:37:01,993: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:37:02.009927797Z [2024-03-28 03:37:02,009: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:37:02.013735001Z [2024-03-28 03:37:02,013: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:37:02.039559299Z [2024-03-28 03:37:02,039: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:37:02.041007628Z [2024-03-28 03:37:02,040: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:37:02.041026630Z [2024-03-28 03:37:02,040: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:37:02.041271064Z [2024-03-28 03:37:02,041: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:37:02.041392523Z [2024-03-28 03:37:02,041: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:37:02.041822255Z [2024-03-28 03:37:02,041: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:37:02.041976857Z [2024-03-28 03:37:02,041: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:37:02.097240115Z [2024-03-28 03:37:02,096: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:37:02.131483685Z [2024-03-28 03:37:02,131: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:37:03.757145611Z [2024-03-28 03:37:03,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26aad15e-45a8-4c74-851e-85ec390f9ce3] succeeded in 3.42188637199979s: None 2024-03-28T03:37:04.200108735Z [2024-03-28 03:37:04,199: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afc04e5e-5d2e-4389-9cae-aec5ac98c65d] succeeded in 3.8837065679999796s: None 2024-03-28T03:37:56.602248954Z [2024-03-28 03:37:56,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e344d6e-6fd6-4411-983e-b70ebd916433] received 2024-03-28T03:37:56.611918881Z [2024-03-28 03:37:56,611: INFO/ForkPoolWorker-15] [3e344d6e-6fd6-4411-983e-b70ebd916433] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240328033755_606269', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-28T03:37:56.902155472Z [2024-03-28 03:37:56,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-28T03:37:57.229623089Z [2024-03-28 03:37:57,229: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:37:57.792051732Z [2024-03-28 03:37:57,791: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e344d6e-6fd6-4411-983e-b70ebd916433] succeeded in 1.1852840329993342s: None 2024-03-28T03:38:00.698064739Z [2024-03-28 03:38:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a17cf1fc-8983-426a-9509-2bf3b2a32a31] received 2024-03-28T03:38:00.700859670Z [2024-03-28 03:38:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e15e778a-772f-4882-a091-129b7732f2d8] received 2024-03-28T03:38:00.704092301Z [2024-03-28 03:38:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8572c89d-0c5d-490f-ba2b-7d76b518ae1e] received 2024-03-28T03:38:00.710091475Z [2024-03-28 03:38:00,709: INFO/ForkPoolWorker-15] [a17cf1fc-8983-426a-9509-2bf3b2a32a31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:38:00.711011567Z [2024-03-28 03:38:00,710: INFO/ForkPoolWorker-1] [8572c89d-0c5d-490f-ba2b-7d76b518ae1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:38:00.715129481Z [2024-03-28 03:38:00,714: INFO/ForkPoolWorker-16] [e15e778a-772f-4882-a091-129b7732f2d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:38:00.715534787Z [2024-03-28 03:38:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af990c23-9e70-4bfe-a19e-d244c2eab541] received 2024-03-28T03:38:00.721807512Z [2024-03-28 03:38:00,721: INFO/ForkPoolWorker-2] [af990c23-9e70-4bfe-a19e-d244c2eab541] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:38:01.035724991Z [2024-03-28 03:38:01,032: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:38:01.044767502Z [2024-03-28 03:38:01,040: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:38:01.067054638Z [2024-03-28 03:38:01,063: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:38:01.100488373Z [2024-03-28 03:38:01,093: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:38:01.274472890Z [2024-03-28 03:38:01,272: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:38:01.279925800Z [2024-03-28 03:38:01,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:38:01.332026753Z [2024-03-28 03:38:01,331: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:38:01.338798391Z [2024-03-28 03:38:01,338: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:38:01.338857988Z [2024-03-28 03:38:01,338: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:38:01.339838757Z [2024-03-28 03:38:01,338: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:38:01.340338802Z [2024-03-28 03:38:01,340: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:38:01.449862055Z [2024-03-28 03:38:01,449: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:38:01.506882326Z [2024-03-28 03:38:01,506: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:38:02.196673121Z [2024-03-28 03:38:02,196: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8572c89d-0c5d-490f-ba2b-7d76b518ae1e] succeeded in 1.4901632250002876s: None 2024-03-28T03:38:02.231473192Z [2024-03-28 03:38:02,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e15e778a-772f-4882-a091-129b7732f2d8] succeeded in 1.528189881999424s: None 2024-03-28T03:38:02.467225556Z [2024-03-28 03:38:02,466: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:38:02.470838970Z [2024-03-28 03:38:02,470: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:38:02.493875049Z [2024-03-28 03:38:02,493: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:38:02.495725327Z [2024-03-28 03:38:02,495: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:38:02.495946959Z [2024-03-28 03:38:02,495: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:38:02.496231705Z [2024-03-28 03:38:02,495: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:38:02.496403660Z [2024-03-28 03:38:02,496: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:38:02.496799558Z [2024-03-28 03:38:02,496: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:38:02.496920432Z [2024-03-28 03:38:02,496: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:38:02.587910497Z [2024-03-28 03:38:02,587: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:38:02.604914830Z [2024-03-28 03:38:02,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:38:02.608607895Z [2024-03-28 03:38:02,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:38:02.637430895Z [2024-03-28 03:38:02,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:38:02.640013870Z [2024-03-28 03:38:02,639: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:38:02.640145189Z [2024-03-28 03:38:02,639: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:38:02.640400880Z [2024-03-28 03:38:02,640: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:38:02.640523411Z [2024-03-28 03:38:02,640: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:38:02.641029220Z [2024-03-28 03:38:02,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:38:02.641759715Z [2024-03-28 03:38:02,640: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:38:02.757770140Z [2024-03-28 03:38:02,757: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:38:04.703570579Z [2024-03-28 03:38:04,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a17cf1fc-8983-426a-9509-2bf3b2a32a31] succeeded in 4.003752426999199s: None 2024-03-28T03:38:06.245315582Z [2024-03-28 03:38:06,244: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[af990c23-9e70-4bfe-a19e-d244c2eab541] succeeded in 5.52806159300053s: None 2024-03-28T03:39:00.407351421Z [2024-03-28 03:39:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e38dd9cf-7624-473b-9ef4-be20329a2842] received 2024-03-28T03:39:00.410124501Z [2024-03-28 03:39:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42f1e57f-79b2-4f6d-b8b7-56552c965e4e] received 2024-03-28T03:39:00.413359306Z [2024-03-28 03:39:00,413: INFO/ForkPoolWorker-15] [e38dd9cf-7624-473b-9ef4-be20329a2842] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:39:00.413882253Z [2024-03-28 03:39:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cfe64f9-b3a3-4832-8f80-bbdef55c3e54] received 2024-03-28T03:39:00.419656795Z [2024-03-28 03:39:00,419: INFO/ForkPoolWorker-1] [9cfe64f9-b3a3-4832-8f80-bbdef55c3e54] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:39:00.420110765Z [2024-03-28 03:39:00,419: INFO/ForkPoolWorker-16] [42f1e57f-79b2-4f6d-b8b7-56552c965e4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:39:00.713839253Z [2024-03-28 03:39:00,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:39:00.785259627Z [2024-03-28 03:39:00,782: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:39:00.787341288Z [2024-03-28 03:39:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:39:00.947329958Z [2024-03-28 03:39:00,946: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:39:00.951436637Z [2024-03-28 03:39:00,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:39:00.970469885Z [2024-03-28 03:39:00,970: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:39:00.971477746Z [2024-03-28 03:39:00,971: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:39:00.971581249Z [2024-03-28 03:39:00,971: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:39:00.971677103Z [2024-03-28 03:39:00,971: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:39:00.972320983Z [2024-03-28 03:39:00,972: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:39:01.071354008Z [2024-03-28 03:39:01,071: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:39:01.633909876Z [2024-03-28 03:39:01,633: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9cfe64f9-b3a3-4832-8f80-bbdef55c3e54] succeeded in 1.218581508999705s: None 2024-03-28T03:39:01.946874697Z [2024-03-28 03:39:01,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:39:01.950708479Z [2024-03-28 03:39:01,950: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:39:01.971752975Z [2024-03-28 03:39:01,971: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:39:01.973249120Z [2024-03-28 03:39:01,972: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:39:01.973267342Z [2024-03-28 03:39:01,973: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:39:01.973428490Z [2024-03-28 03:39:01,973: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:39:01.973464597Z [2024-03-28 03:39:01,973: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:39:01.973922795Z [2024-03-28 03:39:01,973: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:39:01.974216657Z [2024-03-28 03:39:01,974: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:39:01.987184624Z [2024-03-28 03:39:01,986: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:39:01.990787428Z [2024-03-28 03:39:01,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:39:02.013407421Z [2024-03-28 03:39:02,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:39:02.014928612Z [2024-03-28 03:39:02,014: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:39:02.015072970Z [2024-03-28 03:39:02,014: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:39:02.015303002Z [2024-03-28 03:39:02,015: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:39:02.015578903Z [2024-03-28 03:39:02,015: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:39:02.016136728Z [2024-03-28 03:39:02,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:39:02.016368553Z [2024-03-28 03:39:02,016: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:39:02.056457977Z [2024-03-28 03:39:02,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:39:02.120712332Z [2024-03-28 03:39:02,120: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:39:03.574378364Z [2024-03-28 03:39:03,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42f1e57f-79b2-4f6d-b8b7-56552c965e4e] succeeded in 3.162149241001316s: None 2024-03-28T03:39:04.133085638Z [2024-03-28 03:39:04,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e38dd9cf-7624-473b-9ef4-be20329a2842] succeeded in 3.724395416000334s: None 2024-03-28T03:39:56.973400240Z [2024-03-28 03:39:56,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e10ffa79-2521-4df0-96b0-351a11955f5b] received 2024-03-28T03:39:56.980071996Z [2024-03-28 03:39:56,979: INFO/ForkPoolWorker-15] [e10ffa79-2521-4df0-96b0-351a11955f5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240328033955_960149', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-28T03:39:57.315008228Z [2024-03-28 03:39:57,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-03-28T03:39:57.641847592Z [2024-03-28 03:39:57,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:39:58.207822937Z [2024-03-28 03:39:58,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e10ffa79-2521-4df0-96b0-351a11955f5b] succeeded in 1.2326581640008953s: None 2024-03-28T03:40:01.161834143Z [2024-03-28 03:40:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7842ded0-df3a-451c-94c4-4fd3196bbce1] received 2024-03-28T03:40:01.166496305Z [2024-03-28 03:40:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f5963b3-64be-4a0c-8777-2ae09f817219] received 2024-03-28T03:40:01.170594861Z [2024-03-28 03:40:01,169: INFO/ForkPoolWorker-15] [7842ded0-df3a-451c-94c4-4fd3196bbce1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:40:01.174606744Z [2024-03-28 03:40:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e1d3d88-fe34-43a1-81d1-ad846ddca613] received 2024-03-28T03:40:01.177493994Z [2024-03-28 03:40:01,177: INFO/ForkPoolWorker-16] [9f5963b3-64be-4a0c-8777-2ae09f817219] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:40:01.183700009Z [2024-03-28 03:40:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bbf4145-9208-4d74-8c88-e312157e06e9] received 2024-03-28T03:40:01.185523761Z [2024-03-28 03:40:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b18a8a27-d3b7-45f4-840f-fe72824dd385] received 2024-03-28T03:40:01.185846176Z [2024-03-28 03:40:01,185: INFO/ForkPoolWorker-1] [4e1d3d88-fe34-43a1-81d1-ad846ddca613] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:40:01.195283347Z [2024-03-28 03:40:01,194: INFO/ForkPoolWorker-2] [0bbf4145-9208-4d74-8c88-e312157e06e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:40:01.213269597Z [2024-03-28 03:40:01,212: INFO/ForkPoolWorker-3] [b18a8a27-d3b7-45f4-840f-fe72824dd385] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:40:01.722863729Z [2024-03-28 03:40:01,718: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:40:01.736073432Z [2024-03-28 03:40:01,732: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:40:01.849211619Z [2024-03-28 03:40:01,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:40:02.008085890Z [2024-03-28 03:40:01,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:40:02.019494735Z [2024-03-28 03:40:02,018: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:40:02.024463260Z [2024-03-28 03:40:02,023: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:02.058607566Z [2024-03-28 03:40:02,058: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:40:02.059781116Z [2024-03-28 03:40:02,059: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:40:02.059948534Z [2024-03-28 03:40:02,059: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:40:02.060116138Z [2024-03-28 03:40:02,060: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:40:02.060376946Z [2024-03-28 03:40:02,060: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:40:02.109400910Z [2024-03-28 03:40:02,105: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:40:02.202349057Z [2024-03-28 03:40:02,202: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:02.497185226Z [2024-03-28 03:40:02,496: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:03.013930094Z [2024-03-28 03:40:03,013: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0bbf4145-9208-4d74-8c88-e312157e06e9] succeeded in 1.8283530410008098s: None 2024-03-28T03:40:03.284386673Z [2024-03-28 03:40:03,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f5963b3-64be-4a0c-8777-2ae09f817219] succeeded in 2.1137801529985154s: None 2024-03-28T03:40:03.692516627Z [2024-03-28 03:40:03,692: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T03:40:03.696160255Z [2024-03-28 03:40:03,695: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:03.730184303Z [2024-03-28 03:40:03,729: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T03:40:03.731552864Z [2024-03-28 03:40:03,731: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:03.731600934Z [2024-03-28 03:40:03,731: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:03.731813350Z [2024-03-28 03:40:03,731: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:03.731872769Z [2024-03-28 03:40:03,731: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T03:40:03.732166534Z [2024-03-28 03:40:03,732: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:40:03.732228463Z [2024-03-28 03:40:03,732: INFO/ForkPoolWorker-3] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:03.762755825Z [2024-03-28 03:40:03,762: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:40:03.770810704Z [2024-03-28 03:40:03,770: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:03.832308408Z [2024-03-28 03:40:03,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:40:03.834202778Z [2024-03-28 03:40:03,833: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:03.834652632Z [2024-03-28 03:40:03,834: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:03.834915270Z [2024-03-28 03:40:03,834: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:03.835105484Z [2024-03-28 03:40:03,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:40:03.835512874Z [2024-03-28 03:40:03,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:40:03.835722053Z [2024-03-28 03:40:03,835: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:03.868424047Z [2024-03-28 03:40:03,868: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:03.941896487Z [2024-03-28 03:40:03,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:04.186359749Z [2024-03-28 03:40:04,185: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:40:04.190563565Z [2024-03-28 03:40:04,189: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:04.229447257Z [2024-03-28 03:40:04,229: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:40:04.231198557Z [2024-03-28 03:40:04,230: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:04.231416417Z [2024-03-28 03:40:04,231: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:04.231774962Z [2024-03-28 03:40:04,231: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:04.231981944Z [2024-03-28 03:40:04,231: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:40:04.232418457Z [2024-03-28 03:40:04,232: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:40:04.232630511Z [2024-03-28 03:40:04,232: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:04.331037951Z [2024-03-28 03:40:04,330: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:04.734529844Z [2024-03-28 03:40:04,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7842ded0-df3a-451c-94c4-4fd3196bbce1] succeeded in 3.5712500529989484s: None 2024-03-28T03:40:05.017416021Z [2024-03-28 03:40:05,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca83442b-ebfe-4280-94ed-3e4822b0e312] received 2024-03-28T03:40:05.028953354Z [2024-03-28 03:40:05,028: INFO/ForkPoolWorker-15] [ca83442b-ebfe-4280-94ed-3e4822b0e312] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:40:05.339722465Z [2024-03-28 03:40:05,336: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:40:05.686437515Z [2024-03-28 03:40:05,685: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b18a8a27-d3b7-45f4-840f-fe72824dd385] succeeded in 4.497866555000655s: None 2024-03-28T03:40:06.666277555Z [2024-03-28 03:40:06,665: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:40:06.669555922Z [2024-03-28 03:40:06,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:06.694332040Z [2024-03-28 03:40:06,694: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:40:06.695613336Z [2024-03-28 03:40:06,695: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:06.695632819Z [2024-03-28 03:40:06,695: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:06.695711475Z [2024-03-28 03:40:06,695: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:06.695782779Z [2024-03-28 03:40:06,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:40:06.696064911Z [2024-03-28 03:40:06,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:40:06.696168765Z [2024-03-28 03:40:06,696: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:06.779043056Z [2024-03-28 03:40:06,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:06.828048424Z [2024-03-28 03:40:06,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e1d3d88-fe34-43a1-81d1-ad846ddca613] succeeded in 5.649845364001521s: None 2024-03-28T03:40:07.446271560Z [2024-03-28 03:40:07,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca83442b-ebfe-4280-94ed-3e4822b0e312] succeeded in 2.426547250001022s: None 2024-03-28T03:40:07.550452256Z [2024-03-28 03:40:07,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9df5af9-2b7c-412e-a5c5-e049cbcd93a3] received 2024-03-28T03:40:07.556460877Z [2024-03-28 03:40:07,556: INFO/ForkPoolWorker-15] [b9df5af9-2b7c-412e-a5c5-e049cbcd93a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:40:07.950653577Z [2024-03-28 03:40:07,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:40:09.426684546Z [2024-03-28 03:40:09,426: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:40:09.429912930Z [2024-03-28 03:40:09,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:09.462399529Z [2024-03-28 03:40:09,462: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:40:09.464421547Z [2024-03-28 03:40:09,464: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:09.464492128Z [2024-03-28 03:40:09,464: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:09.464682027Z [2024-03-28 03:40:09,464: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:09.464772414Z [2024-03-28 03:40:09,464: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:40:09.465093092Z [2024-03-28 03:40:09,464: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:40:09.465176325Z [2024-03-28 03:40:09,465: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:09.576471743Z [2024-03-28 03:40:09,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:11.042773795Z [2024-03-28 03:40:11,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9df5af9-2b7c-412e-a5c5-e049cbcd93a3] succeeded in 3.490866736001408s: None 2024-03-28T03:40:11.294465095Z [2024-03-28 03:40:11,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06634352-26fc-41ba-bf8e-89c65c34679b] received 2024-03-28T03:40:11.301928655Z [2024-03-28 03:40:11,301: INFO/ForkPoolWorker-15] [06634352-26fc-41ba-bf8e-89c65c34679b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:40:11.658601586Z [2024-03-28 03:40:11,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:40:12.804486751Z [2024-03-28 03:40:12,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:40:12.808074742Z [2024-03-28 03:40:12,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:40:12.835963169Z [2024-03-28 03:40:12,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:40:12.837336234Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:40:12.837420745Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:40:12.837449963Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:40:12.837611690Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:40:12.837953466Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:40:12.838023477Z [2024-03-28 03:40:12,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:40:12.923488302Z [2024-03-28 03:40:12,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:40:13.539229458Z [2024-03-28 03:40:13,538: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06634352-26fc-41ba-bf8e-89c65c34679b] succeeded in 2.243032795000545s: None 2024-03-28T03:41:00.800034186Z [2024-03-28 03:41:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8655cab8-4ba7-4438-9ede-d5b987a3ffb3] received 2024-03-28T03:41:00.808773295Z [2024-03-28 03:41:00,808: INFO/ForkPoolWorker-15] [8655cab8-4ba7-4438-9ede-d5b987a3ffb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:41:00.816392628Z [2024-03-28 03:41:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0cfd9b-82ae-4022-9412-8c5482a91b9e] received 2024-03-28T03:41:00.822923882Z [2024-03-28 03:41:00,822: INFO/ForkPoolWorker-16] [8f0cfd9b-82ae-4022-9412-8c5482a91b9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:41:00.824142508Z [2024-03-28 03:41:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48cff968-05a5-462f-bd9f-5496220623e1] received 2024-03-28T03:41:00.836226586Z [2024-03-28 03:41:00,835: INFO/ForkPoolWorker-1] [48cff968-05a5-462f-bd9f-5496220623e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:41:01.165294109Z [2024-03-28 03:41:01,162: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:41:01.206021320Z [2024-03-28 03:41:01,202: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:41:01.262260311Z [2024-03-28 03:41:01,256: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:41:01.517199274Z [2024-03-28 03:41:01,516: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:41:01.524943337Z [2024-03-28 03:41:01,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:41:01.559061081Z [2024-03-28 03:41:01,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:41:01.562796439Z [2024-03-28 03:41:01,562: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:41:01.562853917Z [2024-03-28 03:41:01,562: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:41:01.562996175Z [2024-03-28 03:41:01,562: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:41:01.563295671Z [2024-03-28 03:41:01,563: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:41:01.704253573Z [2024-03-28 03:41:01,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:41:02.399053557Z [2024-03-28 03:41:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8655cab8-4ba7-4438-9ede-d5b987a3ffb3] succeeded in 1.5971376819998113s: None 2024-03-28T03:41:02.612373681Z [2024-03-28 03:41:02,611: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:41:02.616515056Z [2024-03-28 03:41:02,615: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:41:02.616624483Z [2024-03-28 03:41:02,616: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:41:02.621029523Z [2024-03-28 03:41:02,620: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:41:02.636138534Z [2024-03-28 03:41:02,635: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:41:02.638021449Z [2024-03-28 03:41:02,637: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:41:02.638040557Z [2024-03-28 03:41:02,637: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:41:02.638572842Z [2024-03-28 03:41:02,637: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:41:02.638840000Z [2024-03-28 03:41:02,638: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:41:02.639273862Z [2024-03-28 03:41:02,639: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:41:02.639349651Z [2024-03-28 03:41:02,639: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:41:02.650272185Z [2024-03-28 03:41:02,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:41:02.652286764Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:41:02.652309252Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:41:02.652439565Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:41:02.652477309Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:41:02.652767858Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:41:02.652949049Z [2024-03-28 03:41:02,652: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:41:02.732012411Z [2024-03-28 03:41:02,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:41:02.780840508Z [2024-03-28 03:41:02,780: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:41:04.665035013Z [2024-03-28 03:41:04,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f0cfd9b-82ae-4022-9412-8c5482a91b9e] succeeded in 3.846800118999454s: None 2024-03-28T03:41:05.402084705Z [2024-03-28 03:41:05,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48cff968-05a5-462f-bd9f-5496220623e1] succeeded in 4.575680596000893s: None 2024-03-28T03:42:01.150584817Z [2024-03-28 03:42:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a8f78d4-2037-4603-b0a7-51632f85ec7a] received 2024-03-28T03:42:01.152907925Z [2024-03-28 03:42:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23a44a0c-298c-43fb-a581-6bbc78040f0e] received 2024-03-28T03:42:01.155908009Z [2024-03-28 03:42:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3441e81d-b973-4049-b4c8-84547beec41d] received 2024-03-28T03:42:01.161309686Z [2024-03-28 03:42:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c38ec492-6376-4058-8713-c91779d40c45] received 2024-03-28T03:42:01.162328687Z [2024-03-28 03:42:01,162: INFO/ForkPoolWorker-16] [23a44a0c-298c-43fb-a581-6bbc78040f0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:42:01.164078083Z [2024-03-28 03:42:01,163: INFO/ForkPoolWorker-15] [8a8f78d4-2037-4603-b0a7-51632f85ec7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:42:01.171115444Z [2024-03-28 03:42:01,170: INFO/ForkPoolWorker-2] [c38ec492-6376-4058-8713-c91779d40c45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:42:01.172738274Z [2024-03-28 03:42:01,172: INFO/ForkPoolWorker-1] [3441e81d-b973-4049-b4c8-84547beec41d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:42:01.498840656Z [2024-03-28 03:42:01,495: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:42:01.580644806Z [2024-03-28 03:42:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:42:01.632991005Z [2024-03-28 03:42:01,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:42:01.675592880Z [2024-03-28 03:42:01,671: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:42:01.959010712Z [2024-03-28 03:42:01,958: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:42:01.974297016Z [2024-03-28 03:42:01,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:42:02.013236908Z [2024-03-28 03:42:02,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:42:02.015886189Z [2024-03-28 03:42:02,015: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:42:02.017038526Z [2024-03-28 03:42:02,016: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:42:02.017134830Z [2024-03-28 03:42:02,016: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:42:02.017206951Z [2024-03-28 03:42:02,017: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:42:02.017473758Z [2024-03-28 03:42:02,017: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:42:02.133208814Z [2024-03-28 03:42:02,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:42:02.628638693Z [2024-03-28 03:42:02,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23a44a0c-298c-43fb-a581-6bbc78040f0e] succeeded in 1.473982696999883s: None 2024-03-28T03:42:02.802396753Z [2024-03-28 03:42:02,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3441e81d-b973-4049-b4c8-84547beec41d] succeeded in 1.6401966899993567s: None 2024-03-28T03:42:02.956840025Z [2024-03-28 03:42:02,956: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:42:02.960631889Z [2024-03-28 03:42:02,960: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:42:02.994034477Z [2024-03-28 03:42:02,993: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:42:02.998762045Z [2024-03-28 03:42:02,998: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:42:02.998970756Z [2024-03-28 03:42:02,998: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:42:02.999336305Z [2024-03-28 03:42:02,998: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:42:02.999523339Z [2024-03-28 03:42:02,999: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:42:03.004775223Z [2024-03-28 03:42:03,004: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:42:03.004855640Z [2024-03-28 03:42:03,004: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:42:03.141041796Z [2024-03-28 03:42:03,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:42:03.144917601Z [2024-03-28 03:42:03,144: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:42:03.149104424Z [2024-03-28 03:42:03,148: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:42:03.169607093Z [2024-03-28 03:42:03,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:42:03.172319638Z [2024-03-28 03:42:03,172: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:42:03.172421098Z [2024-03-28 03:42:03,172: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:42:03.172603808Z [2024-03-28 03:42:03,172: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:42:03.172724516Z [2024-03-28 03:42:03,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:42:03.173052327Z [2024-03-28 03:42:03,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:42:03.173621943Z [2024-03-28 03:42:03,173: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:42:03.313776567Z [2024-03-28 03:42:03,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:42:05.757724280Z [2024-03-28 03:42:05,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a8f78d4-2037-4603-b0a7-51632f85ec7a] succeeded in 4.605432418000419s: None 2024-03-28T03:42:05.851416867Z [2024-03-28 03:42:05,850: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c38ec492-6376-4058-8713-c91779d40c45] succeeded in 4.68792849700003s: None 2024-03-28T03:43:00.533699253Z [2024-03-28 03:43:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2927c1f0-aba8-4931-87e1-0cd29ff10274] received 2024-03-28T03:43:00.535942331Z [2024-03-28 03:43:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8de69085-5273-4186-ac39-cab1f1be5fe6] received 2024-03-28T03:43:00.541566825Z [2024-03-28 03:43:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d73bfa9-4510-4904-a624-0bac9ac723e0] received 2024-03-28T03:43:00.541751411Z [2024-03-28 03:43:00,541: INFO/ForkPoolWorker-15] [2927c1f0-aba8-4931-87e1-0cd29ff10274] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:43:00.547070290Z [2024-03-28 03:43:00,546: INFO/ForkPoolWorker-16] [8de69085-5273-4186-ac39-cab1f1be5fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:43:00.559366072Z [2024-03-28 03:43:00,558: INFO/ForkPoolWorker-1] [4d73bfa9-4510-4904-a624-0bac9ac723e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:43:00.890076701Z [2024-03-28 03:43:00,887: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:43:00.952261824Z [2024-03-28 03:43:00,948: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:43:00.992579149Z [2024-03-28 03:43:00,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:43:01.151660929Z [2024-03-28 03:43:01,151: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:43:01.155725271Z [2024-03-28 03:43:01,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:43:01.198176222Z [2024-03-28 03:43:01,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:43:01.210251242Z [2024-03-28 03:43:01,209: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:43:01.210280210Z [2024-03-28 03:43:01,210: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:43:01.210462926Z [2024-03-28 03:43:01,210: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:43:01.213906688Z [2024-03-28 03:43:01,213: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:43:01.357690816Z [2024-03-28 03:43:01,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:43:02.306296748Z [2024-03-28 03:43:02,305: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2927c1f0-aba8-4931-87e1-0cd29ff10274] succeeded in 1.7691629470009502s: None 2024-03-28T03:43:02.399355531Z [2024-03-28 03:43:02,398: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:43:02.403295004Z [2024-03-28 03:43:02,402: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:43:02.439772852Z [2024-03-28 03:43:02,439: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:43:02.441431978Z [2024-03-28 03:43:02,441: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:43:02.441705634Z [2024-03-28 03:43:02,441: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:43:02.441995298Z [2024-03-28 03:43:02,441: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:43:02.442273461Z [2024-03-28 03:43:02,442: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:43:02.442691859Z [2024-03-28 03:43:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:43:02.443367599Z [2024-03-28 03:43:02,443: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:43:02.542801663Z [2024-03-28 03:43:02,542: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:43:02.571104086Z [2024-03-28 03:43:02,570: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:43:02.574750030Z [2024-03-28 03:43:02,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:43:02.613320548Z [2024-03-28 03:43:02,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:43:02.615788759Z [2024-03-28 03:43:02,615: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:43:02.615826337Z [2024-03-28 03:43:02,615: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:43:02.615984136Z [2024-03-28 03:43:02,615: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:43:02.615992007Z [2024-03-28 03:43:02,615: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:43:02.617264797Z [2024-03-28 03:43:02,616: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:43:02.617387074Z [2024-03-28 03:43:02,617: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:43:02.744066327Z [2024-03-28 03:43:02,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:43:05.159298272Z [2024-03-28 03:43:05,158: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d73bfa9-4510-4904-a624-0bac9ac723e0] succeeded in 4.615452973001084s: None 2024-03-28T03:43:05.607494560Z [2024-03-28 03:43:05,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8de69085-5273-4186-ac39-cab1f1be5fe6] succeeded in 5.0698791979993985s: None 2024-03-28T03:44:00.810851507Z [2024-03-28 03:44:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9059b87c-bb39-4fd1-8880-bd57edaa8f02] received 2024-03-28T03:44:00.815760539Z [2024-03-28 03:44:00,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b710cdc-2f5c-482d-812a-cc4569eb42fe] received 2024-03-28T03:44:00.819511160Z [2024-03-28 03:44:00,819: INFO/ForkPoolWorker-15] [9059b87c-bb39-4fd1-8880-bd57edaa8f02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:44:00.819667127Z [2024-03-28 03:44:00,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9edca9e1-336f-42a3-83aa-821b8b9431c4] received 2024-03-28T03:44:00.826136086Z [2024-03-28 03:44:00,825: INFO/ForkPoolWorker-16] [6b710cdc-2f5c-482d-812a-cc4569eb42fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:44:00.832023584Z [2024-03-28 03:44:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6111fcea-7353-4fc3-8c15-945c26920517] received 2024-03-28T03:44:00.833505782Z [2024-03-28 03:44:00,833: INFO/ForkPoolWorker-1] [9edca9e1-336f-42a3-83aa-821b8b9431c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:44:00.841850720Z [2024-03-28 03:44:00,841: INFO/ForkPoolWorker-2] [6111fcea-7353-4fc3-8c15-945c26920517] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:44:01.153100459Z [2024-03-28 03:44:01,148: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:44:01.181669443Z [2024-03-28 03:44:01,178: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:44:01.236628498Z [2024-03-28 03:44:01,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:44:01.441092668Z [2024-03-28 03:44:01,436: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:44:01.499420480Z [2024-03-28 03:44:01,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:44:01.574186242Z [2024-03-28 03:44:01,573: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:44:01.580991511Z [2024-03-28 03:44:01,580: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:44:01.619926737Z [2024-03-28 03:44:01,619: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:44:01.623047088Z [2024-03-28 03:44:01,622: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:44:01.623247765Z [2024-03-28 03:44:01,623: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:44:01.623398331Z [2024-03-28 03:44:01,623: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:44:01.623711626Z [2024-03-28 03:44:01,623: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:44:01.808062370Z [2024-03-28 03:44:01,807: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:44:02.216858755Z [2024-03-28 03:44:02,216: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9059b87c-bb39-4fd1-8880-bd57edaa8f02] succeeded in 1.4037908170012088s: None 2024-03-28T03:44:02.614831511Z [2024-03-28 03:44:02,614: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6111fcea-7353-4fc3-8c15-945c26920517] succeeded in 1.7807837420004944s: None 2024-03-28T03:44:03.080880295Z [2024-03-28 03:44:03,080: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:44:03.084524773Z [2024-03-28 03:44:03,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:44:03.118472883Z [2024-03-28 03:44:03,118: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:44:03.119947695Z [2024-03-28 03:44:03,119: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:44:03.120086377Z [2024-03-28 03:44:03,119: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:44:03.120323270Z [2024-03-28 03:44:03,120: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:44:03.120349654Z [2024-03-28 03:44:03,120: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:44:03.120678132Z [2024-03-28 03:44:03,120: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:44:03.120691849Z [2024-03-28 03:44:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:44:03.206221130Z [2024-03-28 03:44:03,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:44:03.423857638Z [2024-03-28 03:44:03,423: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:44:03.428069039Z [2024-03-28 03:44:03,427: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:44:03.473514282Z [2024-03-28 03:44:03,473: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:44:03.478236186Z [2024-03-28 03:44:03,477: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:44:03.479443628Z [2024-03-28 03:44:03,479: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:44:03.479862796Z [2024-03-28 03:44:03,479: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:44:03.480037182Z [2024-03-28 03:44:03,479: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:44:03.480455944Z [2024-03-28 03:44:03,480: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:44:03.481047151Z [2024-03-28 03:44:03,480: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:44:03.616379484Z [2024-03-28 03:44:03,616: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:44:05.615949566Z [2024-03-28 03:44:05,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b710cdc-2f5c-482d-812a-cc4569eb42fe] succeeded in 4.797520353999062s: None 2024-03-28T03:44:06.036444998Z [2024-03-28 03:44:06,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9edca9e1-336f-42a3-83aa-821b8b9431c4] succeeded in 5.21420740999929s: None 2024-03-28T03:45:00.776985742Z [2024-03-28 03:45:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a83e3a3a-05a7-4200-ae81-83e70e39dedd] received 2024-03-28T03:45:00.779193765Z [2024-03-28 03:45:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebf0d65b-fa17-458e-a33b-ef032359c024] received 2024-03-28T03:45:00.785525278Z [2024-03-28 03:45:00,785: INFO/ForkPoolWorker-15] [a83e3a3a-05a7-4200-ae81-83e70e39dedd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:45:00.787549184Z [2024-03-28 03:45:00,787: INFO/ForkPoolWorker-16] [ebf0d65b-fa17-458e-a33b-ef032359c024] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:45:00.817114364Z [2024-03-28 03:45:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5efe943-8880-4b75-8394-c9b7c3db77c5] received 2024-03-28T03:45:00.825081206Z [2024-03-28 03:45:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82ed8405-5439-40cf-91de-3351349050b4] received 2024-03-28T03:45:00.849901879Z [2024-03-28 03:45:00,849: INFO/ForkPoolWorker-1] [a5efe943-8880-4b75-8394-c9b7c3db77c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:45:00.853932643Z [2024-03-28 03:45:00,851: INFO/ForkPoolWorker-2] [82ed8405-5439-40cf-91de-3351349050b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:45:01.166022191Z [2024-03-28 03:45:01,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:45:01.266951385Z [2024-03-28 03:45:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:45:01.535983618Z [2024-03-28 03:45:01,530: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:45:01.621534865Z [2024-03-28 03:45:01,616: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:45:01.888762808Z [2024-03-28 03:45:01,888: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:45:01.893533640Z [2024-03-28 03:45:01,892: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:01.938343238Z [2024-03-28 03:45:01,938: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:45:01.942518409Z [2024-03-28 03:45:01,942: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:45:01.943024710Z [2024-03-28 03:45:01,942: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:45:01.943441278Z [2024-03-28 03:45:01,943: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:45:01.943797222Z [2024-03-28 03:45:01,943: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:45:02.110412239Z [2024-03-28 03:45:02,110: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:02.996264362Z [2024-03-28 03:45:02,994: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:45:02.999205848Z [2024-03-28 03:45:02,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:03.014372554Z [2024-03-28 03:45:03,013: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82ed8405-5439-40cf-91de-3351349050b4] succeeded in 2.184177813998758s: None 2024-03-28T03:45:03.036735670Z [2024-03-28 03:45:03,036: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:45:03.039339194Z [2024-03-28 03:45:03,038: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:03.039811904Z [2024-03-28 03:45:03,039: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:03.040252858Z [2024-03-28 03:45:03,039: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:03.040583599Z [2024-03-28 03:45:03,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:45:03.041211008Z [2024-03-28 03:45:03,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:45:03.042306706Z [2024-03-28 03:45:03,042: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:03.170008977Z [2024-03-28 03:45:03,169: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:45:03.173710395Z [2024-03-28 03:45:03,173: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:03.197422480Z [2024-03-28 03:45:03,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:03.203405476Z [2024-03-28 03:45:03,203: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:45:03.205746784Z [2024-03-28 03:45:03,205: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:03.205797279Z [2024-03-28 03:45:03,205: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:03.206494716Z [2024-03-28 03:45:03,205: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:03.206791728Z [2024-03-28 03:45:03,206: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:45:03.207362818Z [2024-03-28 03:45:03,207: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:45:03.209867769Z [2024-03-28 03:45:03,207: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:03.315712464Z [2024-03-28 03:45:03,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:03.991326274Z [2024-03-28 03:45:03,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:45:03.995306123Z [2024-03-28 03:45:03,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:04.042685501Z [2024-03-28 03:45:04,042: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:45:04.044335334Z [2024-03-28 03:45:04,044: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:04.049925795Z [2024-03-28 03:45:04,044: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:04.050121833Z [2024-03-28 03:45:04,049: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:04.050184663Z [2024-03-28 03:45:04,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:45:04.050628929Z [2024-03-28 03:45:04,050: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:45:04.051112421Z [2024-03-28 03:45:04,050: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:04.287910957Z [2024-03-28 03:45:04,287: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:04.541232347Z [2024-03-28 03:45:04,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a83e3a3a-05a7-4200-ae81-83e70e39dedd] succeeded in 3.760390297000413s: None 2024-03-28T03:45:04.611179432Z [2024-03-28 03:45:04,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06468238-3975-4497-bdee-2181ee69a438] received 2024-03-28T03:45:04.619821698Z [2024-03-28 03:45:04,619: INFO/ForkPoolWorker-15] [06468238-3975-4497-bdee-2181ee69a438] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:45:04.940926585Z [2024-03-28 03:45:04,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:45:05.699787481Z [2024-03-28 03:45:05,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebf0d65b-fa17-458e-a33b-ef032359c024] succeeded in 4.918791280999358s: None 2024-03-28T03:45:05.872260809Z [2024-03-28 03:45:05,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5efe943-8880-4b75-8394-c9b7c3db77c5] succeeded in 5.051060114001302s: None 2024-03-28T03:45:06.195238678Z [2024-03-28 03:45:06,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:45:06.198547693Z [2024-03-28 03:45:06,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:06.216449159Z [2024-03-28 03:45:06,216: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:45:06.217836432Z [2024-03-28 03:45:06,217: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:06.217898183Z [2024-03-28 03:45:06,217: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:06.218081611Z [2024-03-28 03:45:06,217: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:06.218099845Z [2024-03-28 03:45:06,217: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:45:06.218405808Z [2024-03-28 03:45:06,218: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:45:06.218412339Z [2024-03-28 03:45:06,218: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:06.337617407Z [2024-03-28 03:45:06,337: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:06.980597048Z [2024-03-28 03:45:06,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06468238-3975-4497-bdee-2181ee69a438] succeeded in 2.366153962999306s: None 2024-03-28T03:45:07.015254920Z [2024-03-28 03:45:07,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14c8d09c-bd55-4941-8d10-652bd8af0d67] received 2024-03-28T03:45:07.023442425Z [2024-03-28 03:45:07,023: INFO/ForkPoolWorker-15] [14c8d09c-bd55-4941-8d10-652bd8af0d67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:45:07.408534898Z [2024-03-28 03:45:07,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:45:08.759283523Z [2024-03-28 03:45:08,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:45:08.762837272Z [2024-03-28 03:45:08,762: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:08.781032438Z [2024-03-28 03:45:08,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:45:08.782254265Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:08.782304233Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:08.782448343Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:08.782508484Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:45:08.782836634Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:45:08.782895301Z [2024-03-28 03:45:08,782: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:08.882282679Z [2024-03-28 03:45:08,882: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:10.301172124Z [2024-03-28 03:45:10,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14c8d09c-bd55-4941-8d10-652bd8af0d67] succeeded in 3.283690688000206s: None 2024-03-28T03:45:10.915263547Z [2024-03-28 03:45:10,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aee886e5-e8fd-4b75-9b19-5559410bd4ba] received 2024-03-28T03:45:10.923765911Z [2024-03-28 03:45:10,923: INFO/ForkPoolWorker-15] [aee886e5-e8fd-4b75-9b19-5559410bd4ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:45:11.269423061Z [2024-03-28 03:45:11,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:45:12.420818555Z [2024-03-28 03:45:12,420: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:45:12.424022651Z [2024-03-28 03:45:12,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:45:12.445087312Z [2024-03-28 03:45:12,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:45:12.446708784Z [2024-03-28 03:45:12,446: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:45:12.446722836Z [2024-03-28 03:45:12,446: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:45:12.446870899Z [2024-03-28 03:45:12,446: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:45:12.446876681Z [2024-03-28 03:45:12,446: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:45:12.447183634Z [2024-03-28 03:45:12,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:45:12.447188156Z [2024-03-28 03:45:12,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:45:12.543800358Z [2024-03-28 03:45:12,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:45:13.143621229Z [2024-03-28 03:45:13,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aee886e5-e8fd-4b75-9b19-5559410bd4ba] succeeded in 2.2262602250011696s: None 2024-03-28T03:46:00.537919160Z [2024-03-28 03:46:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0480d9dd-bb8b-4353-a189-e31df482b2ab] received 2024-03-28T03:46:00.544159953Z [2024-03-28 03:46:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7aebb39-8c66-488b-835d-5aca9f440ce0] received 2024-03-28T03:46:00.545776505Z [2024-03-28 03:46:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7683a50-9420-4095-b6a6-e4630ed667e6] received 2024-03-28T03:46:00.547441684Z [2024-03-28 03:46:00,547: INFO/ForkPoolWorker-15] [0480d9dd-bb8b-4353-a189-e31df482b2ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:46:00.554109992Z [2024-03-28 03:46:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c97bbe9-6dea-4d82-afbb-2491199745b0] received 2024-03-28T03:46:00.558847533Z [2024-03-28 03:46:00,558: INFO/ForkPoolWorker-16] [a7aebb39-8c66-488b-835d-5aca9f440ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:46:00.560463457Z [2024-03-28 03:46:00,560: INFO/ForkPoolWorker-2] [2c97bbe9-6dea-4d82-afbb-2491199745b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:46:00.560911508Z [2024-03-28 03:46:00,560: INFO/ForkPoolWorker-1] [f7683a50-9420-4095-b6a6-e4630ed667e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:46:00.885235008Z [2024-03-28 03:46:00,882: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:46:00.944505177Z [2024-03-28 03:46:00,939: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:46:00.991520786Z [2024-03-28 03:46:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:46:01.041647043Z [2024-03-28 03:46:01,038: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:46:01.046956739Z [2024-03-28 03:46:01,046: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:46:01.051296515Z [2024-03-28 03:46:01,050: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:46:01.070696479Z [2024-03-28 03:46:01,070: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:46:01.071938077Z [2024-03-28 03:46:01,071: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:46:01.072161734Z [2024-03-28 03:46:01,071: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:46:01.072296869Z [2024-03-28 03:46:01,072: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:46:01.072577284Z [2024-03-28 03:46:01,072: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:46:01.192399751Z [2024-03-28 03:46:01,192: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:46:01.338347683Z [2024-03-28 03:46:01,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:46:02.006537410Z [2024-03-28 03:46:02,006: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2c97bbe9-6dea-4d82-afbb-2491199745b0] succeeded in 1.4504097600001842s: None 2024-03-28T03:46:02.134560956Z [2024-03-28 03:46:02,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0480d9dd-bb8b-4353-a189-e31df482b2ab] succeeded in 1.5944582340016495s: None 2024-03-28T03:46:02.360766974Z [2024-03-28 03:46:02,360: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:46:02.364782458Z [2024-03-28 03:46:02,364: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:46:02.387248647Z [2024-03-28 03:46:02,386: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:46:02.388497245Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:46:02.388515777Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:46:02.388626354Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:46:02.388641674Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:46:02.388879664Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:46:02.388902765Z [2024-03-28 03:46:02,388: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:46:02.494021446Z [2024-03-28 03:46:02,493: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:46:02.582402663Z [2024-03-28 03:46:02,581: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:46:02.590731309Z [2024-03-28 03:46:02,589: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:46:02.619971439Z [2024-03-28 03:46:02,619: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:46:02.622058612Z [2024-03-28 03:46:02,621: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:46:02.622217087Z [2024-03-28 03:46:02,621: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:46:02.622508791Z [2024-03-28 03:46:02,622: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:46:02.622672657Z [2024-03-28 03:46:02,622: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:46:02.623102413Z [2024-03-28 03:46:02,622: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:46:02.623408164Z [2024-03-28 03:46:02,623: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:46:02.746763809Z [2024-03-28 03:46:02,746: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:46:04.509297308Z [2024-03-28 03:46:04,508: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7aebb39-8c66-488b-835d-5aca9f440ce0] succeeded in 3.960467045999394s: None 2024-03-28T03:46:05.010249025Z [2024-03-28 03:46:05,009: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7683a50-9420-4095-b6a6-e4630ed667e6] succeeded in 4.462738792999517s: None 2024-03-28T03:46:57.487391312Z [2024-03-28 03:46:57,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5e411f9-c628-4496-814e-6c2c45776e3f] received 2024-03-28T03:46:57.498650370Z [2024-03-28 03:46:57,498: INFO/ForkPoolWorker-15] [a5e411f9-c628-4496-814e-6c2c45776e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240328034656_119736', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-28T03:46:57.803653285Z [2024-03-28 03:46:57,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-03-28T03:46:58.050492819Z [2024-03-28 03:46:58,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:46:58.643981836Z [2024-03-28 03:46:58,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5e411f9-c628-4496-814e-6c2c45776e3f] succeeded in 1.154630665001605s: None 2024-03-28T03:47:00.944373859Z [2024-03-28 03:47:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0db548a-724a-4ddc-84c5-442effdd77a5] received 2024-03-28T03:47:00.947217570Z [2024-03-28 03:47:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15163560-cef8-46ee-8e78-3331fc3e7baa] received 2024-03-28T03:47:00.950168517Z [2024-03-28 03:47:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de090493-4c1c-470c-b811-5ebdb7146f37] received 2024-03-28T03:47:00.950343965Z [2024-03-28 03:47:00,950: INFO/ForkPoolWorker-15] [b0db548a-724a-4ddc-84c5-442effdd77a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:47:00.961575289Z [2024-03-28 03:47:00,961: INFO/ForkPoolWorker-1] [de090493-4c1c-470c-b811-5ebdb7146f37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:47:00.962055120Z [2024-03-28 03:47:00,961: INFO/ForkPoolWorker-16] [15163560-cef8-46ee-8e78-3331fc3e7baa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:47:01.353463772Z [2024-03-28 03:47:01,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:47:01.374622584Z [2024-03-28 03:47:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:47:01.394096189Z [2024-03-28 03:47:01,390: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:47:01.600561798Z [2024-03-28 03:47:01,600: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:47:01.605808888Z [2024-03-28 03:47:01,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:47:01.640843296Z [2024-03-28 03:47:01,640: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:47:01.642040822Z [2024-03-28 03:47:01,641: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:47:01.642078530Z [2024-03-28 03:47:01,641: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:47:01.642226837Z [2024-03-28 03:47:01,642: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:47:01.642640112Z [2024-03-28 03:47:01,642: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:47:01.738883284Z [2024-03-28 03:47:01,738: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:47:02.466665267Z [2024-03-28 03:47:02,466: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de090493-4c1c-470c-b811-5ebdb7146f37] succeeded in 1.5109748869999748s: None 2024-03-28T03:47:02.633739343Z [2024-03-28 03:47:02,633: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:47:02.637320694Z [2024-03-28 03:47:02,636: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:47:02.657855313Z [2024-03-28 03:47:02,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:47:02.659310066Z [2024-03-28 03:47:02,659: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:47:02.659337290Z [2024-03-28 03:47:02,659: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:47:02.659601214Z [2024-03-28 03:47:02,659: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:47:02.659788722Z [2024-03-28 03:47:02,659: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:47:02.660131793Z [2024-03-28 03:47:02,659: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:47:02.660332903Z [2024-03-28 03:47:02,660: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:47:02.677401308Z [2024-03-28 03:47:02,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:47:02.680822196Z [2024-03-28 03:47:02,680: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:47:02.698223716Z [2024-03-28 03:47:02,697: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:47:02.699493026Z [2024-03-28 03:47:02,699: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:47:02.700085076Z [2024-03-28 03:47:02,699: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:47:02.700461832Z [2024-03-28 03:47:02,700: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:47:02.700535487Z [2024-03-28 03:47:02,700: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:47:02.700801315Z [2024-03-28 03:47:02,700: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:47:02.701284517Z [2024-03-28 03:47:02,701: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:47:02.758766818Z [2024-03-28 03:47:02,758: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:47:02.817760312Z [2024-03-28 03:47:02,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:47:04.463873647Z [2024-03-28 03:47:04,463: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0db548a-724a-4ddc-84c5-442effdd77a5] succeeded in 3.518068466000841s: None 2024-03-28T03:47:04.730089439Z [2024-03-28 03:47:04,729: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15163560-cef8-46ee-8e78-3331fc3e7baa] succeeded in 3.7809834239997144s: None 2024-03-28T03:48:00.458041938Z [2024-03-28 03:48:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44812e66-4327-4c1b-8399-2a83c3bf2fc4] received 2024-03-28T03:48:00.463101097Z [2024-03-28 03:48:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d20a4c38-f7e2-4f35-949f-f9d7180272ec] received 2024-03-28T03:48:00.465327442Z [2024-03-28 03:48:00,465: INFO/ForkPoolWorker-15] [44812e66-4327-4c1b-8399-2a83c3bf2fc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:48:00.466002134Z [2024-03-28 03:48:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37dfcf69-96c3-459e-ae15-d9050e9255a2] received 2024-03-28T03:48:00.469293991Z [2024-03-28 03:48:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7f80efa-3d74-4456-80cd-c12fa07463fa] received 2024-03-28T03:48:00.474919951Z [2024-03-28 03:48:00,474: INFO/ForkPoolWorker-1] [37dfcf69-96c3-459e-ae15-d9050e9255a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:48:00.475425127Z [2024-03-28 03:48:00,475: INFO/ForkPoolWorker-16] [d20a4c38-f7e2-4f35-949f-f9d7180272ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:48:00.478856559Z [2024-03-28 03:48:00,478: INFO/ForkPoolWorker-2] [e7f80efa-3d74-4456-80cd-c12fa07463fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:48:00.932784719Z [2024-03-28 03:48:00,928: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:48:00.980535180Z [2024-03-28 03:48:00,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:48:01.159428768Z [2024-03-28 03:48:01,155: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:48:01.197779105Z [2024-03-28 03:48:01,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:48:01.365322604Z [2024-03-28 03:48:01,365: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:48:01.436381590Z [2024-03-28 03:48:01,435: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:48:01.441095167Z [2024-03-28 03:48:01,440: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:48:01.499125410Z [2024-03-28 03:48:01,498: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:48:01.510248436Z [2024-03-28 03:48:01,509: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:48:01.510352029Z [2024-03-28 03:48:01,510: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:48:01.510511664Z [2024-03-28 03:48:01,510: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:48:01.511238740Z [2024-03-28 03:48:01,511: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:48:01.663492314Z [2024-03-28 03:48:01,663: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:48:02.121364764Z [2024-03-28 03:48:02,120: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37dfcf69-96c3-459e-ae15-d9050e9255a2] succeeded in 1.6526642609987903s: None 2024-03-28T03:48:02.467843599Z [2024-03-28 03:48:02,467: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e7f80efa-3d74-4456-80cd-c12fa07463fa] succeeded in 1.9944800430002942s: None 2024-03-28T03:48:02.971447892Z [2024-03-28 03:48:02,970: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:48:02.978028805Z [2024-03-28 03:48:02,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:48:03.009728966Z [2024-03-28 03:48:03,009: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:48:03.012488724Z [2024-03-28 03:48:03,012: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:48:03.016514811Z [2024-03-28 03:48:03,016: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:48:03.016870042Z [2024-03-28 03:48:03,016: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:48:03.017074919Z [2024-03-28 03:48:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:48:03.017596137Z [2024-03-28 03:48:03,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:48:03.017941964Z [2024-03-28 03:48:03,017: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:48:03.047492379Z [2024-03-28 03:48:03,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:48:03.051157785Z [2024-03-28 03:48:03,050: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:48:03.074464580Z [2024-03-28 03:48:03,074: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:48:03.076587251Z [2024-03-28 03:48:03,076: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:48:03.076762156Z [2024-03-28 03:48:03,076: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:48:03.077108742Z [2024-03-28 03:48:03,076: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:48:03.077286892Z [2024-03-28 03:48:03,077: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:48:03.077902479Z [2024-03-28 03:48:03,077: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:48:03.078110131Z [2024-03-28 03:48:03,077: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:48:03.126561855Z [2024-03-28 03:48:03,126: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:48:03.182870706Z [2024-03-28 03:48:03,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:48:04.804518089Z [2024-03-28 03:48:04,804: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44812e66-4327-4c1b-8399-2a83c3bf2fc4] succeeded in 4.3446972309993726s: None 2024-03-28T03:48:05.140714209Z [2024-03-28 03:48:05,140: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d20a4c38-f7e2-4f35-949f-f9d7180272ec] succeeded in 4.6760198719985056s: None 2024-03-28T03:49:00.385794098Z [2024-03-28 03:49:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a661038-6636-4a18-9f3d-4858f6f8e7a1] received 2024-03-28T03:49:00.389993941Z [2024-03-28 03:49:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[844b8a4f-7d76-4a34-926e-845bcc850dcb] received 2024-03-28T03:49:00.393628217Z [2024-03-28 03:49:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52b4ad74-4db1-4ee8-ad24-2bc2c8854221] received 2024-03-28T03:49:00.397786272Z [2024-03-28 03:49:00,397: INFO/ForkPoolWorker-15] [6a661038-6636-4a18-9f3d-4858f6f8e7a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:49:00.398911372Z [2024-03-28 03:49:00,398: INFO/ForkPoolWorker-16] [844b8a4f-7d76-4a34-926e-845bcc850dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:49:00.401211320Z [2024-03-28 03:49:00,400: INFO/ForkPoolWorker-1] [52b4ad74-4db1-4ee8-ad24-2bc2c8854221] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:49:00.806391021Z [2024-03-28 03:49:00,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:49:00.837291973Z [2024-03-28 03:49:00,832: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:49:00.850901499Z [2024-03-28 03:49:00,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:49:01.056118250Z [2024-03-28 03:49:01,055: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:49:01.060408392Z [2024-03-28 03:49:01,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:49:01.085793574Z [2024-03-28 03:49:01,085: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:49:01.088450145Z [2024-03-28 03:49:01,088: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:49:01.088632775Z [2024-03-28 03:49:01,088: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:49:01.088758047Z [2024-03-28 03:49:01,088: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:49:01.089037416Z [2024-03-28 03:49:01,088: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:49:01.203760313Z [2024-03-28 03:49:01,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:49:01.933573271Z [2024-03-28 03:49:01,933: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52b4ad74-4db1-4ee8-ad24-2bc2c8854221] succeeded in 1.5379092509992915s: None 2024-03-28T03:49:02.334435168Z [2024-03-28 03:49:02,334: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:49:02.338253933Z [2024-03-28 03:49:02,337: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:49:02.375168443Z [2024-03-28 03:49:02,374: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:49:02.377095566Z [2024-03-28 03:49:02,376: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:49:02.377113709Z [2024-03-28 03:49:02,376: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:49:02.377362996Z [2024-03-28 03:49:02,377: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:49:02.377383458Z [2024-03-28 03:49:02,377: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:49:02.377686498Z [2024-03-28 03:49:02,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:49:02.378371281Z [2024-03-28 03:49:02,377: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:49:02.459311854Z [2024-03-28 03:49:02,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:49:02.463119248Z [2024-03-28 03:49:02,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:49:02.496895207Z [2024-03-28 03:49:02,496: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:49:02.498794565Z [2024-03-28 03:49:02,498: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:49:02.499259758Z [2024-03-28 03:49:02,499: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:49:02.499492355Z [2024-03-28 03:49:02,499: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:49:02.499631860Z [2024-03-28 03:49:02,499: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:49:02.499641758Z [2024-03-28 03:49:02,499: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:49:02.500094857Z [2024-03-28 03:49:02,499: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:49:02.500367565Z [2024-03-28 03:49:02,500: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:49:02.623367681Z [2024-03-28 03:49:02,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:49:04.443415811Z [2024-03-28 03:49:04,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a661038-6636-4a18-9f3d-4858f6f8e7a1] succeeded in 4.055651439999565s: None 2024-03-28T03:49:05.366691326Z [2024-03-28 03:49:05,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[844b8a4f-7d76-4a34-926e-845bcc850dcb] succeeded in 4.972654719000275s: None 2024-03-28T03:50:01.248068779Z [2024-03-28 03:50:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[730b217a-c90f-43e2-99cf-fc6e33f8d19c] received 2024-03-28T03:50:01.252605819Z [2024-03-28 03:50:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dd84432-f826-4cab-a2f3-740efb3cf30d] received 2024-03-28T03:50:01.266411659Z [2024-03-28 03:50:01,266: INFO/ForkPoolWorker-16] [3dd84432-f826-4cab-a2f3-740efb3cf30d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:50:01.267319433Z [2024-03-28 03:50:01,266: INFO/ForkPoolWorker-15] [730b217a-c90f-43e2-99cf-fc6e33f8d19c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:50:01.278185966Z [2024-03-28 03:50:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aad037b1-167f-4ee7-87f5-72a7b54325bf] received 2024-03-28T03:50:01.286326976Z [2024-03-28 03:50:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06ffa27c-13ba-4e4c-8873-bf60b53156e9] received 2024-03-28T03:50:01.294594479Z [2024-03-28 03:50:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df13df27-97af-4afa-842b-45c37e20d491] received 2024-03-28T03:50:01.303034084Z [2024-03-28 03:50:01,302: INFO/ForkPoolWorker-2] [06ffa27c-13ba-4e4c-8873-bf60b53156e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:50:01.315414690Z [2024-03-28 03:50:01,315: INFO/ForkPoolWorker-1] [aad037b1-167f-4ee7-87f5-72a7b54325bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:50:01.341307742Z [2024-03-28 03:50:01,340: INFO/ForkPoolWorker-3] [df13df27-97af-4afa-842b-45c37e20d491] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:50:01.947648345Z [2024-03-28 03:50:01,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:50:02.107456240Z [2024-03-28 03:50:02,102: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:50:02.738084279Z [2024-03-28 03:50:02,737: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:02.808498484Z [2024-03-28 03:50:02,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:50:02.886189939Z [2024-03-28 03:50:02,848: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:50:02.963714197Z [2024-03-28 03:50:02,958: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:50:03.792127433Z [2024-03-28 03:50:03,790: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:50:03.796228495Z [2024-03-28 03:50:03,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:03.909660636Z [2024-03-28 03:50:03,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:50:03.914724926Z [2024-03-28 03:50:03,914: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:50:03.914935610Z [2024-03-28 03:50:03,914: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:50:03.915058716Z [2024-03-28 03:50:03,914: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:50:03.915366738Z [2024-03-28 03:50:03,915: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:50:04.192967492Z [2024-03-28 03:50:04,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:04.702124869Z [2024-03-28 03:50:04,701: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aad037b1-167f-4ee7-87f5-72a7b54325bf] succeeded in 3.4143650109999726s: None 2024-03-28T03:50:05.242311210Z [2024-03-28 03:50:05,241: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[730b217a-c90f-43e2-99cf-fc6e33f8d19c] succeeded in 3.9855032289997325s: None 2024-03-28T03:50:05.309494233Z [2024-03-28 03:50:05,309: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:50:05.313897120Z [2024-03-28 03:50:05,313: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:05.344834153Z [2024-03-28 03:50:05,344: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:50:05.350403969Z [2024-03-28 03:50:05,350: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:05.350576531Z [2024-03-28 03:50:05,350: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:05.350833038Z [2024-03-28 03:50:05,350: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:05.350940240Z [2024-03-28 03:50:05,350: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:50:05.351430801Z [2024-03-28 03:50:05,351: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:50:05.351459377Z [2024-03-28 03:50:05,351: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:05.464514294Z [2024-03-28 03:50:05,464: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:05.593195445Z [2024-03-28 03:50:05,592: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:50:05.597641026Z [2024-03-28 03:50:05,596: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:05.632160945Z [2024-03-28 03:50:05,631: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:50:05.635308918Z [2024-03-28 03:50:05,634: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:05.635575418Z [2024-03-28 03:50:05,635: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:05.635958011Z [2024-03-28 03:50:05,635: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:05.636217702Z [2024-03-28 03:50:05,636: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:50:05.636618349Z [2024-03-28 03:50:05,636: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:50:05.636699121Z [2024-03-28 03:50:05,636: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:05.805274704Z [2024-03-28 03:50:05,804: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:05.807985332Z [2024-03-28 03:50:05,807: INFO/ForkPoolWorker-3] Getting VIM list 2024-03-28T03:50:05.811692539Z [2024-03-28 03:50:05,811: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:05.856278771Z [2024-03-28 03:50:05,855: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T03:50:05.859527324Z [2024-03-28 03:50:05,859: INFO/ForkPoolWorker-3] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:05.859552911Z [2024-03-28 03:50:05,859: INFO/ForkPoolWorker-3] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:05.859839782Z [2024-03-28 03:50:05,859: INFO/ForkPoolWorker-3] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:05.859882739Z [2024-03-28 03:50:05,859: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-03-28T03:50:05.860328884Z [2024-03-28 03:50:05,860: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:50:05.860369495Z [2024-03-28 03:50:05,860: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:05.980575005Z [2024-03-28 03:50:05,980: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:06.399460696Z [2024-03-28 03:50:06,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3dd84432-f826-4cab-a2f3-740efb3cf30d] succeeded in 5.143163509999795s: None 2024-03-28T03:50:06.566039340Z [2024-03-28 03:50:06,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fb0350d-adc3-4945-9415-4deef03cbfd0] received 2024-03-28T03:50:06.580494859Z [2024-03-28 03:50:06,580: INFO/ForkPoolWorker-15] [9fb0350d-adc3-4945-9415-4deef03cbfd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:50:06.984086152Z [2024-03-28 03:50:06,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:50:07.724912904Z [2024-03-28 03:50:07,724: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06ffa27c-13ba-4e4c-8873-bf60b53156e9] succeeded in 6.4341191059993434s: None 2024-03-28T03:50:08.304677813Z [2024-03-28 03:50:08,304: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:50:08.308454317Z [2024-03-28 03:50:08,308: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:08.355865280Z [2024-03-28 03:50:08,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:50:08.358397825Z [2024-03-28 03:50:08,357: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:08.358641565Z [2024-03-28 03:50:08,358: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:08.358969033Z [2024-03-28 03:50:08,358: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:08.359191037Z [2024-03-28 03:50:08,359: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:50:08.359702818Z [2024-03-28 03:50:08,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:50:08.360474473Z [2024-03-28 03:50:08,360: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:08.485743986Z [2024-03-28 03:50:08,485: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[df13df27-97af-4afa-842b-45c37e20d491] succeeded in 7.164612181000848s: None 2024-03-28T03:50:08.592563806Z [2024-03-28 03:50:08,592: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:09.391421876Z [2024-03-28 03:50:09,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7211a2e2-24e2-4926-8617-434c3d984c2c] received 2024-03-28T03:50:09.418270791Z [2024-03-28 03:50:09,417: INFO/ForkPoolWorker-16] [7211a2e2-24e2-4926-8617-434c3d984c2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:50:09.463842770Z [2024-03-28 03:50:09,463: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fb0350d-adc3-4945-9415-4deef03cbfd0] succeeded in 2.895561221999742s: None 2024-03-28T03:50:09.877459525Z [2024-03-28 03:50:09,874: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:50:11.427799609Z [2024-03-28 03:50:11,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:50:11.431215768Z [2024-03-28 03:50:11,430: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:11.448672441Z [2024-03-28 03:50:11,448: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:50:11.451000052Z [2024-03-28 03:50:11,450: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:11.451070946Z [2024-03-28 03:50:11,450: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:11.451349320Z [2024-03-28 03:50:11,451: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:11.451437129Z [2024-03-28 03:50:11,451: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:50:11.451706702Z [2024-03-28 03:50:11,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:50:11.451787671Z [2024-03-28 03:50:11,451: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:11.543747516Z [2024-03-28 03:50:11,543: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:12.173672005Z [2024-03-28 03:50:12,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7211a2e2-24e2-4926-8617-434c3d984c2c] succeeded in 2.774665836999702s: None 2024-03-28T03:50:13.021268846Z [2024-03-28 03:50:13,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86a524c7-dd9c-4bd3-ac0c-40dfb4fac22b] received 2024-03-28T03:50:13.028708528Z [2024-03-28 03:50:13,028: INFO/ForkPoolWorker-15] [86a524c7-dd9c-4bd3-ac0c-40dfb4fac22b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:50:13.361524856Z [2024-03-28 03:50:13,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:50:14.807646011Z [2024-03-28 03:50:14,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:50:14.811945237Z [2024-03-28 03:50:14,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:50:14.829594883Z [2024-03-28 03:50:14,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:50:14.831461802Z [2024-03-28 03:50:14,831: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:50:14.831497286Z [2024-03-28 03:50:14,831: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:50:14.831725863Z [2024-03-28 03:50:14,831: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:50:14.831790856Z [2024-03-28 03:50:14,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:50:14.832230019Z [2024-03-28 03:50:14,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:50:14.832303159Z [2024-03-28 03:50:14,832: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:50:14.914806532Z [2024-03-28 03:50:14,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:15.497272089Z [2024-03-28 03:50:15,496: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86a524c7-dd9c-4bd3-ac0c-40dfb4fac22b] succeeded in 2.473898686001121s: None 2024-03-28T03:50:58.143450395Z [2024-03-28 03:50:58,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec945e7a-63d3-4e89-aa8a-de9d58814865] received 2024-03-28T03:50:58.150064018Z [2024-03-28 03:50:58,149: INFO/ForkPoolWorker-15] [ec945e7a-63d3-4e89-aa8a-de9d58814865] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240328035056_416157', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-28T03:50:58.417712727Z [2024-03-28 03:50:58,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-03-28T03:50:58.716568074Z [2024-03-28 03:50:58,716: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:50:59.218095627Z [2024-03-28 03:50:59,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec945e7a-63d3-4e89-aa8a-de9d58814865] succeeded in 1.0726428550005949s: None 2024-03-28T03:51:00.250058830Z [2024-03-28 03:51:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33d42dbb-3bb8-41ee-b41c-025da7492145] received 2024-03-28T03:51:00.254948526Z [2024-03-28 03:51:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89582488-b4a8-43a6-950d-275969175887] received 2024-03-28T03:51:00.258190683Z [2024-03-28 03:51:00,257: INFO/ForkPoolWorker-15] [33d42dbb-3bb8-41ee-b41c-025da7492145] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:51:00.261074538Z [2024-03-28 03:51:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd884c03-d610-40e9-a272-a8fde69c0365] received 2024-03-28T03:51:00.262195057Z [2024-03-28 03:51:00,261: INFO/ForkPoolWorker-16] [89582488-b4a8-43a6-950d-275969175887] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:51:00.275157996Z [2024-03-28 03:51:00,274: INFO/ForkPoolWorker-1] [cd884c03-d610-40e9-a272-a8fde69c0365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:51:00.584012240Z [2024-03-28 03:51:00,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:51:00.619948925Z [2024-03-28 03:51:00,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:51:00.664116323Z [2024-03-28 03:51:00,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:51:00.872204920Z [2024-03-28 03:51:00,871: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T03:51:00.876480644Z [2024-03-28 03:51:00,875: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:51:00.906583617Z [2024-03-28 03:51:00,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:51:00.910271495Z [2024-03-28 03:51:00,909: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:51:00.910600535Z [2024-03-28 03:51:00,910: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:51:00.910837379Z [2024-03-28 03:51:00,910: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T03:51:00.911303841Z [2024-03-28 03:51:00,911: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:51:01.029122022Z [2024-03-28 03:51:01,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:51:01.803821189Z [2024-03-28 03:51:01,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33d42dbb-3bb8-41ee-b41c-025da7492145] succeeded in 1.5499717500006227s: None 2024-03-28T03:51:02.119089836Z [2024-03-28 03:51:02,118: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:51:02.122689847Z [2024-03-28 03:51:02,122: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:51:02.143588933Z [2024-03-28 03:51:02,143: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:51:02.145105959Z [2024-03-28 03:51:02,144: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:51:02.145242447Z [2024-03-28 03:51:02,145: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:51:02.145429242Z [2024-03-28 03:51:02,145: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:51:02.145639639Z [2024-03-28 03:51:02,145: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:51:02.146059310Z [2024-03-28 03:51:02,145: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:51:02.146172340Z [2024-03-28 03:51:02,146: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:51:02.200256068Z [2024-03-28 03:51:02,199: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:51:02.204043412Z [2024-03-28 03:51:02,203: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:51:02.228782951Z [2024-03-28 03:51:02,228: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:51:02.231255000Z [2024-03-28 03:51:02,230: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:51:02.231303799Z [2024-03-28 03:51:02,231: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:51:02.231486561Z [2024-03-28 03:51:02,231: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:51:02.231632990Z [2024-03-28 03:51:02,231: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:51:02.232033597Z [2024-03-28 03:51:02,231: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:51:02.232230844Z [2024-03-28 03:51:02,231: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:51:02.248724308Z [2024-03-28 03:51:02,248: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:51:02.328754173Z [2024-03-28 03:51:02,328: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:51:03.796321516Z [2024-03-28 03:51:03,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89582488-b4a8-43a6-950d-275969175887] succeeded in 3.5398035700000037s: None 2024-03-28T03:51:04.219989695Z [2024-03-28 03:51:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd884c03-d610-40e9-a272-a8fde69c0365] succeeded in 3.956600575000266s: None 2024-03-28T03:52:00.616659435Z [2024-03-28 03:52:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dbf72f5-0b91-4b74-b22d-375594d4a484] received 2024-03-28T03:52:00.619824822Z [2024-03-28 03:52:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd3a93b7-b628-4204-9b58-a9520e7ab8cc] received 2024-03-28T03:52:00.624024816Z [2024-03-28 03:52:00,623: INFO/ForkPoolWorker-15] [2dbf72f5-0b91-4b74-b22d-375594d4a484] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:52:00.628583945Z [2024-03-28 03:52:00,628: INFO/ForkPoolWorker-16] [cd3a93b7-b628-4204-9b58-a9520e7ab8cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:52:00.639050490Z [2024-03-28 03:52:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9a2d31c-abda-42c8-bae6-6b219e081bbf] received 2024-03-28T03:52:00.651042199Z [2024-03-28 03:52:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd00a635-a5cb-4a93-9059-d64e2238d76d] received 2024-03-28T03:52:00.651279637Z [2024-03-28 03:52:00,650: INFO/ForkPoolWorker-1] [d9a2d31c-abda-42c8-bae6-6b219e081bbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:52:00.661286339Z [2024-03-28 03:52:00,660: INFO/ForkPoolWorker-2] [fd00a635-a5cb-4a93-9059-d64e2238d76d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:52:01.006447892Z [2024-03-28 03:52:01,003: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:52:01.067139633Z [2024-03-28 03:52:01,063: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:52:01.153127263Z [2024-03-28 03:52:01,135: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:52:01.176174266Z [2024-03-28 03:52:01,175: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:52:01.181156109Z [2024-03-28 03:52:01,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:52:01.212658509Z [2024-03-28 03:52:01,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:52:01.214243175Z [2024-03-28 03:52:01,214: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:52:01.214312310Z [2024-03-28 03:52:01,214: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:52:01.214361814Z [2024-03-28 03:52:01,214: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:52:01.214781303Z [2024-03-28 03:52:01,214: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:52:01.257926886Z [2024-03-28 03:52:01,252: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:52:01.319054063Z [2024-03-28 03:52:01,318: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:52:01.392613103Z [2024-03-28 03:52:01,392: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:52:02.016322456Z [2024-03-28 03:52:02,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dbf72f5-0b91-4b74-b22d-375594d4a484] succeeded in 1.3969540289999713s: None 2024-03-28T03:52:02.025779371Z [2024-03-28 03:52:02,025: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd3a93b7-b628-4204-9b58-a9520e7ab8cc] succeeded in 1.4040253209986986s: None 2024-03-28T03:52:02.595720723Z [2024-03-28 03:52:02,595: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:52:02.599475609Z [2024-03-28 03:52:02,598: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:52:02.620754170Z [2024-03-28 03:52:02,620: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:52:02.622395919Z [2024-03-28 03:52:02,622: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:52:02.622476513Z [2024-03-28 03:52:02,622: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:52:02.622660154Z [2024-03-28 03:52:02,622: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:52:02.622773298Z [2024-03-28 03:52:02,622: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:52:02.623237253Z [2024-03-28 03:52:02,622: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:52:02.623371437Z [2024-03-28 03:52:02,623: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:52:02.714248274Z [2024-03-28 03:52:02,713: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:52:02.742466515Z [2024-03-28 03:52:02,742: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:52:02.746001608Z [2024-03-28 03:52:02,745: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:52:02.771408765Z [2024-03-28 03:52:02,771: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:52:02.773589507Z [2024-03-28 03:52:02,773: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:52:02.773959906Z [2024-03-28 03:52:02,773: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:52:02.774320795Z [2024-03-28 03:52:02,773: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:52:02.774544556Z [2024-03-28 03:52:02,774: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:52:02.775266769Z [2024-03-28 03:52:02,774: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:52:02.775475327Z [2024-03-28 03:52:02,775: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:52:02.907221759Z [2024-03-28 03:52:02,906: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:52:04.496079628Z [2024-03-28 03:52:04,495: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd00a635-a5cb-4a93-9059-d64e2238d76d] succeeded in 3.8429649350000545s: None 2024-03-28T03:52:05.464840480Z [2024-03-28 03:52:05,464: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9a2d31c-abda-42c8-bae6-6b219e081bbf] succeeded in 4.823399126998993s: None 2024-03-28T03:53:01.263025190Z [2024-03-28 03:53:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b242d144-cf99-4d0a-9176-8c4806a868a0] received 2024-03-28T03:53:01.269612983Z [2024-03-28 03:53:01,269: INFO/ForkPoolWorker-15] [b242d144-cf99-4d0a-9176-8c4806a868a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:53:01.273888984Z [2024-03-28 03:53:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89efcce6-fe0c-4490-86e2-c74bfdabe7f1] received 2024-03-28T03:53:01.276017176Z [2024-03-28 03:53:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b15460-e23b-4e5c-af2b-8b29fdebb3ba] received 2024-03-28T03:53:01.286844749Z [2024-03-28 03:53:01,285: INFO/ForkPoolWorker-1] [11b15460-e23b-4e5c-af2b-8b29fdebb3ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:53:01.287580260Z [2024-03-28 03:53:01,287: INFO/ForkPoolWorker-16] [89efcce6-fe0c-4490-86e2-c74bfdabe7f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:53:01.578644065Z [2024-03-28 03:53:01,575: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:53:01.599429362Z [2024-03-28 03:53:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:53:01.613272770Z [2024-03-28 03:53:01,608: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:53:01.789665756Z [2024-03-28 03:53:01,788: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:53:01.798297419Z [2024-03-28 03:53:01,797: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:53:01.821185116Z [2024-03-28 03:53:01,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:53:01.823114799Z [2024-03-28 03:53:01,822: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:53:01.823280755Z [2024-03-28 03:53:01,823: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:53:01.823686611Z [2024-03-28 03:53:01,823: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:53:01.824021132Z [2024-03-28 03:53:01,823: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:53:01.928974118Z [2024-03-28 03:53:01,928: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:53:02.627813672Z [2024-03-28 03:53:02,627: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89efcce6-fe0c-4490-86e2-c74bfdabe7f1] succeeded in 1.350362014998609s: None 2024-03-28T03:53:02.957234698Z [2024-03-28 03:53:02,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:53:02.957273283Z [2024-03-28 03:53:02,956: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:53:02.960820477Z [2024-03-28 03:53:02,960: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:53:02.960899922Z [2024-03-28 03:53:02,960: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:53:02.986693126Z [2024-03-28 03:53:02,986: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:53:02.988493626Z [2024-03-28 03:53:02,988: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:53:02.988522138Z [2024-03-28 03:53:02,988: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:53:02.988772550Z [2024-03-28 03:53:02,988: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:53:02.988833874Z [2024-03-28 03:53:02,988: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:53:02.989900134Z [2024-03-28 03:53:02,989: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:53:02.989957933Z [2024-03-28 03:53:02,989: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:53:03.015658437Z [2024-03-28 03:53:03,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:53:03.017260417Z [2024-03-28 03:53:03,016: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:53:03.017299803Z [2024-03-28 03:53:03,017: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:53:03.017591870Z [2024-03-28 03:53:03,017: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:53:03.017628886Z [2024-03-28 03:53:03,017: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:53:03.018015916Z [2024-03-28 03:53:03,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:53:03.018130733Z [2024-03-28 03:53:03,017: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:53:03.116744236Z [2024-03-28 03:53:03,116: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:53:03.132632708Z [2024-03-28 03:53:03,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:53:04.712473715Z [2024-03-28 03:53:04,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b242d144-cf99-4d0a-9176-8c4806a868a0] succeeded in 3.4480566999991424s: None 2024-03-28T03:53:05.125316008Z [2024-03-28 03:53:05,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[11b15460-e23b-4e5c-af2b-8b29fdebb3ba] succeeded in 3.8473098760005087s: None 2024-03-28T03:54:01.130348899Z [2024-03-28 03:54:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e35217f4-af94-4be7-beb8-47c154145df5] received 2024-03-28T03:54:01.136251576Z [2024-03-28 03:54:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e350479c-e587-4201-91d7-e53d824b02d4] received 2024-03-28T03:54:01.141286209Z [2024-03-28 03:54:01,140: INFO/ForkPoolWorker-15] [e35217f4-af94-4be7-beb8-47c154145df5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:54:01.145645790Z [2024-03-28 03:54:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce950c25-c4be-40ac-865b-fec64dba215e] received 2024-03-28T03:54:01.155701078Z [2024-03-28 03:54:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f39f84e-67bd-4d04-9a07-69dd3190947d] received 2024-03-28T03:54:01.158504524Z [2024-03-28 03:54:01,158: INFO/ForkPoolWorker-1] [ce950c25-c4be-40ac-865b-fec64dba215e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:54:01.166608190Z [2024-03-28 03:54:01,166: INFO/ForkPoolWorker-16] [e350479c-e587-4201-91d7-e53d824b02d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:54:01.172790897Z [2024-03-28 03:54:01,172: INFO/ForkPoolWorker-2] [6f39f84e-67bd-4d04-9a07-69dd3190947d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:54:01.539415746Z [2024-03-28 03:54:01,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:54:01.573150742Z [2024-03-28 03:54:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:54:01.622649795Z [2024-03-28 03:54:01,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:54:01.645124907Z [2024-03-28 03:54:01,639: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:54:01.724685028Z [2024-03-28 03:54:01,724: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:54:01.729558805Z [2024-03-28 03:54:01,728: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:54:01.764578432Z [2024-03-28 03:54:01,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:54:01.766368616Z [2024-03-28 03:54:01,766: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:54:01.766647462Z [2024-03-28 03:54:01,766: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:54:01.766795305Z [2024-03-28 03:54:01,766: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:54:01.767174428Z [2024-03-28 03:54:01,767: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:54:01.961609636Z [2024-03-28 03:54:01,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:54:01.964517828Z [2024-03-28 03:54:01,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:54:02.965877338Z [2024-03-28 03:54:02,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e350479c-e587-4201-91d7-e53d824b02d4] succeeded in 1.8187450469995383s: None 2024-03-28T03:54:02.997820163Z [2024-03-28 03:54:02,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e35217f4-af94-4be7-beb8-47c154145df5] succeeded in 1.8650411060007173s: None 2024-03-28T03:54:03.524594330Z [2024-03-28 03:54:03,524: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:54:03.527927503Z [2024-03-28 03:54:03,527: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:54:03.528042317Z [2024-03-28 03:54:03,527: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:54:03.531414941Z [2024-03-28 03:54:03,530: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:54:03.564844985Z [2024-03-28 03:54:03,564: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:54:03.568063317Z [2024-03-28 03:54:03,567: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:54:03.568327586Z [2024-03-28 03:54:03,567: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:54:03.568455504Z [2024-03-28 03:54:03,568: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:54:03.568734043Z [2024-03-28 03:54:03,568: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:54:03.568918729Z [2024-03-28 03:54:03,568: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:54:03.569282334Z [2024-03-28 03:54:03,569: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:54:03.569472440Z [2024-03-28 03:54:03,569: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:54:03.569932436Z [2024-03-28 03:54:03,569: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:54:03.569965439Z [2024-03-28 03:54:03,569: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:54:03.570087413Z [2024-03-28 03:54:03,569: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:54:03.570124022Z [2024-03-28 03:54:03,570: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:54:03.570383174Z [2024-03-28 03:54:03,570: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:54:03.570489574Z [2024-03-28 03:54:03,570: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:54:03.713751356Z [2024-03-28 03:54:03,711: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:54:03.726752858Z [2024-03-28 03:54:03,726: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:54:05.386219371Z [2024-03-28 03:54:05,385: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce950c25-c4be-40ac-865b-fec64dba215e] succeeded in 4.238309730000765s: None 2024-03-28T03:54:05.877568523Z [2024-03-28 03:54:05,876: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6f39f84e-67bd-4d04-9a07-69dd3190947d] succeeded in 4.717143513998963s: None 2024-03-28T03:55:00.926538607Z [2024-03-28 03:55:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e503a2b-68f1-4add-bb65-07fe3a6e5f2b] received 2024-03-28T03:55:00.931708027Z [2024-03-28 03:55:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d4e856e-e457-4ad8-b655-e5d7e75c1d7b] received 2024-03-28T03:55:00.937578493Z [2024-03-28 03:55:00,937: INFO/ForkPoolWorker-15] [8e503a2b-68f1-4add-bb65-07fe3a6e5f2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:55:00.941720716Z [2024-03-28 03:55:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cbf82b2-c794-428c-a216-a43d179deb85] received 2024-03-28T03:55:00.942478031Z [2024-03-28 03:55:00,942: INFO/ForkPoolWorker-16] [6d4e856e-e457-4ad8-b655-e5d7e75c1d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:55:00.945012292Z [2024-03-28 03:55:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[890be884-9d00-40d1-90da-2429de1bf003] received 2024-03-28T03:55:00.950525695Z [2024-03-28 03:55:00,950: INFO/ForkPoolWorker-1] [4cbf82b2-c794-428c-a216-a43d179deb85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:55:00.953965453Z [2024-03-28 03:55:00,953: INFO/ForkPoolWorker-2] [890be884-9d00-40d1-90da-2429de1bf003] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:55:01.331705285Z [2024-03-28 03:55:01,328: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:55:01.381012465Z [2024-03-28 03:55:01,377: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:55:01.407231482Z [2024-03-28 03:55:01,403: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:55:01.504006845Z [2024-03-28 03:55:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:55:01.547473237Z [2024-03-28 03:55:01,547: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T03:55:01.551830879Z [2024-03-28 03:55:01,551: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:01.583800168Z [2024-03-28 03:55:01,583: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:55:01.585365810Z [2024-03-28 03:55:01,585: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:55:01.585734483Z [2024-03-28 03:55:01,585: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:55:01.585910099Z [2024-03-28 03:55:01,585: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T03:55:01.586232544Z [2024-03-28 03:55:01,586: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:55:01.741455130Z [2024-03-28 03:55:01,741: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:02.442361361Z [2024-03-28 03:55:02,441: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[890be884-9d00-40d1-90da-2429de1bf003] succeeded in 1.4952137150012277s: None 2024-03-28T03:55:02.723488958Z [2024-03-28 03:55:02,723: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:55:02.726979825Z [2024-03-28 03:55:02,726: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:02.762738563Z [2024-03-28 03:55:02,762: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:55:02.767174760Z [2024-03-28 03:55:02,766: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:02.767259922Z [2024-03-28 03:55:02,767: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:02.767566383Z [2024-03-28 03:55:02,767: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:02.767774660Z [2024-03-28 03:55:02,767: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:55:02.768352289Z [2024-03-28 03:55:02,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:55:02.769018535Z [2024-03-28 03:55:02,768: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:02.877999281Z [2024-03-28 03:55:02,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:02.956510231Z [2024-03-28 03:55:02,955: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:55:02.964468568Z [2024-03-28 03:55:02,962: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:03.023232589Z [2024-03-28 03:55:03,021: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:55:03.026889735Z [2024-03-28 03:55:03,024: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:03.026922794Z [2024-03-28 03:55:03,026: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:03.026975053Z [2024-03-28 03:55:03,026: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:03.027125372Z [2024-03-28 03:55:03,026: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:55:03.027706246Z [2024-03-28 03:55:03,027: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:55:03.028077058Z [2024-03-28 03:55:03,027: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:03.040650022Z [2024-03-28 03:55:03,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:55:03.045881435Z [2024-03-28 03:55:03,045: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:03.094011735Z [2024-03-28 03:55:03,089: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:55:03.094038098Z [2024-03-28 03:55:03,090: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:03.094042990Z [2024-03-28 03:55:03,090: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:03.094047012Z [2024-03-28 03:55:03,090: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:03.094051346Z [2024-03-28 03:55:03,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:55:03.094054748Z [2024-03-28 03:55:03,091: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:55:03.096275638Z [2024-03-28 03:55:03,091: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:03.142369448Z [2024-03-28 03:55:03,142: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:03.206901330Z [2024-03-28 03:55:03,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:03.775738754Z [2024-03-28 03:55:03,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c5d5750-9b6e-4f53-b85c-5da0dd8b38c6] received 2024-03-28T03:55:03.791528536Z [2024-03-28 03:55:03,791: INFO/ForkPoolWorker-2] [1c5d5750-9b6e-4f53-b85c-5da0dd8b38c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:55:03.858300308Z [2024-03-28 03:55:03,857: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cbf82b2-c794-428c-a216-a43d179deb85] succeeded in 2.9148005730003206s: None 2024-03-28T03:55:04.119684070Z [2024-03-28 03:55:04,116: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:55:04.421532231Z [2024-03-28 03:55:04,421: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e503a2b-68f1-4add-bb65-07fe3a6e5f2b] succeeded in 3.4924815129998024s: None 2024-03-28T03:55:05.274207787Z [2024-03-28 03:55:05,273: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d4e856e-e457-4ad8-b655-e5d7e75c1d7b] succeeded in 4.3403371189997415s: None 2024-03-28T03:55:05.275937456Z [2024-03-28 03:55:05,275: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:55:05.279315041Z [2024-03-28 03:55:05,278: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:05.298914168Z [2024-03-28 03:55:05,298: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:55:05.300595455Z [2024-03-28 03:55:05,300: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:05.300798346Z [2024-03-28 03:55:05,300: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:05.301026581Z [2024-03-28 03:55:05,300: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:05.301170875Z [2024-03-28 03:55:05,301: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:55:05.301574205Z [2024-03-28 03:55:05,301: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:55:05.301758878Z [2024-03-28 03:55:05,301: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:05.388028807Z [2024-03-28 03:55:05,387: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:06.080813863Z [2024-03-28 03:55:06,080: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c5d5750-9b6e-4f53-b85c-5da0dd8b38c6] succeeded in 2.3032247289993393s: None 2024-03-28T03:55:06.187033811Z [2024-03-28 03:55:06,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33dde9fa-a994-4a65-b2e0-e112ae93a7bd] received 2024-03-28T03:55:06.200786743Z [2024-03-28 03:55:06,200: INFO/ForkPoolWorker-15] [33dde9fa-a994-4a65-b2e0-e112ae93a7bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T03:55:06.491068938Z [2024-03-28 03:55:06,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:55:07.651705158Z [2024-03-28 03:55:07,651: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:55:07.655331789Z [2024-03-28 03:55:07,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:07.674795695Z [2024-03-28 03:55:07,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:55:07.676195672Z [2024-03-28 03:55:07,675: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:07.676325724Z [2024-03-28 03:55:07,676: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:07.676492752Z [2024-03-28 03:55:07,676: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:07.676595449Z [2024-03-28 03:55:07,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:55:07.676976331Z [2024-03-28 03:55:07,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:55:07.677060321Z [2024-03-28 03:55:07,676: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:07.773605940Z [2024-03-28 03:55:07,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:08.557614385Z [2024-03-28 03:55:08,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33dde9fa-a994-4a65-b2e0-e112ae93a7bd] succeeded in 2.3670582769991597s: None 2024-03-28T03:55:08.599329229Z [2024-03-28 03:55:08,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[013af278-988f-4607-81dd-6a40c9f747dd] received 2024-03-28T03:55:08.610179049Z [2024-03-28 03:55:08,609: INFO/ForkPoolWorker-15] [013af278-988f-4607-81dd-6a40c9f747dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T03:55:08.996734964Z [2024-03-28 03:55:08,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T03:55:10.438677403Z [2024-03-28 03:55:10,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:55:10.442401565Z [2024-03-28 03:55:10,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:55:10.494095718Z [2024-03-28 03:55:10,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:55:10.502378906Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:55:10.502400980Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:55:10.502450923Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:55:10.502493123Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:55:10.502781457Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T03:55:10.502798267Z [2024-03-28 03:55:10,502: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:55:10.621608682Z [2024-03-28 03:55:10,620: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:55:11.284961603Z [2024-03-28 03:55:11,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[013af278-988f-4607-81dd-6a40c9f747dd] succeeded in 2.682259093000539s: None 2024-03-28T03:56:00.974721699Z [2024-03-28 03:56:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cdfa52d-30c1-4a27-b6c6-89fb2206d26a] received 2024-03-28T03:56:00.981316137Z [2024-03-28 03:56:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4c11662-8f01-4e03-b392-3a0eaed25626] received 2024-03-28T03:56:00.983575304Z [2024-03-28 03:56:00,982: INFO/ForkPoolWorker-15] [0cdfa52d-30c1-4a27-b6c6-89fb2206d26a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:56:00.985583162Z [2024-03-28 03:56:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6de62de-7ca3-4c7f-a4b5-4e114a0fba0a] received 2024-03-28T03:56:00.995907352Z [2024-03-28 03:56:00,995: INFO/ForkPoolWorker-16] [a4c11662-8f01-4e03-b392-3a0eaed25626] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:56:00.996708461Z [2024-03-28 03:56:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4082292-a8a3-4d05-816e-c4008ce2b2aa] received 2024-03-28T03:56:00.998339242Z [2024-03-28 03:56:00,998: INFO/ForkPoolWorker-1] [e6de62de-7ca3-4c7f-a4b5-4e114a0fba0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:56:01.009157963Z [2024-03-28 03:56:01,008: INFO/ForkPoolWorker-2] [a4082292-a8a3-4d05-816e-c4008ce2b2aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:56:01.432521659Z [2024-03-28 03:56:01,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:56:01.585278554Z [2024-03-28 03:56:01,581: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:56:01.593167748Z [2024-03-28 03:56:01,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:56:01.626168017Z [2024-03-28 03:56:01,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:56:01.840569640Z [2024-03-28 03:56:01,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:56:01.957744567Z [2024-03-28 03:56:01,957: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:56:01.966151799Z [2024-03-28 03:56:01,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:56:02.009033921Z [2024-03-28 03:56:02,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:56:02.013948589Z [2024-03-28 03:56:02,013: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:56:02.014086314Z [2024-03-28 03:56:02,013: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:56:02.014171177Z [2024-03-28 03:56:02,014: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:56:02.014527867Z [2024-03-28 03:56:02,014: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:56:02.167066320Z [2024-03-28 03:56:02,166: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:56:02.747070159Z [2024-03-28 03:56:02,746: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cdfa52d-30c1-4a27-b6c6-89fb2206d26a] succeeded in 1.7707327349999105s: None 2024-03-28T03:56:02.953304973Z [2024-03-28 03:56:02,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4c11662-8f01-4e03-b392-3a0eaed25626] succeeded in 1.9684604649992252s: None 2024-03-28T03:56:03.056783404Z [2024-03-28 03:56:03,056: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T03:56:03.061197710Z [2024-03-28 03:56:03,060: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:56:03.081589671Z [2024-03-28 03:56:03,080: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:56:03.083380320Z [2024-03-28 03:56:03,083: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:56:03.083400595Z [2024-03-28 03:56:03,083: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:56:03.083504972Z [2024-03-28 03:56:03,083: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:56:03.083539723Z [2024-03-28 03:56:03,083: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T03:56:03.084065563Z [2024-03-28 03:56:03,083: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:56:03.084140023Z [2024-03-28 03:56:03,084: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:56:03.170360225Z [2024-03-28 03:56:03,169: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:56:03.174199453Z [2024-03-28 03:56:03,173: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:56:03.181134755Z [2024-03-28 03:56:03,180: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:56:03.193714115Z [2024-03-28 03:56:03,193: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:56:03.195148406Z [2024-03-28 03:56:03,194: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:56:03.195161021Z [2024-03-28 03:56:03,195: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:56:03.195435544Z [2024-03-28 03:56:03,195: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:56:03.195618092Z [2024-03-28 03:56:03,195: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:56:03.196164373Z [2024-03-28 03:56:03,195: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:56:03.196356640Z [2024-03-28 03:56:03,196: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:56:03.337607166Z [2024-03-28 03:56:03,337: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:56:05.403064542Z [2024-03-28 03:56:05,402: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4082292-a8a3-4d05-816e-c4008ce2b2aa] succeeded in 4.404277892999744s: None 2024-03-28T03:56:05.901786921Z [2024-03-28 03:56:05,901: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6de62de-7ca3-4c7f-a4b5-4e114a0fba0a] succeeded in 4.914364538000882s: None 2024-03-28T03:57:00.580077554Z [2024-03-28 03:57:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d57376-59c1-4cb9-9172-373e9bb014c4] received 2024-03-28T03:57:00.582190295Z [2024-03-28 03:57:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5077caf9-a76a-489b-876d-f2f51443e7b7] received 2024-03-28T03:57:00.586867258Z [2024-03-28 03:57:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc908181-7c2d-4628-9ba4-6a47c339ebcc] received 2024-03-28T03:57:00.591924689Z [2024-03-28 03:57:00,591: INFO/ForkPoolWorker-15] [77d57376-59c1-4cb9-9172-373e9bb014c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:57:00.592301895Z [2024-03-28 03:57:00,592: INFO/ForkPoolWorker-16] [5077caf9-a76a-489b-876d-f2f51443e7b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:57:00.596052770Z [2024-03-28 03:57:00,595: INFO/ForkPoolWorker-1] [bc908181-7c2d-4628-9ba4-6a47c339ebcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:57:00.866205503Z [2024-03-28 03:57:00,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:57:00.908777200Z [2024-03-28 03:57:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:57:00.945554008Z [2024-03-28 03:57:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:57:01.077216970Z [2024-03-28 03:57:01,076: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:57:01.081595657Z [2024-03-28 03:57:01,081: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:57:01.109875834Z [2024-03-28 03:57:01,109: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:57:01.114458356Z [2024-03-28 03:57:01,114: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:57:01.114677467Z [2024-03-28 03:57:01,114: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:57:01.114834555Z [2024-03-28 03:57:01,114: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:57:01.115174454Z [2024-03-28 03:57:01,115: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:57:01.240172755Z [2024-03-28 03:57:01,239: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:57:02.110002709Z [2024-03-28 03:57:02,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc908181-7c2d-4628-9ba4-6a47c339ebcc] succeeded in 1.520567111998389s: None 2024-03-28T03:57:02.322770104Z [2024-03-28 03:57:02,322: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:57:02.326398139Z [2024-03-28 03:57:02,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:57:02.348617685Z [2024-03-28 03:57:02,348: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:57:02.350563356Z [2024-03-28 03:57:02,350: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:57:02.352341686Z [2024-03-28 03:57:02,350: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:57:02.352720366Z [2024-03-28 03:57:02,352: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:57:02.353879970Z [2024-03-28 03:57:02,352: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:57:02.354505881Z [2024-03-28 03:57:02,354: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:57:02.354678833Z [2024-03-28 03:57:02,354: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:57:02.399487922Z [2024-03-28 03:57:02,399: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:57:02.403443854Z [2024-03-28 03:57:02,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:57:02.427628822Z [2024-03-28 03:57:02,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:57:02.429680154Z [2024-03-28 03:57:02,429: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:57:02.429702415Z [2024-03-28 03:57:02,429: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:57:02.429919064Z [2024-03-28 03:57:02,429: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:57:02.430058424Z [2024-03-28 03:57:02,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:57:02.430646718Z [2024-03-28 03:57:02,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:57:02.430891048Z [2024-03-28 03:57:02,430: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:57:02.477232740Z [2024-03-28 03:57:02,476: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:57:02.537949480Z [2024-03-28 03:57:02,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:57:03.894532276Z [2024-03-28 03:57:03,894: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5077caf9-a76a-489b-876d-f2f51443e7b7] succeeded in 3.3070824639999046s: None 2024-03-28T03:57:04.473298383Z [2024-03-28 03:57:04,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77d57376-59c1-4cb9-9172-373e9bb014c4] succeeded in 3.8914117500007706s: None 2024-03-28T03:58:00.807753357Z [2024-03-28 03:58:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa0f4f7-46d7-41b9-88b3-3ee90a3c313a] received 2024-03-28T03:58:00.810245202Z [2024-03-28 03:58:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4730b1fe-59f4-4b2f-b709-02dd0739f5b7] received 2024-03-28T03:58:00.825250915Z [2024-03-28 03:58:00,824: INFO/ForkPoolWorker-15] [0aa0f4f7-46d7-41b9-88b3-3ee90a3c313a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:58:00.825890464Z [2024-03-28 03:58:00,825: INFO/ForkPoolWorker-16] [4730b1fe-59f4-4b2f-b709-02dd0739f5b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:58:00.835577010Z [2024-03-28 03:58:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[421287fe-46eb-4154-9cc3-b5fb79607e5f] received 2024-03-28T03:58:00.838071770Z [2024-03-28 03:58:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e28511a1-9227-4ea4-846c-81c7b3e9426c] received 2024-03-28T03:58:00.855520141Z [2024-03-28 03:58:00,854: INFO/ForkPoolWorker-1] [421287fe-46eb-4154-9cc3-b5fb79607e5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T03:58:00.863209407Z [2024-03-28 03:58:00,862: INFO/ForkPoolWorker-2] [e28511a1-9227-4ea4-846c-81c7b3e9426c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:58:01.353369799Z [2024-03-28 03:58:01,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:58:01.353707846Z [2024-03-28 03:58:01,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:58:01.433132333Z [2024-03-28 03:58:01,429: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T03:58:01.467601605Z [2024-03-28 03:58:01,464: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:58:01.735191254Z [2024-03-28 03:58:01,734: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:58:01.891060605Z [2024-03-28 03:58:01,890: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T03:58:01.896603907Z [2024-03-28 03:58:01,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:58:01.939861155Z [2024-03-28 03:58:01,939: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:58:01.950329459Z [2024-03-28 03:58:01,949: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:58:01.950583423Z [2024-03-28 03:58:01,950: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:58:01.950726423Z [2024-03-28 03:58:01,950: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T03:58:01.951174510Z [2024-03-28 03:58:01,950: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:58:02.156383441Z [2024-03-28 03:58:02,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:58:02.885326186Z [2024-03-28 03:58:02,884: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[421287fe-46eb-4154-9cc3-b5fb79607e5f] succeeded in 2.0465437620005105s: None 2024-03-28T03:58:03.099068189Z [2024-03-28 03:58:03,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4730b1fe-59f4-4b2f-b709-02dd0739f5b7] succeeded in 2.2832313349990727s: None 2024-03-28T03:58:03.273581035Z [2024-03-28 03:58:03,273: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:58:03.277004138Z [2024-03-28 03:58:03,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:58:03.301075630Z [2024-03-28 03:58:03,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:58:03.303438892Z [2024-03-28 03:58:03,303: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:58:03.303528136Z [2024-03-28 03:58:03,303: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:58:03.303728560Z [2024-03-28 03:58:03,303: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:58:03.303825372Z [2024-03-28 03:58:03,303: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:58:03.304113682Z [2024-03-28 03:58:03,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:58:03.304155096Z [2024-03-28 03:58:03,304: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:58:03.394293991Z [2024-03-28 03:58:03,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:58:03.669930032Z [2024-03-28 03:58:03,669: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T03:58:03.673296322Z [2024-03-28 03:58:03,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:58:03.703604934Z [2024-03-28 03:58:03,703: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T03:58:03.705118429Z [2024-03-28 03:58:03,704: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:58:03.705225074Z [2024-03-28 03:58:03,705: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:58:03.705437238Z [2024-03-28 03:58:03,705: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:58:03.705675742Z [2024-03-28 03:58:03,705: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T03:58:03.705963231Z [2024-03-28 03:58:03,705: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:58:03.706073894Z [2024-03-28 03:58:03,705: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:58:03.799918692Z [2024-03-28 03:58:03,799: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:58:04.940263097Z [2024-03-28 03:58:04,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0aa0f4f7-46d7-41b9-88b3-3ee90a3c313a] succeeded in 4.130626639000184s: None 2024-03-28T03:58:05.597924308Z [2024-03-28 03:58:05,596: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e28511a1-9227-4ea4-846c-81c7b3e9426c] succeeded in 4.754464719999305s: None 2024-03-28T03:59:01.089053444Z [2024-03-28 03:59:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ad4b4f3-3347-45b8-8bac-84ced16c3eb4] received 2024-03-28T03:59:01.090571237Z [2024-03-28 03:59:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3e5ddc6-456f-4b55-a104-d1f647472560] received 2024-03-28T03:59:01.093380193Z [2024-03-28 03:59:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[920407d4-8a2e-4b83-9db9-9a0c6d960364] received 2024-03-28T03:59:01.096483669Z [2024-03-28 03:59:01,096: INFO/ForkPoolWorker-16] [f3e5ddc6-456f-4b55-a104-d1f647472560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T03:59:01.097810810Z [2024-03-28 03:59:01,097: INFO/ForkPoolWorker-15] [7ad4b4f3-3347-45b8-8bac-84ced16c3eb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T03:59:01.107916700Z [2024-03-28 03:59:01,107: INFO/ForkPoolWorker-1] [920407d4-8a2e-4b83-9db9-9a0c6d960364] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T03:59:01.400676897Z [2024-03-28 03:59:01,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T03:59:01.401390987Z [2024-03-28 03:59:01,398: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T03:59:01.448565245Z [2024-03-28 03:59:01,443: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T03:59:01.622150704Z [2024-03-28 03:59:01,621: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T03:59:01.626364874Z [2024-03-28 03:59:01,625: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:59:01.654717988Z [2024-03-28 03:59:01,654: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T03:59:01.657552035Z [2024-03-28 03:59:01,657: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T03:59:01.657708547Z [2024-03-28 03:59:01,657: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T03:59:01.657719544Z [2024-03-28 03:59:01,657: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T03:59:01.657940337Z [2024-03-28 03:59:01,657: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T03:59:01.759059766Z [2024-03-28 03:59:01,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:59:02.464945263Z [2024-03-28 03:59:02,464: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[920407d4-8a2e-4b83-9db9-9a0c6d960364] succeeded in 1.368958338000084s: None 2024-03-28T03:59:02.693918254Z [2024-03-28 03:59:02,693: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T03:59:02.697410926Z [2024-03-28 03:59:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:59:02.698743803Z [2024-03-28 03:59:02,698: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T03:59:02.702379756Z [2024-03-28 03:59:02,701: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T03:59:02.724012413Z [2024-03-28 03:59:02,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T03:59:02.726386678Z [2024-03-28 03:59:02,726: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:59:02.726653270Z [2024-03-28 03:59:02,726: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:59:02.726902989Z [2024-03-28 03:59:02,726: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:59:02.727085552Z [2024-03-28 03:59:02,726: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T03:59:02.727442283Z [2024-03-28 03:59:02,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T03:59:02.728169801Z [2024-03-28 03:59:02,727: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:59:02.735341079Z [2024-03-28 03:59:02,735: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T03:59:02.736741663Z [2024-03-28 03:59:02,736: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T03:59:02.736766120Z [2024-03-28 03:59:02,736: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T03:59:02.736917311Z [2024-03-28 03:59:02,736: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T03:59:02.736981582Z [2024-03-28 03:59:02,736: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T03:59:02.737295512Z [2024-03-28 03:59:02,737: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T03:59:02.737462673Z [2024-03-28 03:59:02,737: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T03:59:02.832414786Z [2024-03-28 03:59:02,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:59:02.882006759Z [2024-03-28 03:59:02,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T03:59:04.956887994Z [2024-03-28 03:59:04,956: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3e5ddc6-456f-4b55-a104-d1f647472560] succeeded in 3.8648911810014397s: None 2024-03-28T03:59:05.426893899Z [2024-03-28 03:59:05,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ad4b4f3-3347-45b8-8bac-84ced16c3eb4] succeeded in 4.335105616000874s: None 2024-03-28T04:00:00.948845767Z [2024-03-28 04:00:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23b0f952-09a8-4b79-be6e-0710f668527f] received 2024-03-28T04:00:00.957462885Z [2024-03-28 04:00:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c37dab78-6d44-4421-92bf-74ad3fff2d0d] received 2024-03-28T04:00:00.958545935Z [2024-03-28 04:00:00,958: INFO/ForkPoolWorker-15] [23b0f952-09a8-4b79-be6e-0710f668527f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:00:00.964647213Z [2024-03-28 04:00:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24eb366f-73dd-480e-ad62-7d52810c9745] received 2024-03-28T04:00:00.966431807Z [2024-03-28 04:00:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03e931dd-0b3f-4b1d-95d2-d5c246556ee4] received 2024-03-28T04:00:00.968247184Z [2024-03-28 04:00:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0792fa6a-3007-4e73-bab0-ae0f0bec242a] received 2024-03-28T04:00:00.976212494Z [2024-03-28 04:00:00,975: INFO/ForkPoolWorker-16] [c37dab78-6d44-4421-92bf-74ad3fff2d0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T04:00:00.988917813Z [2024-03-28 04:00:00,988: INFO/ForkPoolWorker-1] [24eb366f-73dd-480e-ad62-7d52810c9745] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:00:01.014426850Z [2024-03-28 04:00:01,014: INFO/ForkPoolWorker-2] [03e931dd-0b3f-4b1d-95d2-d5c246556ee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:00:01.022359896Z [2024-03-28 04:00:01,021: INFO/ForkPoolWorker-3] [0792fa6a-3007-4e73-bab0-ae0f0bec242a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:00:01.423380035Z [2024-03-28 04:00:01,416: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T04:00:01.430883325Z [2024-03-28 04:00:01,426: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:00:01.501718191Z [2024-03-28 04:00:01,496: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:00:01.640787579Z [2024-03-28 04:00:01,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:00:01.706105711Z [2024-03-28 04:00:01,705: INFO/ForkPoolWorker-3] Getting SDNC list 2024-03-28T04:00:01.710445915Z [2024-03-28 04:00:01,709: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:01.739856687Z [2024-03-28 04:00:01,739: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-03-28T04:00:01.741550675Z [2024-03-28 04:00:01,741: INFO/ForkPoolWorker-3] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:00:01.741868162Z [2024-03-28 04:00:01,741: INFO/ForkPoolWorker-3] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:00:01.742104041Z [2024-03-28 04:00:01,741: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-03-28T04:00:01.742735759Z [2024-03-28 04:00:01,742: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:00:01.757021051Z [2024-03-28 04:00:01,753: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:00:01.759435857Z [2024-03-28 04:00:01,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:01.914333631Z [2024-03-28 04:00:01,914: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:02.500468328Z [2024-03-28 04:00:02,500: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c37dab78-6d44-4421-92bf-74ad3fff2d0d] succeeded in 1.5342503980009496s: None 2024-03-28T04:00:02.846849165Z [2024-03-28 04:00:02,846: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0792fa6a-3007-4e73-bab0-ae0f0bec242a] succeeded in 1.8682344119988556s: None 2024-03-28T04:00:03.428631625Z [2024-03-28 04:00:03,425: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:00:03.437532564Z [2024-03-28 04:00:03,436: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:03.463641119Z [2024-03-28 04:00:03,463: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:00:03.464380610Z [2024-03-28 04:00:03,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:00:03.466395894Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:03.466414376Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:03.466509298Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:03.466530989Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:00:03.466810171Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:00:03.469661965Z [2024-03-28 04:00:03,466: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:03.476730731Z [2024-03-28 04:00:03,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:03.534843359Z [2024-03-28 04:00:03,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:00:03.539643819Z [2024-03-28 04:00:03,539: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:03.545739206Z [2024-03-28 04:00:03,539: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:03.545769571Z [2024-03-28 04:00:03,540: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:03.545860509Z [2024-03-28 04:00:03,540: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:00:03.545868483Z [2024-03-28 04:00:03,540: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:00:03.545878261Z [2024-03-28 04:00:03,540: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:03.656054222Z [2024-03-28 04:00:03,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:03.747276414Z [2024-03-28 04:00:03,741: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:03.750790240Z [2024-03-28 04:00:03,746: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T04:00:03.751348768Z [2024-03-28 04:00:03,750: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:03.781691994Z [2024-03-28 04:00:03,781: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:00:03.782991179Z [2024-03-28 04:00:03,782: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:03.783006545Z [2024-03-28 04:00:03,782: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:03.783206881Z [2024-03-28 04:00:03,782: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:03.783260948Z [2024-03-28 04:00:03,783: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T04:00:03.783598058Z [2024-03-28 04:00:03,783: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:00:03.783743454Z [2024-03-28 04:00:03,783: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:03.919039732Z [2024-03-28 04:00:03,918: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:04.480715521Z [2024-03-28 04:00:04,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23b0f952-09a8-4b79-be6e-0710f668527f] succeeded in 3.529701223998927s: None 2024-03-28T04:00:04.881677776Z [2024-03-28 04:00:04,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc81fc7-36c5-4691-9ca3-c3aee8ec8686] received 2024-03-28T04:00:04.890642131Z [2024-03-28 04:00:04,890: INFO/ForkPoolWorker-15] [6cc81fc7-36c5-4691-9ca3-c3aee8ec8686] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:00:05.217687382Z [2024-03-28 04:00:05,214: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:00:05.468911927Z [2024-03-28 04:00:05,468: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[03e931dd-0b3f-4b1d-95d2-d5c246556ee4] succeeded in 4.499138977000257s: None 2024-03-28T04:00:06.380625875Z [2024-03-28 04:00:06,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24eb366f-73dd-480e-ad62-7d52810c9745] succeeded in 5.410625618998893s: None 2024-03-28T04:00:06.488621815Z [2024-03-28 04:00:06,488: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:00:06.492077900Z [2024-03-28 04:00:06,491: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:06.515029670Z [2024-03-28 04:00:06,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:00:06.517863272Z [2024-03-28 04:00:06,517: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:06.518262550Z [2024-03-28 04:00:06,518: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:06.518617897Z [2024-03-28 04:00:06,518: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:06.518867312Z [2024-03-28 04:00:06,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:00:06.519399300Z [2024-03-28 04:00:06,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:00:06.520178148Z [2024-03-28 04:00:06,519: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:06.634324984Z [2024-03-28 04:00:06,633: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:07.279704342Z [2024-03-28 04:00:07,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cc81fc7-36c5-4691-9ca3-c3aee8ec8686] succeeded in 2.395584116000464s: None 2024-03-28T04:00:07.351410331Z [2024-03-28 04:00:07,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f2f7ec2-8652-4d73-8e97-b688acf30186] received 2024-03-28T04:00:07.358630650Z [2024-03-28 04:00:07,358: INFO/ForkPoolWorker-15] [5f2f7ec2-8652-4d73-8e97-b688acf30186] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T04:00:07.649538962Z [2024-03-28 04:00:07,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:00:09.033925982Z [2024-03-28 04:00:09,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:00:09.037281657Z [2024-03-28 04:00:09,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:09.090787971Z [2024-03-28 04:00:09,090: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:00:09.098440344Z [2024-03-28 04:00:09,098: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:09.098502947Z [2024-03-28 04:00:09,098: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:09.098672011Z [2024-03-28 04:00:09,098: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:09.098756190Z [2024-03-28 04:00:09,098: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:00:09.099107045Z [2024-03-28 04:00:09,098: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:00:09.099239680Z [2024-03-28 04:00:09,099: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:09.285752587Z [2024-03-28 04:00:09,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:10.006858977Z [2024-03-28 04:00:10,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3a27eb8-b2b1-4af5-b262-a49c1ddf81da] received 2024-03-28T04:00:10.014722114Z [2024-03-28 04:00:10,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f2f7ec2-8652-4d73-8e97-b688acf30186] succeeded in 2.6616021359986917s: None 2024-03-28T04:00:10.030499752Z [2024-03-28 04:00:10,030: INFO/ForkPoolWorker-16] [a3a27eb8-b2b1-4af5-b262-a49c1ddf81da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:00:10.360818988Z [2024-03-28 04:00:10,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:00:11.989319539Z [2024-03-28 04:00:11,988: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:00:12.001697323Z [2024-03-28 04:00:12,000: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:00:12.035256450Z [2024-03-28 04:00:12,034: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:00:12.037899152Z [2024-03-28 04:00:12,037: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:00:12.037959749Z [2024-03-28 04:00:12,037: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:00:12.038271440Z [2024-03-28 04:00:12,038: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:00:12.038430041Z [2024-03-28 04:00:12,038: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:00:12.038862752Z [2024-03-28 04:00:12,038: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:00:12.039027206Z [2024-03-28 04:00:12,038: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:00:12.131950099Z [2024-03-28 04:00:12,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:00:12.758580375Z [2024-03-28 04:00:12,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3a27eb8-b2b1-4af5-b262-a49c1ddf81da] succeeded in 2.7466842450012336s: None 2024-03-28T04:01:00.652182987Z [2024-03-28 04:01:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d92fcfa-476b-4756-a95a-29888db169eb] received 2024-03-28T04:01:00.653818906Z [2024-03-28 04:01:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5777621-e0fc-4c40-803c-0622d8498646] received 2024-03-28T04:01:00.662821329Z [2024-03-28 04:01:00,662: INFO/ForkPoolWorker-15] [6d92fcfa-476b-4756-a95a-29888db169eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:01:00.663055995Z [2024-03-28 04:01:00,662: INFO/ForkPoolWorker-16] [f5777621-e0fc-4c40-803c-0622d8498646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:01:00.674082550Z [2024-03-28 04:01:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61481740-01ef-407d-9de4-628ce0157a38] received 2024-03-28T04:01:00.681425088Z [2024-03-28 04:01:00,681: INFO/ForkPoolWorker-1] [61481740-01ef-407d-9de4-628ce0157a38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:01:00.972873696Z [2024-03-28 04:01:00,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:01:00.994349032Z [2024-03-28 04:01:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:01:00.995426266Z [2024-03-28 04:01:00,992: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:01:01.131560382Z [2024-03-28 04:01:01,130: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T04:01:01.135761223Z [2024-03-28 04:01:01,135: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:01:01.162269195Z [2024-03-28 04:01:01,162: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:01:01.163409201Z [2024-03-28 04:01:01,163: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:01:01.163499282Z [2024-03-28 04:01:01,163: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:01:01.163549776Z [2024-03-28 04:01:01,163: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T04:01:01.163751547Z [2024-03-28 04:01:01,163: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:01:01.258067888Z [2024-03-28 04:01:01,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:01:01.845646480Z [2024-03-28 04:01:01,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d92fcfa-476b-4756-a95a-29888db169eb] succeeded in 1.1904409430007945s: None 2024-03-28T04:01:02.255547680Z [2024-03-28 04:01:02,255: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:01:02.259239528Z [2024-03-28 04:01:02,258: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:01:02.285350277Z [2024-03-28 04:01:02,284: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:01:02.287400601Z [2024-03-28 04:01:02,286: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:01:02.287488417Z [2024-03-28 04:01:02,286: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:01:02.287518350Z [2024-03-28 04:01:02,287: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:01:02.287528839Z [2024-03-28 04:01:02,287: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:01:02.287828073Z [2024-03-28 04:01:02,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:01:02.287863120Z [2024-03-28 04:01:02,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:01:02.351952119Z [2024-03-28 04:01:02,351: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:01:02.355475056Z [2024-03-28 04:01:02,354: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:01:02.375931259Z [2024-03-28 04:01:02,375: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:01:02.377430547Z [2024-03-28 04:01:02,377: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:01:02.377444787Z [2024-03-28 04:01:02,377: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:01:02.377628039Z [2024-03-28 04:01:02,377: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:01:02.377661273Z [2024-03-28 04:01:02,377: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:01:02.378194830Z [2024-03-28 04:01:02,377: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:01:02.378210210Z [2024-03-28 04:01:02,378: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:01:02.378500964Z [2024-03-28 04:01:02,378: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:01:02.493605186Z [2024-03-28 04:01:02,493: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:01:04.045381528Z [2024-03-28 04:01:04,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61481740-01ef-407d-9de4-628ce0157a38] succeeded in 3.369466543999806s: None 2024-03-28T04:01:04.422712918Z [2024-03-28 04:01:04,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5777621-e0fc-4c40-803c-0622d8498646] succeeded in 3.767533108000862s: None 2024-03-28T04:02:00.408362360Z [2024-03-28 04:02:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c1978e0-4347-4fe5-9743-ac8603b93e11] received 2024-03-28T04:02:00.413320903Z [2024-03-28 04:02:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4fc9962-de04-479f-b474-6eece096a47a] received 2024-03-28T04:02:00.414147950Z [2024-03-28 04:02:00,413: INFO/ForkPoolWorker-15] [2c1978e0-4347-4fe5-9743-ac8603b93e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T04:02:00.423815596Z [2024-03-28 04:02:00,423: INFO/ForkPoolWorker-16] [a4fc9962-de04-479f-b474-6eece096a47a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:02:00.435951472Z [2024-03-28 04:02:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71f78722-cf9e-4298-bf35-5f2e94579f25] received 2024-03-28T04:02:00.438522566Z [2024-03-28 04:02:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa1a3484-e60d-497d-b12d-1fdd2ce63cba] received 2024-03-28T04:02:00.459513946Z [2024-03-28 04:02:00,459: INFO/ForkPoolWorker-2] [fa1a3484-e60d-497d-b12d-1fdd2ce63cba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:02:00.498658305Z [2024-03-28 04:02:00,498: INFO/ForkPoolWorker-1] [71f78722-cf9e-4298-bf35-5f2e94579f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:02:00.831123973Z [2024-03-28 04:02:00,827: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:02:00.881072954Z [2024-03-28 04:02:00,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T04:02:01.014259674Z [2024-03-28 04:02:01,010: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:02:01.054773740Z [2024-03-28 04:02:01,050: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:02:01.321931705Z [2024-03-28 04:02:01,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:02:01.332644694Z [2024-03-28 04:02:01,332: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T04:02:01.344743653Z [2024-03-28 04:02:01,344: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:02:01.385421804Z [2024-03-28 04:02:01,385: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:02:01.387137289Z [2024-03-28 04:02:01,386: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:02:01.387548074Z [2024-03-28 04:02:01,387: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:02:01.387834232Z [2024-03-28 04:02:01,387: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T04:02:01.388151561Z [2024-03-28 04:02:01,388: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:02:01.499407697Z [2024-03-28 04:02:01,499: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:02:02.268499485Z [2024-03-28 04:02:02,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c1978e0-4347-4fe5-9743-ac8603b93e11] succeeded in 1.8586247750008624s: None 2024-03-28T04:02:02.490953885Z [2024-03-28 04:02:02,490: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa1a3484-e60d-497d-b12d-1fdd2ce63cba] succeeded in 2.049574152000787s: None 2024-03-28T04:02:02.561221317Z [2024-03-28 04:02:02,560: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:02:02.565241274Z [2024-03-28 04:02:02,564: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:02:02.606707640Z [2024-03-28 04:02:02,598: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:02:02.610244089Z [2024-03-28 04:02:02,608: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:02:02.610267770Z [2024-03-28 04:02:02,609: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:02:02.610272063Z [2024-03-28 04:02:02,609: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:02:02.610276143Z [2024-03-28 04:02:02,609: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:02:02.610279490Z [2024-03-28 04:02:02,609: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:02:02.610282863Z [2024-03-28 04:02:02,609: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:02:02.738102699Z [2024-03-28 04:02:02,737: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:02:03.056526754Z [2024-03-28 04:02:03,056: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:02:03.060216981Z [2024-03-28 04:02:03,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:02:03.095479134Z [2024-03-28 04:02:03,095: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:02:03.098688040Z [2024-03-28 04:02:03,098: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:02:03.098719136Z [2024-03-28 04:02:03,098: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:02:03.098957026Z [2024-03-28 04:02:03,098: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:02:03.099047955Z [2024-03-28 04:02:03,098: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:02:03.100715911Z [2024-03-28 04:02:03,099: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:02:03.100834345Z [2024-03-28 04:02:03,100: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:02:03.196296098Z [2024-03-28 04:02:03,195: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:02:04.302722247Z [2024-03-28 04:02:04,302: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4fc9962-de04-479f-b474-6eece096a47a] succeeded in 3.8869415990011476s: None 2024-03-28T04:02:05.106792693Z [2024-03-28 04:02:05,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71f78722-cf9e-4298-bf35-5f2e94579f25] succeeded in 4.66585707899867s: None 2024-03-28T04:03:01.279335383Z [2024-03-28 04:03:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a634bc9-d588-4b0a-b3cd-31eeac298f89] received 2024-03-28T04:03:01.286064647Z [2024-03-28 04:03:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b149ef-a290-46cf-81b5-8379965e71da] received 2024-03-28T04:03:01.287853444Z [2024-03-28 04:03:01,287: INFO/ForkPoolWorker-15] [1a634bc9-d588-4b0a-b3cd-31eeac298f89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:03:01.293196573Z [2024-03-28 04:03:01,292: INFO/ForkPoolWorker-16] [a9b149ef-a290-46cf-81b5-8379965e71da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:03:01.295027763Z [2024-03-28 04:03:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b69298f5-c96e-48f7-a42a-568a8b909b93] received 2024-03-28T04:03:01.303970969Z [2024-03-28 04:03:01,303: INFO/ForkPoolWorker-1] [b69298f5-c96e-48f7-a42a-568a8b909b93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:03:01.636724455Z [2024-03-28 04:03:01,632: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:03:01.676110321Z [2024-03-28 04:03:01,672: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:03:01.740020288Z [2024-03-28 04:03:01,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:03:02.004894015Z [2024-03-28 04:03:02,004: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T04:03:02.009390552Z [2024-03-28 04:03:02,008: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:03:02.040523292Z [2024-03-28 04:03:02,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:03:02.044141851Z [2024-03-28 04:03:02,043: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:03:02.044831897Z [2024-03-28 04:03:02,044: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:03:02.045028152Z [2024-03-28 04:03:02,044: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T04:03:02.045425902Z [2024-03-28 04:03:02,045: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:03:02.174872071Z [2024-03-28 04:03:02,174: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:03:02.955236136Z [2024-03-28 04:03:02,954: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a634bc9-d588-4b0a-b3cd-31eeac298f89] succeeded in 1.6732964680013538s: None 2024-03-28T04:03:03.013187222Z [2024-03-28 04:03:03,012: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:03:03.016747238Z [2024-03-28 04:03:03,016: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:03:03.049290109Z [2024-03-28 04:03:03,048: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:03:03.051774360Z [2024-03-28 04:03:03,051: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:03:03.051807209Z [2024-03-28 04:03:03,051: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:03:03.051998972Z [2024-03-28 04:03:03,051: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:03:03.052047446Z [2024-03-28 04:03:03,051: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:03:03.052465164Z [2024-03-28 04:03:03,052: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:03:03.052515071Z [2024-03-28 04:03:03,052: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:03:03.176659320Z [2024-03-28 04:03:03,176: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:03:03.206841705Z [2024-03-28 04:03:03,206: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:03:03.212412801Z [2024-03-28 04:03:03,211: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:03:03.254175040Z [2024-03-28 04:03:03,253: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:03:03.256645455Z [2024-03-28 04:03:03,256: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:03:03.257336991Z [2024-03-28 04:03:03,257: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:03:03.257636414Z [2024-03-28 04:03:03,257: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:03:03.257651160Z [2024-03-28 04:03:03,257: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:03:03.257936643Z [2024-03-28 04:03:03,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:03:03.257949905Z [2024-03-28 04:03:03,257: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:03:03.407174065Z [2024-03-28 04:03:03,406: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:03:04.992195582Z [2024-03-28 04:03:04,991: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9b149ef-a290-46cf-81b5-8379965e71da] succeeded in 3.704234124999857s: None 2024-03-28T04:03:05.062094076Z [2024-03-28 04:03:05,061: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b69298f5-c96e-48f7-a42a-568a8b909b93] succeeded in 3.764397444001588s: None 2024-03-28T04:04:00.485371902Z [2024-03-28 04:04:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d7db91d-0dd7-4933-ae39-11c7b3237451] received 2024-03-28T04:04:00.491557539Z [2024-03-28 04:04:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a288f348-0f18-4ac4-b31e-98d0926faeae] received 2024-03-28T04:04:00.495460095Z [2024-03-28 04:04:00,495: INFO/ForkPoolWorker-15] [7d7db91d-0dd7-4933-ae39-11c7b3237451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:04:00.496697572Z [2024-03-28 04:04:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82f288a3-51e5-4c5e-a5b9-a2ece3ede16f] received 2024-03-28T04:04:00.499904192Z [2024-03-28 04:04:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88871830-6572-4f7f-96a1-f5ab38a21d09] received 2024-03-28T04:04:00.503507713Z [2024-03-28 04:04:00,503: INFO/ForkPoolWorker-16] [a288f348-0f18-4ac4-b31e-98d0926faeae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T04:04:00.504521525Z [2024-03-28 04:04:00,504: INFO/ForkPoolWorker-1] [82f288a3-51e5-4c5e-a5b9-a2ece3ede16f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:04:00.507112567Z [2024-03-28 04:04:00,506: INFO/ForkPoolWorker-2] [88871830-6572-4f7f-96a1-f5ab38a21d09] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:04:00.831852635Z [2024-03-28 04:04:00,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T04:04:00.836379427Z [2024-03-28 04:04:00,832: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:04:00.848370060Z [2024-03-28 04:04:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:04:00.995916872Z [2024-03-28 04:04:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:04:01.041042605Z [2024-03-28 04:04:01,040: INFO/ForkPoolWorker-2] Getting SDNC list 2024-03-28T04:04:01.045274508Z [2024-03-28 04:04:01,044: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:04:01.075814636Z [2024-03-28 04:04:01,075: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:04:01.078153046Z [2024-03-28 04:04:01,077: INFO/ForkPoolWorker-2] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:04:01.078257523Z [2024-03-28 04:04:01,078: INFO/ForkPoolWorker-2] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:04:01.078293597Z [2024-03-28 04:04:01,078: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-03-28T04:04:01.080199707Z [2024-03-28 04:04:01,079: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:04:01.138817491Z [2024-03-28 04:04:01,138: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:04:01.184955903Z [2024-03-28 04:04:01,184: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:04:01.884328468Z [2024-03-28 04:04:01,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a288f348-0f18-4ac4-b31e-98d0926faeae] succeeded in 1.3907633870003338s: None 2024-03-28T04:04:01.928929729Z [2024-03-28 04:04:01,928: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[88871830-6572-4f7f-96a1-f5ab38a21d09] succeeded in 1.4272731149994797s: None 2024-03-28T04:04:02.504269383Z [2024-03-28 04:04:02,503: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:04:02.508111442Z [2024-03-28 04:04:02,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:04:02.532624331Z [2024-03-28 04:04:02,532: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:04:02.534407524Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:04:02.534478907Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:04:02.534641427Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:04:02.534690377Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:04:02.534984261Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:04:02.535033739Z [2024-03-28 04:04:02,534: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:04:02.577346417Z [2024-03-28 04:04:02,576: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:04:02.580923791Z [2024-03-28 04:04:02,580: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:04:02.609067535Z [2024-03-28 04:04:02,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:04:02.611738364Z [2024-03-28 04:04:02,611: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:04:02.612135018Z [2024-03-28 04:04:02,611: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:04:02.612414012Z [2024-03-28 04:04:02,612: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:04:02.612715253Z [2024-03-28 04:04:02,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:04:02.613215228Z [2024-03-28 04:04:02,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:04:02.613428366Z [2024-03-28 04:04:02,613: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:04:02.641891609Z [2024-03-28 04:04:02,641: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:04:02.718304209Z [2024-03-28 04:04:02,717: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:04:04.115305372Z [2024-03-28 04:04:04,114: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82f288a3-51e5-4c5e-a5b9-a2ece3ede16f] succeeded in 3.6166948399986723s: None 2024-03-28T04:04:05.338016831Z [2024-03-28 04:04:05,337: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d7db91d-0dd7-4933-ae39-11c7b3237451] succeeded in 4.850085791000311s: None 2024-03-28T04:05:00.904131501Z [2024-03-28 04:05:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a1d610c-bad6-41db-97a2-1d5507ee12ba] received 2024-03-28T04:05:00.909977751Z [2024-03-28 04:05:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0656623-71a7-4305-a38a-240f64c8fa10] received 2024-03-28T04:05:00.912672906Z [2024-03-28 04:05:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6604f36c-c2ec-45e1-9d2a-ad837b02acb9] received 2024-03-28T04:05:00.914995320Z [2024-03-28 04:05:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2625021-c6d8-4b52-9fb6-9329d2ebcb8b] received 2024-03-28T04:05:00.923134103Z [2024-03-28 04:05:00,922: INFO/ForkPoolWorker-1] [6604f36c-c2ec-45e1-9d2a-ad837b02acb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:05:00.923313111Z [2024-03-28 04:05:00,922: INFO/ForkPoolWorker-16] [e0656623-71a7-4305-a38a-240f64c8fa10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:05:00.923961043Z [2024-03-28 04:05:00,923: INFO/ForkPoolWorker-15] [8a1d610c-bad6-41db-97a2-1d5507ee12ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:05:00.930283401Z [2024-03-28 04:05:00,929: INFO/ForkPoolWorker-2] [f2625021-c6d8-4b52-9fb6-9329d2ebcb8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:05:01.303408328Z [2024-03-28 04:05:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:05:01.368817522Z [2024-03-28 04:05:01,364: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:05:01.396067504Z [2024-03-28 04:05:01,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:05:01.406190480Z [2024-03-28 04:05:01,402: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:05:01.586086929Z [2024-03-28 04:05:01,585: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T04:05:01.590988939Z [2024-03-28 04:05:01,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:01.623194084Z [2024-03-28 04:05:01,622: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:05:01.624841024Z [2024-03-28 04:05:01,624: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:05:01.624906639Z [2024-03-28 04:05:01,624: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:05:01.625029634Z [2024-03-28 04:05:01,624: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T04:05:01.625295888Z [2024-03-28 04:05:01,625: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:05:01.733732636Z [2024-03-28 04:05:01,733: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:02.493653197Z [2024-03-28 04:05:02,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6604f36c-c2ec-45e1-9d2a-ad837b02acb9] succeeded in 1.5774716850010009s: None 2024-03-28T04:05:02.962631617Z [2024-03-28 04:05:02,962: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:05:02.966382214Z [2024-03-28 04:05:02,965: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:02.986393990Z [2024-03-28 04:05:02,985: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T04:05:02.991352349Z [2024-03-28 04:05:02,990: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:03.001743505Z [2024-03-28 04:05:03,001: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:05:03.003881811Z [2024-03-28 04:05:03,003: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:03.004070686Z [2024-03-28 04:05:03,003: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:03.004269024Z [2024-03-28 04:05:03,004: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:03.004399410Z [2024-03-28 04:05:03,004: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:05:03.004770827Z [2024-03-28 04:05:03,004: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:05:03.005825920Z [2024-03-28 04:05:03,004: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:03.040139432Z [2024-03-28 04:05:03,039: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:05:03.042166802Z [2024-03-28 04:05:03,041: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:03.042388192Z [2024-03-28 04:05:03,042: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:03.042760779Z [2024-03-28 04:05:03,042: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:03.043092344Z [2024-03-28 04:05:03,042: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T04:05:03.043535123Z [2024-03-28 04:05:03,043: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:05:03.043727613Z [2024-03-28 04:05:03,043: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:03.190221752Z [2024-03-28 04:05:03,189: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:03.194977470Z [2024-03-28 04:05:03,194: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:05:03.196183837Z [2024-03-28 04:05:03,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:03.199424826Z [2024-03-28 04:05:03,198: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:03.239010391Z [2024-03-28 04:05:03,238: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:05:03.240950488Z [2024-03-28 04:05:03,240: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:03.241090060Z [2024-03-28 04:05:03,240: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:03.241338445Z [2024-03-28 04:05:03,241: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:03.241379843Z [2024-03-28 04:05:03,241: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:05:03.241822653Z [2024-03-28 04:05:03,241: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:05:03.241847480Z [2024-03-28 04:05:03,241: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:03.364435904Z [2024-03-28 04:05:03,364: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:04.043642815Z [2024-03-28 04:05:04,043: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a1d610c-bad6-41db-97a2-1d5507ee12ba] succeeded in 3.137613793998753s: None 2024-03-28T04:05:04.309779711Z [2024-03-28 04:05:04,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8563e7a4-2ba5-4f04-b537-9656b4ccc15f] received 2024-03-28T04:05:04.327778497Z [2024-03-28 04:05:04,327: INFO/ForkPoolWorker-15] [8563e7a4-2ba5-4f04-b537-9656b4ccc15f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'split_metrics', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:05:04.618594984Z [2024-03-28 04:05:04,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:05:05.034902138Z [2024-03-28 04:05:05,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0656623-71a7-4305-a38a-240f64c8fa10] succeeded in 4.120852263000415s: None 2024-03-28T04:05:05.192786044Z [2024-03-28 04:05:05,192: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2625021-c6d8-4b52-9fb6-9329d2ebcb8b] succeeded in 4.27618420699946s: None 2024-03-28T04:05:05.866307259Z [2024-03-28 04:05:05,865: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:05:05.869780849Z [2024-03-28 04:05:05,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:05.889276297Z [2024-03-28 04:05:05,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:05:05.891599172Z [2024-03-28 04:05:05,891: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:05.891736257Z [2024-03-28 04:05:05,891: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:05.892062962Z [2024-03-28 04:05:05,891: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:05.892297592Z [2024-03-28 04:05:05,892: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:05:05.892830712Z [2024-03-28 04:05:05,892: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:05:05.893132629Z [2024-03-28 04:05:05,892: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:05.989859944Z [2024-03-28 04:05:05,989: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:06.692104380Z [2024-03-28 04:05:06,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8563e7a4-2ba5-4f04-b537-9656b4ccc15f] succeeded in 2.375316149000355s: None 2024-03-28T04:05:06.721076971Z [2024-03-28 04:05:06,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d80ec193-9c8a-4fab-8ee0-370113087c50] received 2024-03-28T04:05:06.727234886Z [2024-03-28 04:05:06,726: INFO/ForkPoolWorker-15] [d80ec193-9c8a-4fab-8ee0-370113087c50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'collect_metrics', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-28T04:05:06.996814886Z [2024-03-28 04:05:06,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:05:08.257987683Z [2024-03-28 04:05:08,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:05:08.263899593Z [2024-03-28 04:05:08,263: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:08.296941028Z [2024-03-28 04:05:08,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:05:08.300804580Z [2024-03-28 04:05:08,300: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:08.305111617Z [2024-03-28 04:05:08,304: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:08.305355910Z [2024-03-28 04:05:08,305: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:08.305558572Z [2024-03-28 04:05:08,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:05:08.306148297Z [2024-03-28 04:05:08,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:05:08.306352059Z [2024-03-28 04:05:08,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:08.473656562Z [2024-03-28 04:05:08,468: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:09.076622860Z [2024-03-28 04:05:09,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d80ec193-9c8a-4fab-8ee0-370113087c50] succeeded in 2.353621023001324s: None 2024-03-28T04:05:09.403017472Z [2024-03-28 04:05:09,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6de8acfd-1d70-47fe-8717-06aa15d9d86b] received 2024-03-28T04:05:09.420831141Z [2024-03-28 04:05:09,420: INFO/ForkPoolWorker-15] [6de8acfd-1d70-47fe-8717-06aa15d9d86b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'send_prometheus', 'scheduled__2024-03-28T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-28T04:05:09.824314536Z [2024-03-28 04:05:09,820: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-03-28T04:05:11.021544851Z [2024-03-28 04:05:11,021: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:05:11.025176804Z [2024-03-28 04:05:11,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:05:11.048910178Z [2024-03-28 04:05:11,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:05:11.051151666Z [2024-03-28 04:05:11,050: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:05:11.051299275Z [2024-03-28 04:05:11,051: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:05:11.051555736Z [2024-03-28 04:05:11,051: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:05:11.051730078Z [2024-03-28 04:05:11,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:05:11.052200098Z [2024-03-28 04:05:11,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-03-28T04:05:11.052345807Z [2024-03-28 04:05:11,052: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:05:11.178977082Z [2024-03-28 04:05:11,178: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:05:11.711081882Z [2024-03-28 04:05:11,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6de8acfd-1d70-47fe-8717-06aa15d9d86b] succeeded in 2.3058867150011793s: None 2024-03-28T04:06:01.216120781Z [2024-03-28 04:06:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0047902-8cc7-4584-ae2a-469f48cef51a] received 2024-03-28T04:06:01.220110787Z [2024-03-28 04:06:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1f688c8-4a56-41e7-98a0-b8cac729dcd6] received 2024-03-28T04:06:01.222488557Z [2024-03-28 04:06:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f5e0ed8-4082-4e3b-b321-e8eaefe9d571] received 2024-03-28T04:06:01.224868907Z [2024-03-28 04:06:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a5eded0-e38f-42f4-b4f0-69081f29abcf] received 2024-03-28T04:06:01.225230237Z [2024-03-28 04:06:01,224: INFO/ForkPoolWorker-15] [f0047902-8cc7-4584-ae2a-469f48cef51a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T04:06:01.239494747Z [2024-03-28 04:06:01,239: INFO/ForkPoolWorker-2] [0a5eded0-e38f-42f4-b4f0-69081f29abcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:06:01.239834673Z [2024-03-28 04:06:01,239: INFO/ForkPoolWorker-1] [0f5e0ed8-4082-4e3b-b321-e8eaefe9d571] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:06:01.247459756Z [2024-03-28 04:06:01,247: INFO/ForkPoolWorker-16] [a1f688c8-4a56-41e7-98a0-b8cac729dcd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:06:01.625564561Z [2024-03-28 04:06:01,621: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:06:01.651901633Z [2024-03-28 04:06:01,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T04:06:01.653317237Z [2024-03-28 04:06:01,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:06:01.895594540Z [2024-03-28 04:06:01,891: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:06:02.048899161Z [2024-03-28 04:06:02,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:06:02.098148574Z [2024-03-28 04:06:02,097: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T04:06:02.103392582Z [2024-03-28 04:06:02,102: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:06:02.130808406Z [2024-03-28 04:06:02,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:06:02.133273208Z [2024-03-28 04:06:02,133: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:06:02.133628918Z [2024-03-28 04:06:02,133: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:06:02.133712810Z [2024-03-28 04:06:02,133: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T04:06:02.134377624Z [2024-03-28 04:06:02,134: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:06:02.285657401Z [2024-03-28 04:06:02,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:06:02.753443012Z [2024-03-28 04:06:02,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0047902-8cc7-4584-ae2a-469f48cef51a] succeeded in 1.5352625720006472s: None 2024-03-28T04:06:03.180507067Z [2024-03-28 04:06:03,179: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f5e0ed8-4082-4e3b-b321-e8eaefe9d571] succeeded in 1.9564349110005423s: None 2024-03-28T04:06:03.211759332Z [2024-03-28 04:06:03,211: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:06:03.216667444Z [2024-03-28 04:06:03,215: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:06:03.249178081Z [2024-03-28 04:06:03,248: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:06:03.251789407Z [2024-03-28 04:06:03,251: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:06:03.251906001Z [2024-03-28 04:06:03,251: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:06:03.251941287Z [2024-03-28 04:06:03,251: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:06:03.251948320Z [2024-03-28 04:06:03,251: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:06:03.252297200Z [2024-03-28 04:06:03,252: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:06:03.252431146Z [2024-03-28 04:06:03,252: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:06:03.405788746Z [2024-03-28 04:06:03,404: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:06:03.594131157Z [2024-03-28 04:06:03,593: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T04:06:03.597930722Z [2024-03-28 04:06:03,597: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:06:03.654262513Z [2024-03-28 04:06:03,654: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:06:03.659690105Z [2024-03-28 04:06:03,659: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:06:03.659712838Z [2024-03-28 04:06:03,659: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:06:03.659805132Z [2024-03-28 04:06:03,659: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:06:03.659827671Z [2024-03-28 04:06:03,659: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T04:06:03.660283818Z [2024-03-28 04:06:03,660: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:06:03.660330735Z [2024-03-28 04:06:03,660: INFO/ForkPoolWorker-2] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:06:03.782941538Z [2024-03-28 04:06:03,782: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:06:05.261933711Z [2024-03-28 04:06:05,261: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a5eded0-e38f-42f4-b4f0-69081f29abcf] succeeded in 4.034397913999783s: None 2024-03-28T04:06:05.882614935Z [2024-03-28 04:06:05,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1f688c8-4a56-41e7-98a0-b8cac729dcd6] succeeded in 4.6577529730002425s: None 2024-03-28T04:07:00.529302988Z [2024-03-28 04:07:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd09592f-9da6-4dfb-8eff-0b9698568811] received 2024-03-28T04:07:00.531157715Z [2024-03-28 04:07:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dab53e0c-c787-4a26-a4fe-c16eb4c244e4] received 2024-03-28T04:07:00.536202043Z [2024-03-28 04:07:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f407b1d-3249-459e-8b68-6b49f9cf153c] received 2024-03-28T04:07:00.538858759Z [2024-03-28 04:07:00,538: INFO/ForkPoolWorker-15] [bd09592f-9da6-4dfb-8eff-0b9698568811] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:07:00.539084049Z [2024-03-28 04:07:00,538: INFO/ForkPoolWorker-16] [dab53e0c-c787-4a26-a4fe-c16eb4c244e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:07:00.547476389Z [2024-03-28 04:07:00,547: INFO/ForkPoolWorker-1] [9f407b1d-3249-459e-8b68-6b49f9cf153c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:07:00.851648573Z [2024-03-28 04:07:00,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:07:00.901168815Z [2024-03-28 04:07:00,897: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:07:00.973312632Z [2024-03-28 04:07:00,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:07:01.074756146Z [2024-03-28 04:07:01,074: INFO/ForkPoolWorker-1] Getting SDNC list 2024-03-28T04:07:01.078956970Z [2024-03-28 04:07:01,078: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:07:01.107554669Z [2024-03-28 04:07:01,107: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:07:01.108573250Z [2024-03-28 04:07:01,108: INFO/ForkPoolWorker-1] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:07:01.108617730Z [2024-03-28 04:07:01,108: INFO/ForkPoolWorker-1] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:07:01.108758076Z [2024-03-28 04:07:01,108: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-03-28T04:07:01.110051006Z [2024-03-28 04:07:01,109: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:07:01.204365162Z [2024-03-28 04:07:01,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:07:01.934466075Z [2024-03-28 04:07:01,934: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f407b1d-3249-459e-8b68-6b49f9cf153c] succeeded in 1.396228711000731s: None 2024-03-28T04:07:02.184439154Z [2024-03-28 04:07:02,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:07:02.188512889Z [2024-03-28 04:07:02,187: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:07:02.209146875Z [2024-03-28 04:07:02,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:07:02.210937588Z [2024-03-28 04:07:02,210: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:07:02.211179296Z [2024-03-28 04:07:02,210: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:07:02.211477773Z [2024-03-28 04:07:02,211: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:07:02.211680274Z [2024-03-28 04:07:02,211: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:07:02.212072658Z [2024-03-28 04:07:02,211: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:07:02.212258169Z [2024-03-28 04:07:02,212: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:07:02.308797284Z [2024-03-28 04:07:02,308: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:07:02.539295208Z [2024-03-28 04:07:02,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-03-28T04:07:02.542836104Z [2024-03-28 04:07:02,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:07:02.568887760Z [2024-03-28 04:07:02,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:07:02.570576314Z [2024-03-28 04:07:02,570: INFO/ForkPoolWorker-15] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:07:02.570596455Z [2024-03-28 04:07:02,570: INFO/ForkPoolWorker-15] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:07:02.570751423Z [2024-03-28 04:07:02,570: INFO/ForkPoolWorker-15] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:07:02.570797547Z [2024-03-28 04:07:02,570: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-03-28T04:07:02.571385816Z [2024-03-28 04:07:02,571: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:07:02.571492793Z [2024-03-28 04:07:02,571: INFO/ForkPoolWorker-15] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:07:02.656565089Z [2024-03-28 04:07:02,656: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:07:04.417146078Z [2024-03-28 04:07:04,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd09592f-9da6-4dfb-8eff-0b9698568811] succeeded in 3.8823156260004907s: None 2024-03-28T04:07:05.094505798Z [2024-03-28 04:07:05,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dab53e0c-c787-4a26-a4fe-c16eb4c244e4] succeeded in 4.561867206000898s: None 2024-03-28T04:08:00.790350140Z [2024-03-28 04:08:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4b4ccf0-86cc-4b1d-aab6-757e763b4ded] received 2024-03-28T04:08:00.793915909Z [2024-03-28 04:08:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02ecd630-7974-4dc7-af9f-c2637c78c9e2] received 2024-03-28T04:08:00.801141266Z [2024-03-28 04:08:00,800: INFO/ForkPoolWorker-15] [c4b4ccf0-86cc-4b1d-aab6-757e763b4ded] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-28T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-28T04:08:00.802333859Z [2024-03-28 04:08:00,802: INFO/ForkPoolWorker-16] [02ecd630-7974-4dc7-af9f-c2637c78c9e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:08:00.802496216Z [2024-03-28 04:08:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1af8eac8-af25-494a-b372-8b640c88ef30] received 2024-03-28T04:08:00.805133875Z [2024-03-28 04:08:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[738bd180-7946-4099-8b2e-4946813ddaff] received 2024-03-28T04:08:00.816377615Z [2024-03-28 04:08:00,816: INFO/ForkPoolWorker-2] [738bd180-7946-4099-8b2e-4946813ddaff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:08:00.818776176Z [2024-03-28 04:08:00,818: INFO/ForkPoolWorker-1] [1af8eac8-af25-494a-b372-8b640c88ef30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:08:01.170302202Z [2024-03-28 04:08:01,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:08:01.171785149Z [2024-03-28 04:08:01,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-03-28T04:08:01.240843628Z [2024-03-28 04:08:01,237: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:08:01.278797568Z [2024-03-28 04:08:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:08:01.341612532Z [2024-03-28 04:08:01,341: INFO/ForkPoolWorker-16] Getting SDNC list 2024-03-28T04:08:01.345454522Z [2024-03-28 04:08:01,344: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:08:01.390863982Z [2024-03-28 04:08:01,390: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:08:01.393527745Z [2024-03-28 04:08:01,393: INFO/ForkPoolWorker-16] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:08:01.393771978Z [2024-03-28 04:08:01,393: INFO/ForkPoolWorker-16] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:08:01.393917427Z [2024-03-28 04:08:01,393: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-03-28T04:08:01.394243775Z [2024-03-28 04:08:01,394: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:08:01.520487033Z [2024-03-28 04:08:01,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:08:01.712748990Z [2024-03-28 04:08:01,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:08:02.316532565Z [2024-03-28 04:08:02,316: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4b4ccf0-86cc-4b1d-aab6-757e763b4ded] succeeded in 1.519411315999605s: None 2024-03-28T04:08:02.455407779Z [2024-03-28 04:08:02,454: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02ecd630-7974-4dc7-af9f-c2637c78c9e2] succeeded in 1.65818948299966s: None 2024-03-28T04:08:02.782125529Z [2024-03-28 04:08:02,781: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:08:02.785405882Z [2024-03-28 04:08:02,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:08:02.809357866Z [2024-03-28 04:08:02,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:08:02.811002310Z [2024-03-28 04:08:02,810: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:08:02.811091525Z [2024-03-28 04:08:02,810: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:08:02.811255936Z [2024-03-28 04:08:02,811: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:08:02.811301034Z [2024-03-28 04:08:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:08:02.811651564Z [2024-03-28 04:08:02,811: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:08:02.811720721Z [2024-03-28 04:08:02,811: INFO/ForkPoolWorker-1] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:08:02.813045612Z [2024-03-28 04:08:02,812: INFO/ForkPoolWorker-2] Getting VIM list 2024-03-28T04:08:02.817293471Z [2024-03-28 04:08:02,816: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:08:02.845727104Z [2024-03-28 04:08:02,845: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-03-28T04:08:02.847850026Z [2024-03-28 04:08:02,847: INFO/ForkPoolWorker-2] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:08:02.847991950Z [2024-03-28 04:08:02,847: INFO/ForkPoolWorker-2] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:08:02.848240466Z [2024-03-28 04:08:02,847: INFO/ForkPoolWorker-2] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:08:02.848324664Z [2024-03-28 04:08:02,848: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-03-28T04:08:02.848848200Z [2024-03-28 04:08:02,848: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:08:02.849079710Z [2024-03-28 04:08:02,848: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:08:02.917238510Z [2024-03-28 04:08:02,916: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:08:02.983741475Z [2024-03-28 04:08:02,983: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:08:04.872353034Z [2024-03-28 04:08:04,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1af8eac8-af25-494a-b372-8b640c88ef30] succeeded in 4.066994013999647s: None 2024-03-28T04:08:05.339226091Z [2024-03-28 04:08:05,338: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[738bd180-7946-4099-8b2e-4946813ddaff] succeeded in 4.5323515870004485s: None 2024-03-28T04:09:01.172163406Z [2024-03-28 04:09:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76c249a8-deec-4176-86ac-4478411507b1] received 2024-03-28T04:09:01.174260055Z [2024-03-28 04:09:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c25d989-72ac-4257-8972-d688097e776e] received 2024-03-28T04:09:01.184778130Z [2024-03-28 04:09:01,184: INFO/ForkPoolWorker-15] [76c249a8-deec-4176-86ac-4478411507b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-28T04:09:01.185841127Z [2024-03-28 04:09:01,185: INFO/ForkPoolWorker-16] [7c25d989-72ac-4257-8972-d688097e776e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-28T04:09:01.190869055Z [2024-03-28 04:09:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[095de85f-e3b0-437c-a446-aebd99617e79] received 2024-03-28T04:09:01.202916611Z [2024-03-28 04:09:01,201: INFO/ForkPoolWorker-1] [095de85f-e3b0-437c-a446-aebd99617e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-28T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-28T04:09:01.520275867Z [2024-03-28 04:09:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-03-28T04:09:01.529778580Z [2024-03-28 04:09:01,526: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-03-28T04:09:01.533595140Z [2024-03-28 04:09:01,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-03-28T04:09:01.692407110Z [2024-03-28 04:09:01,691: INFO/ForkPoolWorker-15] Getting SDNC list 2024-03-28T04:09:01.696973563Z [2024-03-28 04:09:01,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:09:01.726009494Z [2024-03-28 04:09:01,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-03-28T04:09:01.731666896Z [2024-03-28 04:09:01,731: INFO/ForkPoolWorker-15] Read SDNC f906052d-77e1-46fe-8ae6-046f5094143e (sdnc-osm) 2024-03-28T04:09:01.732033869Z [2024-03-28 04:09:01,731: INFO/ForkPoolWorker-15] [{'_id': 'f906052d-77e1-46fe-8ae6-046f5094143e', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-03-28T04:09:01.732710587Z [2024-03-28 04:09:01,731: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-03-28T04:09:01.733542129Z [2024-03-28 04:09:01,733: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_f906052d-77e1-46fe-8ae6-046f5094143e 2024-03-28T04:09:01.872625642Z [2024-03-28 04:09:01,872: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:09:02.531785294Z [2024-03-28 04:09:02,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76c249a8-deec-4176-86ac-4478411507b1] succeeded in 1.3571962179994443s: None 2024-03-28T04:09:02.739453213Z [2024-03-28 04:09:02,739: INFO/ForkPoolWorker-1] Getting VIM list 2024-03-28T04:09:02.743109899Z [2024-03-28 04:09:02,742: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:09:02.776777141Z [2024-03-28 04:09:02,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-03-28T04:09:02.778909551Z [2024-03-28 04:09:02,778: INFO/ForkPoolWorker-1] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:09:02.779162639Z [2024-03-28 04:09:02,779: INFO/ForkPoolWorker-1] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:09:02.779364299Z [2024-03-28 04:09:02,779: INFO/ForkPoolWorker-1] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:09:02.779475942Z [2024-03-28 04:09:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-03-28T04:09:02.779868552Z [2024-03-28 04:09:02,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-03-28T04:09:02.780226428Z [2024-03-28 04:09:02,780: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:09:02.882368721Z [2024-03-28 04:09:02,882: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:09:02.994875536Z [2024-03-28 04:09:02,994: INFO/ForkPoolWorker-16] Getting VIM list 2024-03-28T04:09:02.999095141Z [2024-03-28 04:09:02,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '1NPKpYWyHEazJhSkiP5X30RhOfDnvfQS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-03-28T04:09:03.022786614Z [2024-03-28 04:09:03,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-03-28T04:09:03.026794362Z [2024-03-28 04:09:03,026: INFO/ForkPoolWorker-16] Read VIM 7da891ed-1a7c-49be-9b2f-015e934515eb (_system-osm-vim) 2024-03-28T04:09:03.026819050Z [2024-03-28 04:09:03,026: INFO/ForkPoolWorker-16] Read VIM f3602c45-eecd-490c-b369-1ba2b8b0177e (osm) 2024-03-28T04:09:03.026962487Z [2024-03-28 04:09:03,026: INFO/ForkPoolWorker-16] [{'_id': '7da891ed-1a7c-49be-9b2f-015e934515eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'f3602c45-eecd-490c-b369-1ba2b8b0177e', 'name': 'osm', 'vim_type': 'openstack'}] 2024-03-28T04:09:03.027044982Z [2024-03-28 04:09:03,026: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-03-28T04:09:03.027398324Z [2024-03-28 04:09:03,027: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-03-28T04:09:03.027411996Z [2024-03-28 04:09:03,027: INFO/ForkPoolWorker-16] Creating DAG vim_status_f3602c45-eecd-490c-b369-1ba2b8b0177e 2024-03-28T04:09:03.123277203Z [2024-03-28 04:09:03,122: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-03-28T04:09:05.204344977Z [2024-03-28 04:09:05,203: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c25d989-72ac-4257-8972-d688097e776e] succeeded in 4.025986712000304s: None 2024-03-28T04:09:05.491311102Z [2024-03-28 04:09:05,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[095de85f-e3b0-437c-a446-aebd99617e79] succeeded in 4.298588289000691s: None 2024-03-27T23:50:28.827277916Z 2024-03-27T23:50:28.844082363Z Cleaning logs every 900 seconds 2024-03-27T23:50:28.844117799Z Trimming airflow logs to 15 days. 2024-03-28T00:00:00.941878733Z Trimming airflow logs to 15 days. 2024-03-28T00:15:00.197010436Z Trimming airflow logs to 15 days. 2024-03-28T00:15:01.239214555Z Trimming airflow logs to 15 days. 2024-03-28T00:30:00.291843803Z Trimming airflow logs to 15 days. 2024-03-28T00:30:01.331321170Z Trimming airflow logs to 15 days. 2024-03-28T00:45:00.393664670Z Trimming airflow logs to 15 days. 2024-03-28T00:45:01.430854481Z Trimming airflow logs to 15 days. 2024-03-28T01:00:00.529839029Z Trimming airflow logs to 15 days. 2024-03-28T01:00:01.570931717Z Trimming airflow logs to 15 days. 2024-03-28T01:15:00.638577732Z Trimming airflow logs to 15 days. 2024-03-28T01:15:01.705730313Z Trimming airflow logs to 15 days. 2024-03-28T01:30:00.790303597Z Trimming airflow logs to 15 days. 2024-03-28T01:30:01.881895992Z Trimming airflow logs to 15 days. 2024-03-28T01:45:01.009277805Z Trimming airflow logs to 15 days. 2024-03-28T02:00:00.116611651Z Trimming airflow logs to 15 days. 2024-03-28T02:00:01.181764156Z Trimming airflow logs to 15 days. 2024-03-28T02:15:00.255920218Z Trimming airflow logs to 15 days. 2024-03-28T02:15:01.411006361Z Trimming airflow logs to 15 days. 2024-03-28T02:30:00.491564443Z Trimming airflow logs to 15 days. 2024-03-28T02:30:01.571604167Z Trimming airflow logs to 15 days. 2024-03-28T02:45:00.646786943Z Trimming airflow logs to 15 days. 2024-03-28T02:45:01.756967893Z Trimming airflow logs to 15 days. 2024-03-28T03:00:00.901611384Z Trimming airflow logs to 15 days. 2024-03-28T03:00:01.979714870Z Trimming airflow logs to 15 days. 2024-03-28T03:15:00.077971456Z Trimming airflow logs to 15 days. 2024-03-28T03:15:01.197227116Z Trimming airflow logs to 15 days. 2024-03-28T03:30:00.306408701Z Trimming airflow logs to 15 days. 2024-03-28T03:30:01.410912943Z Trimming airflow logs to 15 days. 2024-03-28T03:45:00.586683243Z Trimming airflow logs to 15 days. 2024-03-28T03:45:01.681820675Z Trimming airflow logs to 15 days. 2024-03-28T04:00:00.810637768Z Trimming airflow logs to 15 days. 2024-03-28T04:00:01.914175172Z Trimming airflow logs to 15 days.